Interactive Organisms Lab
Undergraduate Student Researcher
Role
HCI Researcher
Motion & Graphic Designer
Timeline
September 2020 - June 2021
Highlights
Augmented Humans International Conference 2021
Best Demo Award and Publication
I explored the intersection of design and technology through human-computer interaction, wearables and beauty technology research.
I worked with researchers from diverse disciplines and developed skills with programmable devices, tactile user interfaces. I studied 3D printing and modeling techniques and interactivity through programmed interfaces (Arduino), electronic sensors and Bluetooth communication. I developed an on-skin interface to communicate through human facial gestures.
GemiN' I
Seamless Skin Interfaces Aiding Communication through Unconscious Behaviors
Shuyi Sun, Neha Deshmukh, Xin Chen, Hao-Chuan Wang, and Katia Vega.
Voice command is the primary way of interacting with smart home devices and virtual assistants. However, being vocal is not always feasible or appropriate. This project aims to explore the potential of on-skin interfaces in social settings by discreetly communicating to a smart home device when enacting nearly unconscious behaviors. GemiN'I is a Beauty Technology that aesthetically and inconspicuously embeds sensors in face jewels to detect facial muscle movements, which then signals smart home devices without vocal commands, allowing the user and observers to interact without vocal interrupts. Our design rationale consists on: a) the form factor of a commercially available product for face decoration such as facial gems, b) novel discrete interfaces by making the technology invisible(circuits hidden within the gems), and the interaction by triggering devices when enacting unconscious behaviors (frowning), and c) seamlessly triggering a device in presence of an observer.
Publication
Shuyi Sun, Neha Deshmukh, Xin Chen, Hao-Chuan Wang, and Katia Vega. 2021. GemiN’ I: Seamless Skin Interfaces Aiding Communication through Unconscious Behaviors. In Augmented Humans Conference 2021 (AHs’21). Association for Computing Machinery, New York, NY, USA, 277–279. DOI:https://doi.org/10.1145/3458709.3458997
Demo and Scenarios
Functionality
GemiN' I prototype. a) on-skin interface through 3 layers: aesthetic top layer with gemstones, circuit design by switches and connections, and adhesive for insulation in the bottom layer. b) System design. c,d) Interaction through a frown to activate the device.
Conferences and Awards
Augmented Humans (AHs) International Conference 2021