1. Body as the interface

会議の名前
UIST 2024
MouthIO: Fabricating Customizable Oral User Interfaces with Integrated Sensing and Actuation
要旨

This paper introduces MouthIO, the first customizable intraoral user interface that can be equipped with various sensors and output components. MouthIO consists of an SLA-printed brace that houses a flexible PCB within a bite-proof enclosure positioned between the molar teeth and inner cheeks. Our MouthIO design and fabrication technique enables makers to customize the oral user interfaces in both form and function at low cost. All parts in contact with the oral cavity are made of bio-compatible materials to ensure safety, while the design takes into account both comfort and portability. We demonstrate MouthIO through three application examples ranging from beverage consumption monitoring, health monitoring, to assistive technology. Results from our full-day user study indicate high wearability and social acceptance levels, while our technical evaluation demonstrates the device's ability to withstand adult bite forces.

著者
Yijing Jiang
Aarhus University, Aarhus, Denmark
Julia Kleinau
Aarhus University, Aarhus, Denmark
Till Max Eckroth
Aarhus University, Aarhus, Denmark
Eve Hoggan
Computer Science, Aarhus University, Aarhus, Denmark
Stefanie Mueller
MIT CSAIL, Cambridge, Massachusetts, United States
Michael Wessely
Aarhus University, Aarhus, Denmark
論文URL

https://doi.org/10.1145/3654777.3676443

動画
Can a Smartwatch Move Your Fingers? Compact and Practical Electrical Muscle Stimulation in a Smartwatch
要旨

Smartwatches gained popularity in the mainstream, making them into today’s de-facto wearables. Despite advancements in sensing, haptics on smartwatches is still restricted to tactile feedback (e.g., vibration). Most smartwatch-sized actuators cannot render strong force-feedback. Simultaneously, electrical muscle stimulation (EMS) promises compact force-feedback but, to actuate fingers requires users to wear many electrodes on their forearms. While forearm electrodes provide good accuracy, they detract EMS from being a practical force-feedback interface. To address this, we propose moving the electrodes to the wrist—conveniently packing them in the backside of a smartwatch. In our first study, we found that by cross-sectionally stimulating the wrist in 1,728 trials, we can actuate thumb extension, index extension & flexion, middle flexion, pinky flexion, and wrist flexion. Following, we engineered a compact EMS that integrates directly into a smartwatch’s wristband (with a custom stimulator, electrodes, demultiplexers, and communication). In our second study, we found that participants could calibrate our device by themselves ~50% faster than with conventional EMS. Furthermore, all participants preferred the experience of this device, especially for its social acceptability & practicality. We believe that our approach opens new applications for smartwatch-based interactions, such as haptic assistance during everyday tasks.

受賞
Honorable Mention
著者
Akifumi Takahashi
University of Chicago, Chicago, Illinois, United States
Yudai Tanaka
University of Chicago, Chicago, Illinois, United States
Archit Tamhane
University of Chicago, Chicago, Illinois, United States
Alan Shen
University Of Chicago, Chicago, Illinois, United States
Shan-Yuan Teng
University of Chicago, Chicago, Illinois, United States
Pedro Lopes
University of Chicago, Chicago, Illinois, United States
論文URL

https://doi.org/10.1145/3654777.3676373

動画
Power-over-Skin: Full-Body Wearables Powered By Intra-Body RF Energy
要旨

Powerful computing devices are now small enough to be easily worn on the body. However, batteries pose a major design and user experience obstacle, adding weight and volume, and generally requiring periodic device removal and recharging. In response, we developed Power-over-Skin, an approach using the human body itself to deliver power to many distributed, battery-free, worn devices. We demonstrate power delivery from on-body distances as far as from head-to-toe, with sufficient energy to power microcontrollers capable of sensing and wireless communication. We share results from a study campaign that informed our implementation, as well as experiments that validate our final system. We conclude with several demonstration devices, ranging from input controllers to longitudinal bio-sensors, which highlight the efficacy and potential of our approach.

著者
Andy Kong
Carnegie Mellon University, Pittsburgh, Pennsylvania, United States
Daehwa Kim
Carnegie Mellon University, Pittsburgh, Pennsylvania, United States
Chris Harrison
Carnegie Mellon University, Pittsburgh, Pennsylvania, United States
論文URL

https://doi.org/10.1145/3654777.3676394

動画
HandPad: Make Your Hand an On-the-go Writing Pad via Human Capacitance
要旨

The convenient text input system is a pain point for devices such as AR glasses, and it is difficult for existing solutions to balance portability and efficiency. This paper introduces HandPad, the system that turns the hand into an on-the-go touchscreen, which realizes interaction on the hand via human capacitance. HandPad achieves keystroke and handwriting inputs for letters, numbers, and Chinese characters, reducing the dependency on capacitive or pressure sensor arrays. Specifically, the system verifies the feasibility of touch point localization on the hand using the human capacitance model and proposes a handwriting recognition system based on Bi-LSTM and ResNet. The transfer learning-based system only needs a small amount of training data to build a handwriting recognition model for the target user. Experiments in real environments verify the feasibility of HandPad for keystroke (accuracy of 100%) and handwriting recognition for letters (accuracy of 99.1%), numbers (accuracy of 97.6%) and Chinese characters (accuracy of 97.9%).

著者
Yu Lu
Shanghai Jiao Tong University, Shanghai, China
Dian Ding
Shanghai Jiao Tong University, Shanghai, China
Hao Pan
Shanghai Jiao Tong University, Shanghai, China
Yijie Li
Shanghai Jiao Tong University, Shanghai, China
Juntao Zhou
Shanghai Jiao Tong University, Shanghai, China
Yongjian Fu
Central South University, Changsha, Hunan, China
Yongzhao Zhang
University of Electronic Science and Technology of China, Chengdu, Sichuan, China
Yi-Chao Chen
Shanghai Jiao Tong University, Shanghai, China
Guangtao Xue
Shanghai Jiao Tong University, Shanghai, China
論文URL

https://doi.org/10.1145/3654777.3676328

動画