1. Beyond mobile

会議の名前
UIST 2024
picoRing: battery-free rings for subtle thumb-to-index input
要旨

Smart rings for subtle, reliable finger input offer an attractive path for ubiquitous interaction with wearable computing platforms. However, compared to ordinary rings worn for cultural or fashion reasons, smart rings are much bulkier and less comfortable, largely due to the space required for a battery, which also limits the space available for sensors. This paper presents picoRing, a flexible sensing architecture that enables a variety of battery-free smart rings paired with a wristband. By inductively connecting a wristband-based sensitive reader coil with a ring-based fully-passive sensor coil, picoRing enables the wristband to stably detect the passive response from the ring via a weak inductive coupling. We demonstrate four different rings that support thumb-to-finger interactions like pressing, sliding, or scrolling. When users perform these interactions, the corresponding ring converts each input into a unique passive response through a network of passive switches. Combining the coil-based sensitive readout with the fully-passive ring design enables a tiny ring that weighs as little as 1.5 g and achieves a 13 cm stable readout despite finger bending, and proximity to metal.

著者
Ryo Takahashi
The University of Tokyo, Hongo, Tokyo, Japan
Eric Whitmire
Meta, Redmond, Washington, United States
Roger Boldu
Meta Reality Labs, Redmond, Washington, United States
Shiu Ng
Meta, Redmond, Washington, United States
Wolf Kienzle
Reality Labs, Seattle, Washington, United States
Hrvoje Benko
Meta Inc., Redmond, Washington, United States
論文URL

https://doi.org/10.1145/3654777.3676365

動画
WatchLink: Enhancing Smartwatches with Sensor Add-Ons via ECG Interface
要旨

We introduce a low-power communication method that lets smartwatches leverage existing electrocardiogram (ECG) hardware as a data communication interface. Our unique approach enables the connection of external, inexpensive, and low-power "add-on" sensors to the smartwatch, expanding its functionalities. These sensors cater to specialized user needs beyond those offered by pre-built sensor suites, at a fraction of the cost and power of traditional communication protocols, including Bluetooth Low Energy. To demonstrate the feasibility of our approach, we conduct a series of exploratory and evaluative tests to characterize the ECG interface as a communication channel on commercial smartwatches. We design a simple transmission scheme using commodity components, demonstrating cost and power benefits. Further, we build and test a suite of add-on sensors, including UV light, body temperature, buttons, and breath alcohol, all of which achieved testing objectives at low material cost and power usage. This research paves the way for personalized and user-centric wearables by offering a cost-effective solution to expand their functionalities.

著者
Anandghan Waghmare
University of Washington, Seattle, Washington, United States
Ishan Chatterjee
University of Washington, Seattle, Washington, United States
Vikram Iyer
University of Washington, Seattle, Washington, United States
Shwetak Patel
University of Washington, Seattle, Washington, United States
論文URL

https://doi.org/10.1145/3654777.3676329

動画
PrISM-Observer: Intervention Agent to Help Users Perform Everyday Procedures Sensed using a Smartwatch
要旨

We routinely perform procedures (such as cooking) that include a set of atomic steps. Often, inadvertent omission or misordering of a single step can lead to serious consequences, especially for those experiencing cognitive challenges such as dementia. This paper introduces PrISM-Observer, a smartwatch-based, context-aware, real-time intervention system designed to support daily tasks by preventing errors. Unlike traditional systems that require users to seek out information, the agent observes user actions and intervenes proactively. This capability is enabled by the agent's ability to continuously update its belief in the user's behavior in real-time through multimodal sensing and forecast optimal intervention moments and methods. We first validated the steps-tracking performance of our framework through evaluations across three datasets with different complexities. Then, we implemented a real-time agent system using a smartwatch and conducted a user study in a cooking task scenario. The system generated helpful interventions, and we gained positive feedback from the participants. The general applicability of PrISM-Observer to daily tasks promises broad applications, for instance, including support for users requiring more involved interventions, such as people with dementia or post-surgical patients.

著者
Riku Arakawa
Carnegie Mellon University, Pittsburgh, Pennsylvania, United States
Hiromu Yakura
University of Tsukuba, Tsukuba, Japan
Mayank Goel
Carnegie Mellon University, Pittsburgh, Pennsylvania, United States
論文URL

https://doi.org/10.1145/3654777.3676350

動画
RadarHand: a Wrist-Worn Radar for On-Skin Touch based Proprioceptive Gestures
要旨

We introduce RadarHand, a wrist-worn wearable with millimetre wave radar that detects on-skin touch-based proprioceptive hand gestures. Radars are robust, private, small, penetrate materials, and require low computation costs. We first evaluated the proprioceptive and tactile perception nature of the back of the hand and found that tapping on the thumb is the least proprioceptive error of all the finger joints, followed by the index finger, middle finger, ring finger, and pinky finger in the eyes-free and high cognitive load situation. Next, we trained deep-learning models for gesture classification. We introduce two types of gestures based on the locations of the back of the hand: generic gestures and discrete gestures. Discrete gestures are gestures that start at specific locations and end at specific locations at the back of the hand, in contrast to generic gestures, which can start anywhere and end anywhere on the back of the hand. Out of 27 gesture group possibilities, we achieved 92% accuracy for a set of seven gestures and 93% accuracy for the set of eight discrete gestures. Finally, we evaluated RadarHand’s performance in real-time under two interaction modes: Active interaction and Reactive interaction. Active interaction is where the user initiates input to achieve the desired output, and reactive interaction is where the device initiates interaction and requires the user to react. We obtained an accuracy of 87% and 74% for active generic and discrete gestures, respectively, as well as 91% and 81.7% for reactive generic and discrete gestures, respectively. We discuss the implications of RadarHand for gesture recognition and directions for future works.

著者
Mr Ryo Hajika
Massey University, Auckland C, Auckland, New Zealand
Tamil Selvan Gunasekaran
The University of Auckland, Auckland, New Zealand
Chloe Haigh
The University of Auckland, Auckland, Auckland, New Zealand
Yun Suen Pai
University of Auckland, Auckland, New Zealand
Eiji Hayashi
Meta, Menlo Park, California, United States
Jaime Lien
Archetype AI, San Francisco Bay Area, California, United States
Danielle Lottridge
University of Auckland, Auckland, Auckland, New Zealand
Mark Billinghurst
University of South Australia, Mawson Lakes, Australia