SonarID: Using Sonar to Identify Fingers on a Smartwatch


The diminutive size of wrist wearables has prompted the design of many novel input techniques to increase expressivity. Finger identification, or assigning different functionality to different fingers, has been frequently proposed. However, while the value of the technique seems clear, its implementation remains challenging, often relying on external devices (e.g., worn magnets) or explicit instructions. Addressing these limitations, this paper explores a novel approach to natural and unencumbered finger identification on an unmodified smartwatch: sonar. To do this, we adapt an existing finger tracking smartphone sonar implementation---rather than extract finger motion, we process raw sonar fingerprints representing the complete sonar scene recorded during a touch. We capture data from 16 participants operating a smartwatch and use their sonar fingerprints to train a deep learning recognizer that identifies taps by the thumb, index, and middle fingers with an accuracy of up to 93.7%, sufficient to support meaningful application development.

Jiwan Kim
UNIST, Ulsan, Korea, Republic of
Ian Oakley
UNIST, Ulsan, Korea, Republic of


会議: CHI 2022

The ACM CHI Conference on Human Factors in Computing Systems (

セッション: Sensing

5 件の発表
2022-05-05 01:15:00
2022-05-05 02:30:00