InterFACE: Establishing a Facial Action Unit Input Vocabulary for Hands-Free Extended Reality Interactions, From VR Gaming to AR Web Browsing

要旨

Extended Reality (XR) interactions often rely on spatial hand or controller inputs - necessitating dexterous wrist, hand and finger movements including pressing virtual buttons, pinching to select, and performing hand gestures. However, there are scenarios where such dependencies may render XR devices and apps inaccessible to users - from situational/temporary impairments such as encumbrance, to physical motor impairments. In this paper, we contribute to a growing literature considering facial input as an alternative. In a user study (N=20) we systematically evaluate the usability of 53 Facial Action Units in VR, deriving a set of optimal (comfort, effort, performance) FAUs for interaction. We then use these facial inputs to drive and evaluate (N=10) two demonstrator apps: VR locomotion, and AR web browsing, showcasing how close facial interaction can get to existing baselines, and demonstrating that FAUs offer a viable, generalizable input modality for XR devices.

著者
Graham Wilson
University of Glasgow, Glasgow, United Kingdom
Jamie McCready
University of Glasgow, Glasgow, United Kingdom
Euan Freeman
University of Glasgow, Glasgow, United Kingdom
Florian Mathis
University of St. Gallen, St. Gallen, Switzerland
Harvey Russell
University of Glasgow, Glasgow, United Kingdom
Mark McGill
University of Glasgow, Glasgow, Lanarkshire, United Kingdom
DOI

10.1145/3706598.3713694

論文URL

https://dl.acm.org/doi/10.1145/3706598.3713694

動画

会議: CHI 2025

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2025.acm.org/)

セッション: Interaction Techniques

Annex Hall F204
7 件の発表
2025-04-28 23:10:00
2025-04-29 00:40:00
日本語まとめ
読み込み中…