When Audio Is Enough: Design-Tradeoffs in Multi-Story MR Navigation

要旨

Mixed Reality (MR) interfaces have traditionally relied on visual modalities, but this poses challenges in high-stakes or cognitively demanding contexts where continuous visual attention is impractical. This exploratory study investigates audio-centric interaction in MR, specifically focusing on 3D spatial navigation. Unlike prior work limited to 2D navigation, we developed a custom augmented reality (AR) navigation system to compare \textit{audio AR} (AAR) with (1) visual AR, (2) combined audio-visual AR, and (3) traditional navigation without aids. Results show that AAR enables users to maintain environmental awareness comparable to those without AR assistance, while showing no meaningful difference in navigation performance with visual AR in complex 3D environments. Qualitative reports and awareness tests suggest AAR reduces visual tunneling. These exploratory findings suggest the potential use of AAR in many surrounding fields, such as accessibility for blind or visually impaired individuals or training resources for first responders, offering insights into audio interface design for safety-critical applications.

著者
Bilgehan Cagiltay
Sabanci University, Istanbul, Turkey
Selim Balcisoy
Sabanci University, Tuzla, Istanbul, Turkey

会議: CHI 2026

ACM CHI Conference on Human Factors in Computing Systems

セッション: XR Navigation

Area 1 + 2 + 3: theatre
7 件の発表
2026-04-15 20:15:00
2026-04-15 21:45:00