EchoSight: Streamlining Bidirectional Virtual-physical Interaction with In-situ Optical Tethering

要旨

Emerging AR applications require seamless integration of the virtual and physical worlds, which calls for tools that support both passive perception and active manipulation of the environment, enabling bidirectional interaction. We introduce EchoSight, a system for AR glasses that enables efficient look-and-control bidirectional interaction. EchoSight exploits optical wireless communication to instantaneously connect virtual data with its physical counterpart. EchoSight's unique dual-element optical design leverages beam directionality to automatically align the user's focus with target objects, reducing the overhead in both target identification and subsequent communication. This approach streamlines user interaction, reducing cognitive load and enhancing engagement. Our evaluations demonstrate EchoSight's effectiveness for room-scale communication, achieving distances up to 5 m and viewing angles up to 120 degrees. A study with 12 participants confirms EchoSight's improved efficiency and user experience over traditional methods, such as QR Code scanning and voice control, in AR IoT applications.

著者
Jingyu Li
Peking University, Beijing, China
Qingwen Yang
Peking University, Beijing, China
Kenuo Xu
Peking University, Beijing, China
Yang Zhang
University of California, Los Angeles, Los Angeles, California, United States
Chenren Xu
Peking University, Beijing, China
DOI

10.1145/3706598.3713925

論文URL

https://dl.acm.org/doi/10.1145/3706598.3713925

動画

会議: CHI 2025

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2025.acm.org/)

セッション: AR Interaction

Annex Hall F206
7 件の発表
2025-04-30 23:10:00
2025-05-01 00:40:00
日本語まとめ
読み込み中…