STREAM: Exploring the Combination of Spatially-Aware Tablets with Augmented Reality Head-Mounted Displays for Immersive Analytics


Recent research in the area of immersive analytics demonstrated the utility of head-mounted augmented reality devices for visual data analysis. However, it can be challenging to use the by default supported mid-air gestures to interact with visualizations in augmented reality (e.g. due to limited precision). Touch-based interaction (e.g. via mobile devices) can compensate for these drawbacks, but is limited to two-dimensional input. In this work we present STREAM: Spatially-aware Tablets combined with Augmented Reality Head-Mounted Displays for the multimodal interaction with 3D visualizations. We developed a novel eyes-free interaction concept for the seamless transition between the tablet and the augmented reality environment. A user study reveals that participants appreciated the novel interaction concept, indicating the potential for spatially-aware tablets in augmented reality. Based on our findings, we provide design insights to foster the application of spatially-aware touch devices in augmented reality and research implications indicating areas that need further investigation.

Sebastian Hubenschmid
University of Konstanz, Konstanz, Germany
Johannes Zagermann
University of Konstanz, Konstanz, Germany
Simon Butscher
University of Konstanz, Konstanz, Germany
Harald Reiterer
University of Konstanz, Konstanz, Germany




会議: CHI 2021

The ACM CHI Conference on Human Factors in Computing Systems (

セッション: Novel Visualization Techniques

[A] Paper Room 09, 2021-05-11 17:00:00~2021-05-11 19:00:00 / [B] Paper Room 09, 2021-05-12 01:00:00~2021-05-12 03:00:00 / [C] Paper Room 09, 2021-05-12 09:00:00~2021-05-12 11:00:00
Paper Room 09
15 件の発表
2021-05-11 17:00:00
2021-05-11 19:00:00