Replicate and Reuse: Tangible Interaction Design for Digitally-Augmented Physical Media Objects


Technology has transformed our physical interactions into infinitely more scalable and flexible digital ones. We can peruse an infinite number of photos, news articles, and books. However, these digital experiences lack the physical experience of paging through an album, reading a newspaper, or meandering through a bookshelf. Overlaying physical objects with digital content using augmented reality is a promising avenue towards bridging this gap. In this paper, we investigate the interaction design for such digital-overlaid physical objects and their varying levels of tangibility. We first conduct a user evaluation of a physical photo album that uses tangible interactions to support physical and digital operations. We further prototype multiple objects including bookshelves and newspapers and probe users on their usage, capabilities, and interactions. We then conduct a qualitative investigation of three interaction designs with varying tangibility that use three different input modalities. Finally, we discuss the insights from our investigations and recommend design guidelines.

augmented reality
tangible interaction
physical objects
Aakar Gupta
University of Waterloo, Waterloo, ON, Canada
Bo Rui Lin
University of Waterloo & Pinterest Inc., Waterloo, ON, Canada
Siyi Ji
University of Waterloo, Waterloo, ON, Canada
Arjav Patel
University of Waterloo, Waterloo, ON, Canada
Daniel Vogel
University of Waterloo, Waterloo, ON, Canada



会議: CHI 2020

The ACM CHI Conference on Human Factors in Computing Systems

セッション: Tools & interfaces

Paper session
313C O'AHU
2020-04-28 01:00:00
2020-04-28 02:15:00