SpatialProto: Exploring Real-World Motion Captures for Rapid Prototyping of Interactive Mixed Reality


Spatial computing devices that blend virtual and real worlds have the potential to soon become ubiquitous. Yet, creating experiences for spatial computing is non-trivial and needs skills in programming and 3D content creation, rendering them inaccessible to a wider group of users. We present SpatialProto, an in-situ spatial prototyping system for lowering the barrier to engage in spatial prototyping. With a depth-sensing capable Mixed Reality headset, SpatialProto lets users record animated objects of the real-world environment (e.g. paper, clay, people or any other prop), extract only the relevant parts, and directly place and transform these recordings in their physical environment. We describe the design and implementation of SpatialProto, a user study evaluating the system's prototype with non-expert users (n=9), and demonstrate applications where multiple captures are fused for compelling Augmented Reality experiences.

Leon Müller
LMU Munich, Munich, Germany
Ken Pfeuffer
Bundeswehr University Munich, Munich, Germany
Jan Gugenheimer
Institut Polytechnique de Paris, Paris, France
Bastian Pfleging
Eindhoven University of Technology, Eindhoven, Netherlands
Sarah Prange
Bundeswehr University Munich, Munich, Germany
Florian Alt
Bundeswehr University Munich, Munich, Germany




会議: CHI 2021

The ACM CHI Conference on Human Factors in Computing Systems (

セッション: UX and Interaction Design and Research: Techniques, Insights & Prototyping / Reflection, Behavior, Change & Learning

[C] Paper Room 13, 2021-05-14 09:00:00~2021-05-14 11:00:00 / [A] Paper Room 13, 2021-05-13 17:00:00~2021-05-13 19:00:00 / [B] Paper Room 13, 2021-05-14 01:00:00~2021-05-14 03:00:00
Paper Room 13
13 件の発表
2021-05-14 09:00:00
2021-05-14 11:00:00