Sketch2Terrain: AI-Driven Real-Time Terrain Sketch Mapping in Augmented Reality

要旨

Sketch mapping is an effective technique to externalize and communicate spatial information. However, it has been limited to 2D mediums, making it difficult to represent 3D information, particularly for terrains with elevation changes. We present Sketch2Terrain, an intuitive generative-3D-sketch-mapping system combining freehand sketching with generative Artificial Intelligence that radically changes sketch map creation and representation using Augmented Reality. Sketch2Terrain empowers non-experts to create unambiguous sketch maps of natural environments and provides a homogeneous interface for researchers to collect data and conduct experiments. A between-subject study (N=36) revealed that generative-3D-sketch-mapping improved efficiency by 38.4%, terrain-topology accuracy by 12.5%, and landmark accuracy by up to 12.1%, with only a 4.7% trade-off in terrain-elevation accuracy compared to freehand 3D-sketch-mapping. Additionally, generative-3D-sketch-mapping reduced perceived strain by 60.5% and stress by 39.5% over 2D-sketch-mapping. These findings underscore potential applications of generative-3D-sketch-mapping for in-depth understanding and accurate representation of vertically complex environments. The implementation is publicly available.

著者
Tianyi Xiao
Institute of Cartography and Geoinformation, ETH Zurich, Zürich, Switzerland
Yizi Chen
IKG, Zurich, Switzerland
Sailin Zhong
ETH Zürich, Zürich, Switzerland
Peter Kiefer
ETH Zurich, Zurich, ZH, Switzerland
Jakub Krukar
University of Muenster, Muenster, Germany
Kevin Gonyop Kim
FHNW University of Applied Sciences and Arts Northwestern Switzerland, Windisch, Switzerland
Lorenz Hurni
ETH Zurich, Zurich, Switzerland
Angela Schwering
University of Muenster, Muenster, Germany
Martin Raubal
ETH Zurich, Zurich, ZH, Switzerland
DOI

10.1145/3706598.3713467

論文URL

https://dl.acm.org/doi/10.1145/3706598.3713467

動画

会議: CHI 2025

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2025.acm.org/)

セッション: Immersive Touch and Gesture Interaction

G303
7 件の発表
2025-04-30 20:10:00
2025-04-30 21:40:00
日本語まとめ
読み込み中…