Dreamcrafter: Immersive Editing of 3D Radiance Fields Through Flexible, Generative Inputs and Outputs

要旨

Authoring 3D scenes is a central task for spatial computing applications. Competing visions for lowering existing barriers are (1) focus on immersive, direct manipulation of 3D content or (2) leverage AI techniques that capture real scenes (3D Radiance Fields such as, NeRFs, 3D Gaussian Splatting) and modify them at a higher level of abstraction, at the cost of high latency. We unify the complementary strengths of these approaches and investigate how to integrate generative AI advances into real-time, immersive 3D Radiance Field editing. We introduce Dreamcrafter, a VR-based 3D scene editing system that: (1) provides a modular architecture to integrate generative AI algorithms; (2) combines different levels of control for creating objects, including natural language and direct manipulation; and (3) introduces proxy representations that support interaction during high-latency operations. We contribute empirical findings on control preferences and discuss how generative AI interfaces beyond text input enhance creativity in scene editing and world building.

著者
Cyrus Vachha
University of California, Berkeley, Berkeley, California, United States
Yixiao Kang
University of California, Berkeley, Berkeley, California, United States
Zach Dive
University of California, Berkeley, Berkeley, California, United States
Ashwat Chidambaram
University of California, Berkeley, Berkeley, California, United States
Anik Gupta
University of California, Berkeley, Berkeley, California, United States
Eunice Jun
University of California, Los Angeles, Los Angeles, California, United States
Bjoern Hartmann
UC Berkeley, Berkeley, California, United States
DOI

10.1145/3706598.3714312

論文URL

https://dl.acm.org/doi/10.1145/3706598.3714312

動画

会議: CHI 2025

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2025.acm.org/)

セッション: 3D Design and Fabrication

Annex Hall F204
6 件の発表
2025-04-30 01:20:00
2025-04-30 02:50:00
日本語まとめ
読み込み中…