Haptic Rendering of Neural Radiance Fields

要旨

The neural radiance field (NeRF) is attracting increasing attentions from researchers in various fields. While NeRF has produced visu- ally plausible results and found its potential applications in virtual reality, users are only allowed to rotate the camera to observe the scene represented as NeRF. We study the haptic interaction with NeRF models in this paper to enable the experience of touching ob- jects reconstructed by NeRF. Existing haptic rendering algorithms do not work well for NeRF-represented models because NeRF is of- ten noisy. We propose a stochastic haptic rendering method to deal with the collision response between the haptic proxy and NeRF. We validate our method with complex NeRF models and experimental results show the efficacy of our proposed algorithm.

著者
Heng Zhang
Southeast University, Nanjing, China
Lifeng Zhu
Southeast University, Nanjing, Jiangsu, China
Yichen Xiang
Southeast University, Nanjing, China
Jianwei Zheng
Southeast University, Nanjing, China
Aiguo Song
Southeast University, Nanjing, Jiangsu, China
論文URL

https://doi.org/10.1145/3586183.3606811

動画

会議: UIST 2023

ACM Symposium on User Interface Software and Technology

セッション: Touching the Future: Haptics and Gestures

Venetian Room
6 件の発表
2023-11-01 19:50:00
2023-11-01 21:10:00