Unlocking Understanding: An Investigation of Multimodal Communication in Virtual Reality Collaboration

要旨

Communication in collaboration, especially synchronous, remote communication, is crucial to the success of task-specific goals. Insufficient or excessive forms of communication may lead to detrimental effects on task performance while increasing mental fatigue. However, identifying which combinations of communication modalities provide the most efficient transfer of information in collaborative settings will greatly improve collaboration. To investigate this, we developed a remote, synchronous, asymmetric VR collaborative assembly task application, where users play the role of either mentor or mentee, and were exposed to different combinations of three communication modalities: voice, gestures, and gaze. Through task-based experiments with 25 pairs of participants (50 individuals), we evaluated quantitative and qualitative data and found that gaze did not differ significantly from multiple combinations of communication modalities. Our qualitative results indicate that mentees experienced more difficulty and frustration in completing tasks than mentors, with both types of users preferring all three modalities to be present.

著者
Ryan Ghamandi
University of Central Florida, Orlando, Florida, United States
Ravi Kiran Kattoju
University of Central Florida, Orlando, Florida, United States
Yahya Hmaiti
University of Central Florida, Orlando, Florida, United States
Mykola Maslych
University of Central Florida, Orlando, Florida, United States
Eugene Matthew. Taranta
University of Central Florida, Orlando, Florida, United States
Ryan P. McMahan
University of Central Florida, Orlando, Florida, United States
Joseph LaViola
University of Central Florida, Orlando, Florida, United States
論文URL

https://doi.org/10.1145/3613904.3642491

動画

会議: CHI 2024

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2024.acm.org/)

セッション: Immersive Experiences: Creating and Communicating

315
5 件の発表
2024-05-14 20:00:00
2024-05-14 21:20:00