Virtual Minds, Real Work: LLM-Powered Preference-Based Planning through Spatial Multi-Agent-Human Collaboration

要旨

People frequently face preference-based planning tasks requiring balancing goals with nuanced constraints, yet even advanced LLMs demand considerable effort to produce and adjust plans reflecting complex user preferences. We present MAVIS (Multi-Agent Virtual Interactive Synergy), a multi-agent system within a virtual workspace that introduces an incremental collaboration mechanism. This mechanism automatically decomposes tasks into guidelines and sequentially introduces expert agents. Each agent proactively engages users in focused dialog to uncover implicit preferences, while successive agents add perspectives and transparently negotiate trade-offs. To mitigate textual overload, MAVIS employs spatial visualizations that externalize agents' reasoning through step-linked summaries and context-aware boards, with embodied avatars supporting natural interaction. Across studies, Study 1 showed our collaboration mechanism doubled expressed preferences and improved planning quality by 60.3% over a conventional LLM baseline. Study 2 affirmed visualization's benefits over a non-spatial baseline, while Study 3 confirmed its versatility across VR and desktop modalities and diverse tasks.

著者
Ziyi Zhang
Southeast University, Nanjing, China
Xin Yi
Tsinghua University, Beijing, China
Zitong Dai
Southeast University, Nanjing, China
Xuewen Yu
Southeast University, Nanjing, China
Shuning Zhang
Tsinghua University, Beijing, China
Bo Liu
Southeast University, Nanjing, China
Jiuxin Cao
Southeast University, Nanjing, China
Hantao Zhao
Southeast University, Nanjing, China

会議: CHI 2026

ACM CHI Conference on Human Factors in Computing Systems

セッション: AI in Practice

P1 - Room 122
7 件の発表
2026-04-15 18:00:00
2026-04-15 19:30:00