Who Does What? Archetypes of Roles Assigned to LLMs During Human-AI Decision-Making

要旨

LLMs are increasingly supporting decision-making across high-stakes domains, requiring critical reflection on the socio-technical factors that shape how humans and LLMs are assigned roles and interact during human-in-the-loop decision-making. This paper introduces the concept of human-LLM archetypes -- defined as recurring socio-technical interaction patterns that structure the roles of humans and LLMs in collaborative decision-making. We describe 17 human-LLM archetypes derived from a scoping literature review and thematic analysis of 113 LLM-supported decision-making papers. Then, we evaluate these diverse archetypes across real-world clinical diagnostic cases to examine the potential effects of adopting distinct human-LLM archetypes on LLM outputs and decision outcomes. Finally, we present relevant tradeoffs and design choices across human-LLM archetypes, including decision control, social hierarchies, cognitive forcing strategies, and information requirements. Through our analysis, we show that selection of human-LLM interaction archetype can influence LLM outputs and decisions, bringing important risks and considerations for the designers of human-AI decision-making systems.

著者
Shreya Chappidi
University of Cambridge, Cambridge, United Kingdom
Jatinder Singh
University of Cambridge, Cambridge, United Kingdom
Andra Valentina. Krauze
NCI NIH, BETHESDA, Maryland, United States

会議: CHI 2026

ACM CHI Conference on Human Factors in Computing Systems

セッション: LLM Interactions and Generative AI Mechanics

P1 - Room 124
7 件の発表
2026-04-14 20:15:00
2026-04-14 21:45:00