"Here, Let Me Help": An Empirical Study of User Interventions in Human–Web Agent Collaboration

要旨

Web agents aim to execute complex online tasks from high-level instructions, yet fully autonomous execution remains challenging in practice. We present an empirical study of user interventions in human–web agent collaboration, moving beyond outcome-based metrics to examine how interventions unfold during execution. We conducted a controlled in-lab study with 30 participants whose interactions reflected early-stage web agent adoption across 12 structured tasks in shopping, travel, and information-seeking domains using live websites. Analyzing interaction logs, user inputs, and screen recordings, we identify diverse behaviors and propose a taxonomy capturing both the reasons for intervention and the forms they take. We distinguish explicit interventions, where users halt or override actions, from implicit interventions, where users guide or prepare the environment without stopping execution. Our findings reveal how task structure and execution breakdowns shape intervention behaviors to provide process-level evidence for designing web agents that better support users as active collaborators.

受賞
Honorable Mention
著者
Joohee Kim
Ulsan National Institute of Science and Technology, Ulsan, Korea, Republic of
Sungbeom Cho
POSTECH, Pohang, Korea, Republic of
Duc M. Nguyen
Pohang University of Science and Technology, Pohang, Korea, Republic of
Jaehyeong Jeon
POSTECH, Pohang, Korea, Republic of
Minjeong Shin
Pohang University of Science and Technology, Pohang-si, Gyeongsangbuk-do, Korea, Republic of
Sungahn Ko
POSTECH, Pohang, Korea, Republic of

会議: CHI 2026

ACM CHI Conference on Human Factors in Computing Systems

セッション: Trust and Perception in AI Systems

P1 - Room 118
7 件の発表
2026-04-14 20:15:00
2026-04-14 21:45:00