An Evaluation of Situational Autonomy for Human-AI Collaboration in a Shared Workspace Setting

要旨

Designing interactions for human-AI teams (HATs) can be challenging due to an AI agent's potential autonomy. Previous work suggests that higher autonomy does not always improve team performance, and situation-dependent autonomy adaptation might be beneficial. However, there is a lack of systematic empirical evaluations of such autonomy adaptation in human-AI interaction. Therefore, we propose a cooperative task in a simulated shared workspace to investigate effects of fixed levels of AI autonomy and situation-dependent autonomy adaptation on team performance and user satisfaction. We derive adaptation rules for AI autonomy from previous work and a pilot study. We implement these rule for our main experiment and find that team performance was best when humans collaborated with an agent adjusting its autonomy based on the situation. Additionally, users rated this agent highest in terms of perceived intelligence. From these results, we discuss the influence of varying autonomy degrees on HATs in shared workspaces.

著者
Vildan Salikutluk
TU Darmstadt, Darmstadt, Germany
Janik Schöpper
TU Darmstadt, Darmstadt, Hessen, Germany
Franziska Herbert
TU Darmstadt, Darmstadt, Germany
Katrin Scheuermann
TU Darmstadt, Darmstadt, Germany
Eric Frodl
TU Darmstadt , Darmstadt, Germany
Dirk Balfanz
TU Darmstadt, Darmstadt, Germany
Frank Jäkel
TU Darmstadt, Darmstadt, Germany
Dorothea Koert
TU Darmstadt, Darmstadt, Germany
論文URL

doi.org/10.1145/3613904.3642564

動画

会議: CHI 2024

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2024.acm.org/)

セッション: Evaluating AI Technologies A

321
5 件の発表
2024-05-15 01:00:00
2024-05-15 02:20:00