A Human-AI Collaborative Approach for Clinical Decision Making on Rehabilitation Assessment


Advances in artificial intelligence (AI) have made it increasingly applicable to supplement expert's decision-making in the form of a decision support system on various tasks. For instance, an AI-based system can provide therapists quantitative analysis on patient's status to improve practices of rehabilitation assessment. However, there is limited knowledge on the potential of these systems. In this paper, we present the development and evaluation of an interactive AI-based system that supports collaborative decision making with therapists for rehabilitation assessment. This system automatically identifies salient features of assessment to generate patient-specific analysis for therapists, and tunes with their feedback. In two evaluations with therapists, we found that our system supports therapists significantly higher agreement on assessment (0.71 average F1-score) than a traditional system without analysis (0.66 average F1-score, $p < 0.05$). After tuning with therapist’s feedback, our system significantly improves its performance from 0.8377 to 0.9116 average F1-scores ($p < 0.01$). This work discusses the potential of a human-AI collaborative system to support more accurate decision making while learning from each other's strengths.

Min Hun Lee
Carnegie Mellon University, Pittsburgh, Pennsylvania, United States
Daniel P. Siewiorek
Carnegie Mellon University, Pittsburgh, Pennsylvania, United States
Asim Smailagic
Carnegie Mellon University, Pittsburgh, Pennsylvania, United States
Alexandre Bernardino
Instituto Superior Tecnico, University of Lisbon, Lisbon, Lisbon, Portugal
Sergi Bermúdez i Badia
Universidade da Madeira, Funchal, Portugal





会議: CHI 2021

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2021.acm.org/)

セッション: Computational Human-AI Conversation

[A] Paper Room 02, 2021-05-11 17:00:00~2021-05-11 19:00:00 / [B] Paper Room 02, 2021-05-12 01:00:00~2021-05-12 03:00:00 / [C] Paper Room 02, 2021-05-12 09:00:00~2021-05-12 11:00:00
Paper Room 02
14 件の発表
2021-05-11 17:00:00
2021-05-11 19:00:00