Augmenting Human Cognition with an AI-Mediated Intelligent Visual Feedback


In this paper, we introduce an AI-mediated framework that can provide intelligent feedback to augment human cognition. Specifically, we leverage deep reinforcement learning (DRL) to provide adaptive time pressure feedback to improve user performance in a math arithmetic task. Time pressure feedback could either improve or deteriorate user performance by regulating user attention and anxiety. Adaptive time pressure feedback controlled by a DRL policy according to users' real-time performance could potentially solve this trade-off problem. However, the DRL training and hyperparameter tuning may require large amounts of data and iterative user studies. Therefore, we propose a dual-DRL framework that trains a regulation DRL agent to regulate user performance by interacting with another simulation DRL agent that mimics user cognition behaviors from an existing dataset. Our user study demonstrates the feasibility and effectiveness of the dual-DRL framework in augmenting user performance, in comparison to the baseline group.

Songlin Xu
University of California, San Diego, San Diego, California, United States
Xinyu Zhang
University of California San Diego, San Diego, California, United States


会議: CHI 2023

The ACM CHI Conference on Human Factors in Computing Systems (

セッション: AI, Cognition & Bias

Hall C
6 件の発表
2023-04-25 20:10:00
2023-04-25 21:35:00