Criticmate: Stagewise Human-AI Co-Critique in UI Design through Situation Awareness

要旨

AI tools are increasingly used for UI evaluation, yet most treat evaluation as a single-pass, black-box process that limits both effective model reasoning and human involvement. Grounded in Situation Awareness (SA) theory, we reframe single-screen heuristic evaluation of mobile UIs as stagewise human--AI co-critique, structuring evaluation into three editable stages: Perception (what is on the screen), Comprehension (what elements mean and do), and Projection (what problems and fixes follow). We instantiate this framing in Criticmate, an interactive system that exposes intermediate reasoning artifacts for intervention. Across offline benchmarks and a controlled user study, we show that stagewise co-critique yields more expert-like and better balanced critiques than single-pass approaches, while supporting higher trust and engagement without reducing perceived autonomy.

著者
Jisu Ko
Hanyang University, Ansan, Korea, Republic of
Jinyoung Choi
Hanyang University, Ansan, Korea, Republic of
Cielo Morales
Hanyang University, ANSAN, Korea, Republic of
Dajung Kim
Ulsan National Institute of Science and Technology (UNIST), Ulsan, Korea, Republic of
Minsam Ko
Hanyang University ERICA, Ansan, Korea, Republic of

会議: CHI 2026

ACM CHI Conference on Human Factors in Computing Systems

セッション: AI for Task Augmentation

Area 1 + 2 + 3: theatre
7 件の発表
2026-04-15 18:00:00
2026-04-15 19:30:00