From Answer Givers to Design Mentors: Guiding LLMs with the Cognitive Apprenticeship Model

要旨

Design feedback helps practitioners improve their artifacts while also fostering reflection and design reasoning. Large Language Models (LLMs) such as ChatGPT can support design work, but often provide generic, one-off suggestions that limit reflective engagement. We investigate how to guide LLMs to act as design mentors by applying the Cognitive Apprenticeship Model, which emphasizes demonstrating reasoning through six methods: modeling, coaching, scaffolding, articulation, reflection, and exploration. We operationalize these instructional methods through structured prompting and evaluate them in a within-subjects study with data visualization practitioners. Participants interacted with both a baseline LLM and an instructional LLM designed with cognitive apprenticeship prompts. We further conducted surveys, interviews, and conversational log analyses to evaluate experiences across conditions. Our findings show that cognitively informed prompts elicit deeper design reasoning and more reflective feedback exchanges, though the baseline is sometimes preferred depending on task types or experience levels. We distill design considerations for AI-assisted feedback systems that foster reflective practice.

著者
Yongsu Ahn
Boston College, Chestnut Hill, Massachusetts, United States
Lejun R. Liao
Boston College, Chestnut Hill, Massachusetts, United States
Benjamin Bach
Inria, Bordeaux, France
Nam Wook Kim
Boston College, Chestnut Hill, Massachusetts, United States

会議: CHI 2026

ACM CHI Conference on Human Factors in Computing Systems

セッション: AI & Data Visualization

M2 - Room M211/212
6 件の発表
2026-04-15 18:00:00
2026-04-15 19:30:00