Lookee: Gaze Tracking-based Infant Vocabulary Comprehension Assessment and Analysis

要旨

Measuring preverbal vocabulary comprehension of young children is vital for early intervention and developmental evaluation, yet challenging due to their limited communication abilities. We introduce Lookee, an AI-powered vocabulary comprehension assessment tool through gaze tracking for toddlers in the preverbal stage. Lookee incorporates the Intermodal Preferential Looking Paradigm (IPLP), which is one of the prominent word comprehension measures for toddlers and estimates word comprehension through a random forest model analysis. We design and validate Lookee through user studies involving 19 toddlers and their parents. Then we identify necessary design requirements from potential stakeholders' perspectives through in-depth interviews including researchers, clinicians, and parents. As a result, Lookee achieves considerable estimation accuracy with sufficient system usability, and demonstrates key design requirements for each stakeholder group. From our study, we highlight necessary design implications in developing and validating AI-powered clinical tools for toddlers.

著者
Minji Kim
Seoul National University, Seoul, Korea, Republic of
Minkyu Shim
Seoul National University, Seoul, Korea, Republic of
Jun Ho Chai
Sunway University, Kuala Lumpur, Malaysia
Eon-Suk Ko
Chosun University, Gwangju, Korea, Republic of
Youngki Lee
Seoul National University, Seoul, Korea, Republic of
DOI

10.1145/3706598.3713386

論文URL

https://dl.acm.org/doi/10.1145/3706598.3713386

動画

会議: CHI 2025

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2025.acm.org/)

セッション: Language Matters

G318+G319
6 件の発表
2025-05-01 18:00:00
2025-05-01 19:30:00
日本語まとめ
読み込み中…