Unlocking the Power of Speech: Game-Based Accent and Oral Communication Training for Immigrant English Language Learners via Large Language Models

要旨

With the growing number of immigrants globally, language barriers have become a significant challenge, particularly for those entering English-speaking countries. Traditional language learning methods often fail to provide sufficient practical opportunities, especially for diverse accents. To address this, we introduce Language Urban Odyssey (LUO), a serious game that leverages large language models (LLMs) and game-based learning to offer a low-cost, accessible virtual environment for English learners. Built on the Minecraft platform, LUO offers real-time speech interaction with NPCs of various accents, supported by multi-modal feedback. A controlled study (N=30) showed improvements in speaking abilities, accent comprehension, and emotional confidence. Our findings suggest that LUO provides a scalable, immersive platform that bridges gaps in language learning for immigrants facing cultural and social challenges.

著者
Yijun Zhao
Zhejiang University, Hangzhou, China
Jiangyu Pan
Zhejiang University, Hangzhou, China
Jiacheng Cao
Zhejiang University, HangZhou, China
Jiarong Zhang
Zhejiang University, Hangzhou, Zhejiang, China
Yan Dong
Zhejiang University, Hangzhou, China
Yicheng Wang
Zhejiang University, HangZhou, Zhejiang, China
Preben Hansen
Stockholm University, Kista, Sweden
Guanyun Wang
Zhejiang University, Hangzhou, China
DOI

10.1145/3706598.3713945

論文URL

https://dl.acm.org/doi/10.1145/3706598.3713945

動画

会議: CHI 2025

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2025.acm.org/)

セッション: Language Matters

G318+G319
6 件の発表
2025-05-01 18:00:00
2025-05-01 19:30:00
日本語まとめ
読み込み中…