Co-Designing QuickPic: Automated Topic-Specific Communication Boards from Photographs for AAC-Based Language Instruction

要旨

Traditional topic-specific communication boards for Augmentative and Alternative Communication (AAC) require manual programming of relevant symbolic vocabulary, which is time-consuming and often impractical even for experienced Speech-Language Pathologists (SLPs). While recent research has demonstrated the potential to automatically generate these boards from photographs using artificial intelligence, there has been no exploration on how to design such tools to support the specific needs of AAC-based language instruction. This paper introduces QuickPic, a mobile AAC application co-designed with SLPs and special educators, aimed at enhancing language learning for non-speaking individuals, such as autistic children. Through a 17-month design process, we uncover the unique design features required to provide timely language support in therapy and special education contexts. We present emerging evidence on the overall satisfaction of SLPs using QuickPic, and on the advantages of large language model-based generation compared to the existing technique for automated vocabulary from photographs for AAC.

著者
Mauricio Fontana de Vargas
McGill University, Montreal, Quebec, Canada
Christina Yu
Boston Children's Hospital, Boston, Massachusetts, United States
Howard C. Shane
Boston Children’s Hospital, Boston, Massachusetts, United States
Karyn Moffatt
McGill University, Montreal, Quebec, Canada
論文URL

doi.org/10.1145/3613904.3642080

動画

会議: CHI 2024

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2024.acm.org/)

セッション: Supporting Communication Needs A

324
5 件の発表
2024-05-14 18:00:00
2024-05-14 19:20:00