Not Seeing the Whole Picture: Challenges and Opportunities in Using AI for Co-Making Physical, DIY-AT for People with Visual Impairments

要旨

Existing assistive technologies (AT) often adopt a one-size-fits-all approach, overlooking the diverse needs of people with visual impairments (PVI). Do-it-yourself AT (DIY-AT) toolkits offer one path toward customization, but most remain limited—targeting co-design with engineers or requiring programming expertise. Non-professionals with disabilities, including PVI, also face barriers such as inaccessible tools, lack of confidence, and insufficient technical knowledge. These gaps highlight the need for prototyping technologies that enable PVI to directly make their own AT. Building on emerging evidence that large language models (LLMs) can serve not only as visual aids but also as co-design partners, we present an exploratory study of how LLM-based AI can support PVI in the tangible DIY-AT co-making process. Our findings surface key challenges and design opportunities: the need for greater spatial and visual support, strategies for mitigating novel AI errors, and implications for designing more accessible AI-assisted prototypes.

著者
Ben Kosa
University of Wisconsin--Madison, Madison, Wisconsin, United States
Hsuanling Lee
Purdue University, West Lafayette, Indiana, United States
Jasmine Li
Purdue University, West Lafayette, Indiana, United States
Sanbrita Mondal
University of Wisconsin-Madison, Madison, Wisconsin, United States
Yuhang Zhao
University of Wisconsin-Madison, Madison, Wisconsin, United States
Liang He
University of Texas at Dallas, Richardson, Texas, United States

会議: CHI 2026

ACM CHI Conference on Human Factors in Computing Systems

セッション: Co-Design and Collaboration

P1 - Room 117
7 件の発表
2026-04-16 20:15:00
2026-04-16 21:45:00