Memory Reviver: Supporting Photo-Collection Reminiscence for People with Visual Impairment via a Proactive Chatbot

要旨

Reminiscing with photo collections offers significant psychological benefits but poses challenges for people with visual impairment (PVI). Their current reliance on sighted help restricts the flexibility of this activity. In response, we explored using a chatbot in a preliminary study. We identified two primary challenges that hinder effective reminiscence with a chatbot: the scattering of information and a lack of proactive guidance. To address these limitations, we present Memory Reviver, a proactive chatbot that helps PVI reminisce with a photo collection through natural language communication. Memory Reviver incorporates two novel features: (1) a Memory Tree, which uses a hierarchical structure to organize the information in a photo collection; and (2) a Proactive Strategy, which actively delivers information to users at proper conversation rounds. Evaluation with twelve PVI demonstrated that Memory Reviver effectively facilitated engaging reminiscence, enhanced understanding of photo collections, and delivered natural conversational experiences. Based on our findings, we distill implications for supporting photo reminiscence and designing chatbots for PVI.

著者
Shuchang Xu
Hong Kong University of Science and Technology, Hong Kong, China
Chang Chen
The Hong Kong University of Science and Technology, Hong Kong, Hong Kong
Zichen LIU
Hong Kong University of Science and Technology, Hong Kong, China
Xiaofu Jin
The Hong Kong University of Science and Technology, Hong Kong SAR, Hong Kong, China
Linping Yuan
The Hong Kong University of Science and Technology, Hong Kong, China
Yukang Yan
University of Rochester, Rochester, New York, United States
Huamin Qu
The Hong Kong University of Science and Technology, Hong Kong, China
論文URL

https://doi.org/10.1145/3654777.3676336

動画

会議: UIST 2024

ACM Symposium on User Interface Software and Technology

セッション: 2. A11y

Westin: Allegheny 2
6 件の発表
2024-10-16 01:10:00
2024-10-16 02:40:00