PSST: Enabling Blind or Visually Impaired Developers to Author Sonifications of Streaming Sensor Data

要旨

We present the first toolkit that equips blind and visually impaired (BVI) developers with the tools to create accessible data displays. Called PSST (Physical computing Streaming Sensor data Toolkit), it enables BVI developers to understand the data generated by sensors from a mouse to a micro:bit physical computing platform. By assuming visual abilities, earlier efforts to make physical computing accessible fail to address the need for BVI developers to access sensor data. PSST enables BVI developers to understand real-time, real-world sensor data by providing control over what should be displayed, as well as when to display and how to display sensor data. PSST supports filtering based on raw or calculated values, highlighting, and transformation of data. Output formats include tonal sonification, nonspeech audio files, speech, and SVGs for laser cutting. We validate PSST through a series of demonstrations and a user study with BVI developers.

著者
Venkatesh Potluri
University of Washington, Seattle, Washington, United States
John R. Thompson
Microsoft Research, Redmond, Washington, United States
James Devine
Microsoft Research, Cambridge, Cambridgeshire, United Kingdom
Bongshin Lee
Microsoft Research, Redmond, Washington, United States
Nora Morsi
University of Washington, Seattle, Washington, United States
Peli de Halleux
Microsoft Research, Redmond, Washington, United States
Steve Hodges
Microsoft Research, Cambridge, United Kingdom
Jennifer Mankoff
University of Washington, Seattle, Washington, United States
論文URL

https://doi.org/10.1145/3526113.3545700

会議: UIST 2022

The ACM Symposium on User Interface Software and Technology

セッション: Accessibility

6 件の発表
2022-11-01 18:00:00
2022-11-01 19:30:00