Litcius/Paper detail

Infosonics: Accessible Infographics for People who are Blind using Sonification and Voice

Leona Holloway, Cagatay Goncu, Alon Ilsar, Matthew Butler, Kim Marriott

2022CHI Conference on Human Factors in Computing Systems53 citationsDOI

Abstract

Data visualisations are increasingly used online to engage readers and enable independent analysis of the data underlying news stories. However, access to such infographics is problematic for readers who are blind or have low vision (BLV). Equitable access to information is a basic human right and essential for independence and inclusion. We introduce infosonics, the audio equivalent of infographics, as a new style of interactive sonification that uses a spoken introduction and annotation, non-speech audio and sound design elements to present data in an understandable and engaging way. A controlled user evaluation with 18 BLV adults found a COVID-19 infosonic enabled a clearer mental image than a traditional sonification. Further, infosonics prove complementary to text descriptions and facilitate independent understanding of the data. Based on our findings, we provide preliminary suggestions for infosonics design, which we hope will enable BLV people to gain equitable access to online news and information.

Topics & Concepts

InfographicSonificationComputer scienceWorld Wide WebHuman–computer interactionMultimediaAnnotationVisualizationArtificial intelligenceData miningTactile and Sensory InteractionsMultisensory perception and integrationInteractive and Immersive Displays