Playing with Feeling: Exploring Vibrotactile Feedback and Aesthetic Experiences for Developing Haptic Wearables for Blind and Low Vision Music Learning
Leon Lu, Jin Kang, Chase Crispin, Audrey Girouard
Abstract
Musical haptic wearables (MHWs) that convey information through vibrotactile feedback holds the potential to support the music learning of a blind or low vision (BLV) music learner. Yet, it is unclear how these technologies can give functional support to a BLV person. We also investigated material preferences in such technologies to understand the role of non-functional aesthetic experiences in shaping their music learning. We conducted 5 co-design workshops with 10 BLV participants. Participants explored eleven materials common in a music learning environment and engaged in bodystorming with a prototype that communicated six vibrotactile patterns. Through thematic analysis, we found that MHWs with vibrotactile alerts and variations in vibration are suited to communicate instructional information, aid music reading and support technical guidance and practice. We categorized the participants’ material experiences into sensorial, interpretive, and affective levels. Based on our findings, we discuss considerations when designing vibrotactile interactions to support music learning for BLV people and highlight material experiences that should be emphasized to make the music learning experience wholesome for BLV music learners.