Litcius/Paper detail

Squishy, Yet Satisfying: Exploring Deformable Shapes' Cross-Modal Correspondences with Colours and Emotions

Cameron Steer, Kim Sauvé, Anika Jain, Omosunmisola Lawal, Michael J. Proulx, Crescent Jicol, Jason Alexander

202414 citationsDOIOpen Access PDF

Abstract

Surfaces with deformable and shape-changing properties seek to enhance and diversify tangible interactions with computing systems. However, we currently lack fundamental knowledge and user interface design principles that connect the inherent properties of deformable shapes with our human senses and cognitive associations. To address this knowledge gap, we systematically explored deformable shapes’ cross-modal correspondences (CC) with colours and emotions. In our CC study, 52 participants were presented with deformable shape stimuli that varied in stiffness and angularity. They were asked to associate these stimuli with colours and emotions under (i) visuo-tactile and; (ii) tactile-only conditions. For the first time, our findings reveal (1) how stiffness level primarily influences the CC associations and; (2) that stiffness and angularity play a significant role in CC associations over the visibility of the shapes. The results were distilled into design guidelines for future deformable, shape-changing interfaces that engage specific human senses and responses.

Topics & Concepts

ModalVisibilityStiffnessComputer scienceCognitionInterface (matter)Human–computer interactionArtificial intelligenceComputer visionPsychologyStructural engineeringPhysicsEngineeringMaterials scienceOpticsParallel computingBubbleNeurosciencePolymer chemistryMaximum bubble pressure methodTactile and Sensory InteractionsMultisensory perception and integrationColor perception and design