Sensorimotor Realities: Formalizing Ability-Mediating Design for Computer-Mediated Reality Environments
Radu-Daniel Vatavu
Abstract
We introduce “Sensorimotor Realities,” a new concept in the XR landscape and corresponding technology-agnostic framework for computer-mediated perception and motor action. Sensorimotor Realities capitalize on the heterogeneity of human sensorimotor abilities to support conceptualization, characterization, and design of computer technology that leverages existing abilities in new, computer-mediated worlds. We introduce a conceptual space for Sensorimotor Realities with six dimensions, discuss examples of interactive systems in this space, and show how Sensorimotor Realities are distinct in nature and goal from Augmented, Mixed, Virtual, and Mediated Reality. We capitalize on Sensorimotor Realities to propose “ability-mediating design,” an approach to designing accessible interactive computer systems that complements ability-based design. We discuss how Sensorimotor Realities offer new opportunities for research and development at the intersection of XR, wearable computing, ambient intelligence, and accessible computing, and draw a research roadmap with three major directions of scientific investigation.