RePlay: Touchscreen Interaction Substitution Method for Accessible Gaming
Dragan Ahmetovic, Daniele Riboli, Cristian Bernareggi, Sergio Mascetti
Abstract
We present RePlay, an interaction substitution method designed to support people with upper extremity motor impairments while interacting with mobile apps. RePlay overcomes key limitations of existing approaches, allowing users to quickly access all app interface elements, even those not visible to the OS (a common situation especially with games). This is achieved through personalized mapping of interface elements to alternative inputs, such as external switches or non-verbal vocal sounds, hence adapting to users with diverse abilities. RePlay was implemented as an Android Accessibility Service, running without any changes at OS level.
Topics & Concepts
TouchscreenComputer scienceReplay attackAndroid (operating system)Human–computer interactionSubstitution (logic)Interface (matter)Key (lock)Android appMultimediaPasswordComputer securityOperating systemMaximum bubble pressure methodBubbleProgramming languageTactile and Sensory InteractionsDigital Accessibility for DisabilitiesInteractive and Immersive Displays