Litcius/Paper detail

Multimodal Gaze Interaction for Creative Design

Chris Creed, Maite Frutos-Pascual, Ian Williams

202032 citationsDOI

Abstract

We present a new application ("Sakura") that enables people with physical impairments to produce creative visual design work using a multimodal gaze approach. The system integrates multiple features tailored for gaze interaction including the selection of design artefacts via a novel grid approach, control methods for manipulating canvas objects, creative typography, a new color selection approach, and a customizable guide technique facilitating the alignment of design elements. A user evaluation (N=24) found that non-disabled users were able to utilize the application to complete common design activities and that they rated the system positively in terms of usability. A follow-up study with physically impaired participants (N=6) demonstrated they were able to control the system when working towards a website design, rating the application as having a good level of usability. Our research highlights new directions in making creative activities more accessible for people with physical impairments.

Topics & Concepts

UsabilityHuman–computer interactionGazeTypographyComputer scienceSelection (genetic algorithm)Control (management)MultimediaInteraction designEye trackingMultimodal interactionUser-centered designUser experience designArtificial intelligenceArtVisual artsGaze Tracking and Assistive TechnologyTactile and Sensory InteractionsDigital Accessibility for Disabilities