Litcius/Paper detail

Weighted Pointer: Error-aware Gaze-based Interaction through Fallback Modalities

Ludwig Sidenmark, Mark Parent, Chi-Hao Wu, Joannes Chan, Michael Glueck, Daniel Wigdor, Tovi Grossman, M. Giordano

2022IEEE Transactions on Visualization and Computer Graphics32 citationsDOI

Abstract

Gaze-based interaction is a fast and ergonomic type of hands-free interaction that is often used with augmented and virtual reality when pointing at targets. Such interaction, however, can be cumbersome whenever user, tracking, or environmental factors cause eye tracking errors. Recent research has suggested that fallback modalities could be leveraged to ensure stable interaction irrespective of the current level of eye tracking error. This work thus presents Weighted Pointer interaction, a collection of error-aware pointing techniques that determine whether pointing should be performed by gaze, a fallback modality, or a combination of the two, depending on the level of eye tracking error that is present. These techniques enable users to accurately point at targets when eye tracking is accurate and inaccurate. A virtual reality target selection study demonstrated that Weighted Pointer techniques were more performant and preferred over techniques that required the use of manual modality switching.

Topics & Concepts

Computer scienceGazePointer (user interface)Computer visionModalitiesModality (human–computer interaction)Eye trackingArtificial intelligenceHuman–computer interactionVirtual realityAugmented realitySocial scienceSociologyGaze Tracking and Assistive TechnologyTactile and Sensory InteractionsHand Gesture Recognition Systems
Weighted Pointer: Error-aware Gaze-based Interaction through Fallback Modalities | Litcius