Litcius/Paper detail

TapGazer: Text Entry with Finger Tapping and Gaze-directed Word Selection

Zhenyi He, Christof Lutteroth, Ken Perlin

2022CHI Conference on Human Factors in Computing Systems23 citationsDOIOpen Access PDF

Abstract

While using VR, efficient text entry is a challenge: users cannot easily locate standard physical keyboards, and keys are often out of reach, e.g. when standing. We present TapGazer, a text entry system where users type by tapping their fingers in place. Users can tap anywhere as long as the identity of each tapping finger can be detected with sensors. Ambiguity between different possible input words is resolved by selecting target words with gaze. If gaze tracking is unavailable, ambiguity is resolved by selecting target words with additional taps. We evaluated TapGazer for seated and standing VR: seated novice users using touchpads as tap surfaces reached 44.81 words per minute (WPM), 79.17% of their QWERTY typing speed. Standing novice users tapped on their thighs with touch-sensitive gloves, reaching 45.26 WPM (71.91%). We analyze TapGazer with a theoretical performance model and discuss its potential for text input in future AR scenarios.

Topics & Concepts

Text entryGazeTappingComputer scienceAmbiguityWord (group theory)Selection (genetic algorithm)Tracking (education)Eye trackingSpeech recognitionHuman–computer interactionArtificial intelligenceComputer visionPsychologyEngineeringMathematicsProgramming languageMechanical engineeringPedagogyGeometryInteractive and Immersive DisplaysGaze Tracking and Assistive TechnologyTactile and Sensory Interactions
TapGazer: Text Entry with Finger Tapping and Gaze-directed Word Selection | Litcius