GAZEploit: Remote Keystroke Inference Attack by Gaze Estimation from Avatar Views in VR/MR Devices
Hanqiu Wang, Zihao Zhan, Haoqi Shan, Siqi Dai, Max Panoff, Shuo Wang
Abstract
The advent and growing popularity of Virtual Reality (VR) and Mixed Reality (MR) solutions have revolutionized the way we interact with digital platforms. The cutting-edge gaze-controlled typing methods, now prevalent in high-end models of these devices, e.g., Apple Vision Pro, have not only improved user experience but also mitigated traditional keystroke inference attacks that relied on hand gestures, head movements and acoustic side-channels. However, this advancement has paradoxically given birth to a new, potentially more insidious cyber threat, GAZEploit.
Topics & Concepts
Computer scienceAvatarGazeGestureVirtual realityHuman–computer interactionKeystroke loggingInferencePopularityComputer visionArtificial intelligenceComputer securityPsychologySocial psychologyGaze Tracking and Assistive TechnologyHand Gesture Recognition SystemsTactile and Sensory Interactions