Litcius/Paper detail

Gaze-Based Interaction Intention Recognition in Virtual Reality

Xiao-lin Chen, Wenjun Hou

2022Electronics31 citationsDOIOpen Access PDF

Abstract

With the increasing need for eye tracking in head-mounted virtual reality displays, the gaze-based modality has the potential to predict user intention and unlock intuitive new interaction schemes. In the present work, we explore whether gaze-based data and hand-eye coordination data can predict a user’s interaction intention with the digital world, which could be used to develop predictive interfaces. We validate it on the eye-tracking data collected from 10 participants in item selection and teleporting tasks in virtual reality. We demonstrate successful prediction of the onset of item selection and teleporting with an 0.943 F1-Score using a Gradient Boosting Decision Tree, which is the best among the four classifiers compared, while the model size of the Support Vector Machine is the smallest. It is also proven that hand-eye-coordination-related features can improve interaction intention recognition in virtual reality environments.

Topics & Concepts

GazeComputer scienceVirtual realityEye trackingHuman–computer interactionArtificial intelligenceDecision treeBoosting (machine learning)Augmented realitySupport vector machineComputer visionMachine learningGaze Tracking and Assistive TechnologyHand Gesture Recognition SystemsVisual Attention and Saliency Detection