Human Gaze Assisted Artificial Intelligence: A Review
Ruohan Zhang, Akanksha Saran, Bo Liu, Yifeng Zhu, Sihang Guo, Scott Niekum, Dana H. Ballard, Mary Hayhoe
Abstract
Human gaze reveals a wealth of information about internal cognitive state. Thus, gaze-related research has significantly increased in computer vision, natural language processing, decision learning, and robotics in recent years. We provide a high-level overview of the research efforts in these fields, including collecting human gaze data sets, modeling gaze behaviors, and utilizing gaze information in various applications, with the goal of enhancing communication between these research areas. We discuss future challenges and potential applications that work towards a common goal of human-centered artificial intelligence.
Topics & Concepts
GazeComputer scienceArtificial intelligenceHuman–computer interactionRobotHuman–robot interactionCognitionPsychologyNeuroscienceGaze Tracking and Assistive TechnologyVisual Attention and Saliency DetectionAdvanced Computing and Algorithms