Litcius/Paper detail

Data-Driven Estimation of Driver Attention Using Calibration-Free Eye Gaze and Scene Features

Zhongxu Hu, Chen Lv, Peng Hang, Chao Huang, Yang Xing

2021IEEE Transactions on Industrial Electronics99 citationsDOI

Abstract

Driver attention estimation is one of the key technologies for intelligent vehicles. The existing related methods only focus on the scene image or the driver's gaze or head pose. The purpose of this article is to propose a more reasonable and feasible method based on a dual-view scene with calibration-free gaze direction. According to human visual mechanisms, the low-level features, static visual saliency map, and dynamic optical flow information are extracted as input feature maps, which combine the high-level semantic descriptions and a gaze probability map transformed from the gaze direction. A multiresolution neural network is proposed to handle the calibration-free features. The proposed method is verified on a virtual reality experimental platform that collected more than 550 000 samples and obtained a more accurate ground truth. The experiments show that the proposed method is feasible and better than the state-of-the-art methods based on multiple widely used metrics. This study also provides a discussion of the effects of different landscapes, times, and weather conditions on the performance.

Topics & Concepts

Computer scienceGazeArtificial intelligenceComputer visionFocus (optics)CalibrationGround truthFeature (linguistics)Key (lock)Virtual realityMathematicsPhysicsStatisticsComputer securityLinguisticsOpticsPhilosophyGaze Tracking and Assistive TechnologyVisual Attention and Saliency DetectionRetinal Imaging and Analysis