A Survey on Deep Learning-based Gaze Direction Regression: Searching for the State-of-the-art
Not on the map. Why?
Abstract (arXiv)
In this paper, we present a survey of deep learning-based methods for the regression of gaze direction vector from head and eye images. We describe in detail numerous published methods with a focus on the input data, architecture of the model, and loss function used to supervise the model. Additionally, we present a list of datasets that can be used to train and evaluate gaze direction regression methods. Furthermore, we noticed that the results reported in the literature are often not comparable one to another due to differences in the validation or even test subsets used. To address this problem, we re-evaluated several methods on the commonly used in-the-wild Gaze360 dataset using the same validation setup. The experimental results show that the latest methods, although claiming state-of-the-art results, significantly underperform compared with some older methods. Finally, we show that the temporal models outperform the static models under static test conditions.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 22 Oct 2024.
Builds on
19 of 33 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2014Going Deeper with Convolutionscited by 4,231
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2017Dynamic Routing Between Capsulescited by 689
- 2019Gaze360: Physically Unconstrained Gaze Estimation in the Wildcited by 173
- 2015Appearance-Based Gaze Estimation in the Wildcited by 153
- 2020ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variationcited by 141
- 2021Appearance-based Gaze Estimation With Deep Learning: A Review and Benchmarkcited by 82
- 2021Gaze Estimation using Transformercited by 68
- 2022L2CS-Net: Fine-Grained Gaze Estimation in Unconstrained Environmentscited by 65
- 2020Towards End-to-end Video-based Eye-Trackingcited by 39
7 more
- 2021Automatic Gaze Analysis: A Survey of Deep Learning based Approachescited by 33
- 2018Recurrent CNN for 3D Gaze Estimation using Appearance and Shape Cuescited by 21
- 2023End-to-end Video Gaze Estimation via Capturing Head-face-eye Spatial-temporal Interaction Contextcited by 14
- 2023A Review of Driver Gaze Estimation and Application in Gaze Behavior Understandingcited by 12
- 2024Spatio-Temporal Attention and Gaussian Processes for Personalized Video Gaze Estimationcited by 12
- 2024CrossGaze: A Strong Method for 3D Gaze Estimation in the Wildcited by 7
- 2020360-Degree Gaze Estimation in the Wild Using Multiple Zoom Scalescited by 6
Built on by
Citing papers per year: 2025: 1.
1 paper.