mlsanityData to 14 Oct 2026

Quantifying the Impact of Motion on 2D Gaze Estimation in Real-World Mobile Interactions

arXiv 2502.10570 ↗First posted 14 Feb 2025cs.HC cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Mobile gaze tracking on handheld devices commonly relies on appearance-based 2D gaze estimation from the device's front-facing RGB camera. Although this approach makes eye tracking more accessible by avoiding dedicated infrared hardware, maintaining accuracy remains difficult because the spatial relationship among the user's face, the camera, and the screen changes continuously during handheld use. This paper examines how motion-related geometry change affects a representative front-camera RGB 2D gaze-estimation pipeline. We report two complementary within-subject user studies ((n=10)) that capture handheld behaviour, calibration data, and gaze-estimation error during everyday-style mobile tasks across conditions ranging from lying and sitting to walking and maze navigation. Rather than treating motion as a single binary factor, we analyse within-task versus task-switch behaviour, calibration-test mismatch, and condition-specific motion signatures. Behavioural results show that head-to-camera distance is comparatively stable during sustained within-task use, while task switches introduce much larger geometry fluctuations, with head-distance standard deviations of approximately 7.42--10.10,cm across conditions. In the gaze-evaluation study, one-off calibration reduced average RMSE from 4.49,cm to 3.44,cm; under this regime, the global effect of motion condition on RMSE was not statistically reliable, whereas clearer patterns appeared in task-specific and motion-specific calibration analyses, where better calibration-test match reduced error.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 19 of its 59 references that are in the map. First posted on arXiv 14 Feb 2025.

Builds on

19 of 59 references.

References · 19

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2019Gaze360: Physically Unconstrained Gaze Estimation in the Wildcited by 174
  3. 2016Eye Tracking for Everyonecited by 155
  4. 2015Appearance-Based Gaze Estimation in the Wildcited by 153
  5. 2020ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variationcited by 141
  6. 2016It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimationcited by 123
  7. 2017MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimationcited by 118
  8. 2021Appearance-based Gaze Estimation With Deep Learning: A Review and Benchmarkcited by 82
  9. 2019Few-Shot Adaptive Gaze Estimationcited by 77
  10. 2021Gaze Estimation using Transformercited by 68
  11. 2021Automatic Gaze Analysis: A Survey of Deep Learning based Approachescited by 33
  12. 2021Adaptive Feature Fusion Network for Gaze Tracking in Mobile Tabletscited by 29
7 more
  1. 2018Recurrent CNN for 3D Gaze Estimation using Appearance and Shape Cuescited by 21
  2. 2023An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devicescited by 13
  3. 2023EFE: End-to-end Frame-to-Gaze Estimationcited by 11
  4. 2018Forecasting User Attention During Everyday Mobile Interactions Using Device-Integrated and Wearable Sensorscited by 6
  5. 2023DynamicRead: Exploring Robust Gaze Interaction Methods for Reading on Handheld Mobile Devices under Dynamic Conditionscited by 5
  6. 2019SacCalib: Reducing Calibration Distortion for Stationary Eye Trackers Using Saccadic Eye Movementscited by 4
  7. 2019Accurate and Robust Eye Contact Detection During Everyday Mobile Device Interactionscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 5.

6 papers.