Context-Aware Causal Gaze Forecasting for Human-Vehicle Interaction During In-Cabin Tracking Dropouts
Not on the map. Why?
Abstract (arXiv)
Dashboard-mounted gaze trackers often lose sight of the driver's eyes during large head rotations, including shoulder checks, mirror glances, and intersection scanning. These maneuvers occur when information about the driver's visual attention is most useful. Offline gap-filling methods may reconstruct a missing interval using observations from both sides, but an online driver-monitoring system cannot rely on measurements that have not yet occurred. We therefore formulate causal gaze recovery: forecasting unavailable gaze at time t without target-tracker gaze at t or later. We introduce the Causal Context-Gated Forecaster (CCGF), which encodes a 60-frame pre-dropout history of gaze and head pose and combines it with DINOv3 scene features. A learned reliability gate controls the contribution of the history and scene representations as the dropout progresses. We evaluate two scene conditions: Live, in which the scene representation continues to update during tracker loss, and Frozen, in which the final pre-dropout representation is used throughout the missing interval. We evaluate CCGF on 2,047 eligible, naturally occurring GazeSense headlost events drawn from 10.5 h of naturalistic driving by ten drivers. Across all recordings, headlost accounts for 8.5 percent of GazeSense recording time. Synchronized gaze coordinates from a head-mounted Neon tracker provide supervision and evaluation targets but are never used as model inputs. Under leave-one-driver-out evaluation, CCGF achieves a mean per-driver median error of 175.7 px (10.5 deg) with Live scene updates, a 33 percent reduction relative to history-only causal forecasting. With Frozen scene input, the error increases to 210.8 px (12.9 deg), indicating that scene observations acquired during the dropout provide useful predictive information. We will release the dataset, evaluation protocol, and causal baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 11 Sep 2026.
Builds on
16 of 27 references.
References · 16
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2025DINOv3cited by 1,414
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
- 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 582
- 2018BRITS: Bidirectional Recurrent Imputation for Time Seriescited by 290
- 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Modelscited by 198
- 2019Gaze360: Physically Unconstrained Gaze Estimation in the Wildcited by 174
- 2019GP-VAE: Deep Probabilistic Time Series Imputationcited by 172
- 2022SAITS: Self-Attention-based Imputation for Time Seriescited by 169
- 2020ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variationcited by 141
- 2023SegRNN: Segment Recurrent Neural Network for Long-Term Time Series Forecastingcited by 55
- 2023ImputeFormer: Low Rankness-Induced Transformers for Generalizable Spatiotemporal Imputationcited by 50
4 more
- 2015Recurrent Neural Networks for Driver Activity Anticipation via Sensory-Fusion Architecturecited by 42
- 20223DGazeNet: Generalizing Gaze Estimation with Weak-Supervision from Synthetic Viewscited by 11
- 2023Looking Inside Out: Anticipating Driver Intent From Videoscited by 2
- 2025Weather-Dependent Variations in Driver Gaze Behavior: A Case Study in Rainy Conditionscited by 1
Built on by
Not cited yet.