mlsanityData to 14 Oct 2026

Can Webcam Gaze Constrain Mesa-Objectives in Driving Models? An Instrument Precision Analysis

arXiv 2608.08947 ↗First posted 9 Aug 2026cs.CV cs.HC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Current hazard detection systems in autonomous driving may develop mesa objectives, learned internal goals that achieve high training performance through spurious correlations rather than genuine hazard recognition. We investigate whether human gaze patterns, captured via webcam-based eye tracking (WebGazer.js), can serve as privileged information to constrain mesa-objective formation. We collected 137,663 frame-level gaze samples synchronized with hazard annotations across 388 real dashcam clips, then test this hypothesis across two calibration protocols (9-point/45-click and 11-point/440-click), two model architectures (Random Forest and causal Transformer), and five random seeds per experiment with paired t-tests. No experiment yields a statistically significant improvement from gaze (p = 0.919, 0.578, and 0.667 respectively). A geometric analysis reveals the root cause: WebGazer's reported error (~130-257 px depending on configuration) exceeds 93% of detected hazard object sizes (median 36 px), rendering object-level gaze attribution physically impossible at this instrument precision.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 24 references that are in the map. First posted on arXiv 9 Aug 2026.

Builds on

11 of 24 references.

References · 11

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarkscited by 395
  4. 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 258
  5. 2015Unifying distillation and privileged informationcited by 233
  6. 2016Eye Tracking for Everyonecited by 155
  7. 2021Goal Misgeneralization in Deep Reinforcement Learningcited by 123
  8. 2017Predicting the Driver's Focus of Attention: the DR(eye)VE Projectcited by 79
  9. 2017Predicting Driver Attention in Critical Situationscited by 61
  10. 2019DADA-2000: Can Driving Accident be Predicted by Driver Attention? Analyzed by A Benchmarkcited by 57
  11. 2016Gaze Embeddings for Zero-Shot Image Classificationcited by 25

Built on by

Not cited yet.