mlsanityData to 7 Oct 2026

Deployment-Oriented Session-wise Meta-Calibration for Landmark-Based Webcam Gaze Tracking

arXiv 2603.12388 ↗First posted 12 Mar 2026cs.CV cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Practical webcam gaze tracking is constrained not only by error, but also by calibration burden, robustness to head motion and session drift, runtime footprint, and browser use. We therefore target a deployment-oriented operating point rather than the image large-backbone regime. We cast landmark-based point-of-regard estimation as session-wise adaptation: a shared geometric encoder produces embeddings that can be aligned to a new session from a small calibration set. We present Equivariant Meta-Calibrated Gaze (EMC-Gaze), a lightweight landmark-only method combining an E(3)-equivariant landmark-graph encoder, local eye geometry, binocular emphasis, auxiliary 3D gaze-direction supervision, and a closed-form ridge calibrator differentiated through episodic meta-training. To reduce pose leakage, we use a two-view canonicalization consistency loss. The deployed predictor uses only facial landmarks and fits a per-session ridge head from brief calibration. In a fixation-style interactive evaluation over 33 sessions at 100 cm, EMC-Gaze achieves 5.79 +/- 1.81 deg RMSE after 9-point calibration versus 6.68 +/- 2.34 deg for Elastic Net; the gain is larger on still-head queries (2.92 +/- 0.75 deg vs. 4.45 +/- 0.30 deg). Across three subject holdouts of 10 subjects each, EMC-Gaze retains an advantage (5.66 +/- 0.19 deg vs. 6.49 +/- 0.33 deg). On MPIIFaceGaze with short per-session calibration, the eye-focused model reaches 8.82 +/- 1.21 deg at 16-shot calibration, ties Elastic Net at 1-shot, and outperforms it from 3-shot onward. The exported eye-focused encoder has 944,423 parameters, is 4.76 MB in ONNX, and supports calibrated browser prediction in 12.58/12.58/12.90 ms per sample (mean/median/p90) in Chromium 145 with ONNX Runtime Web. These results position EMC-Gaze as a calibration-friendly operating point rather than a universal state-of-the-art claim against heavier appearance-based systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 41 references that are in the map. First posted on arXiv 12 Mar 2026.

Builds on

15 of 41 references.

References · 15

  1. 2021E(n) Equivariant Graph Neural Networkscited by 951
  2. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
  3. 2018Meta-learning with differentiable closed-form solverscited by 395
  4. 2019Gaze360: Physically Unconstrained Gaze Estimation in the Wildcited by 173
  5. 2016Eye Tracking for Everyonecited by 155
  6. 2015Appearance-Based Gaze Estimation in the Wildcited by 153
  7. 2020ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variationcited by 141
  8. 2016It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimationcited by 123
  9. 2021Appearance-based Gaze Estimation With Deep Learning: A Review and Benchmarkcited by 82
  10. 2019Few-Shot Adaptive Gaze Estimationcited by 77
  11. 2019Real-time Facial Surface Geometry from Monocular Video on Mobile GPUscited by 72
  12. 2018Learning to Find Eye Region Landmarks for Remote Gaze Estimation in Unconstrained Settingscited by 38
3 more
  1. 2019Evaluation of Appearance-Based Methods and Implications for Gaze-Based Applicationscited by 29
  2. 2023An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devicescited by 13
  3. 2020Efficiency in Real-time Webcam Gaze Trackingcited by 2

Built on by

Not cited yet.