mlsanityData to 14 Oct 2026

LISA: Language-guided Interference-aware Spatial-Frequency Attention for Driver Gaze Estimation

arXiv 2605.17287 ↗First posted 17 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Driver gaze estimation serves as a fundamental metric for evaluating driver attentiveness in modern monitoring systems. Beyond being vulnerable to sudden lighting changes and sensor noise, spatial-domain models struggle to disentangle authentic gaze cues from irrelevant visual attributes. In this paper, we propose LISA, a Language-guided Interference-aware Spatial-Frequency Attention framework that combines frequency-domain priors with vision-language knowledge. Observing that the amplitude spectrum remains relatively stable even under spatial perturbations, we design a dual-domain fusion mechanism. It integrates stable low-frequency semantics into high-frequency details, employing spatial attention to precisely target ocular regions. To reduce semantic ambiguity, we also introduce a training-time disentanglement strategy. Using a frozen CLIP encoder and orthogonal regularization, we explicitly separate gaze features from appearance interference. Experiments on two benchmarks show that LISA achieves state-of-the-art performance, with significantly improved robustness against occlusions and lighting variations. The code repository is available at https://github.com/Mason-bupt/LISA.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 37 references that are in the map. First posted on arXiv 17 May 2026.

Builds on

21 of 37 references.

References · 21

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2019Gaze360: Physically Unconstrained Gaze Estimation in the Wildcited by 174
  4. 2015Appearance-Based Gaze Estimation in the Wildcited by 153
  5. 2020ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variationcited by 141
  6. 2017MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimationcited by 118
  7. 2021Appearance-based Gaze Estimation With Deep Learning: A Review and Benchmarkcited by 82
  8. 2021Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domaincited by 71
  9. 2021Gaze Estimation using Transformercited by 68
  10. 2021PureGaze: Purifying Gaze Feature for Generalizable Gaze Estimationcited by 54
  11. 2021Generalizing Gaze Estimation with Outlier-guided Collaborative Adaptationcited by 42
  12. 2024Gaze-LLE: Gaze Target Estimation via Large-Scale Learned Encoderscited by 36
9 more
  1. 2024Gazing Into Missteps: Leveraging Eye-Gaze for Unsupervised Mistake Detection in Egocentric Videos of Skilled Human Activitiescited by 15
  2. 2024What Do You See in Vehicle? Comprehensive Vision Solution for In-Vehicle Gaze Estimationcited by 14
  3. 2024Spatio-Temporal Attention and Gaussian Processes for Personalized Video Gaze Estimationcited by 12
  4. 2024LG-Gaze: Learning Geometry-aware Continuous Prompts for Language-Guided Gaze Estimationcited by 9
  5. 2025Enhancing 3D Gaze Estimation in the Wild using Weak Supervision with Gaze Following Labelscited by 9
  6. 2022FreeGaze: Resource-efficient Gaze Estimation via Frequency Domain Contrastive Learningcited by 5
  7. 2024Appearance Debiased Gaze Estimation via Stochastic Subject-Wise Adversarial Learningcited by 3
  8. 20253D Prior is All You Need: Cross-Task Few-shot 2D Gaze Estimationcited by 3
  9. 2025GA3CE: Unconstrained 3D Gaze Estimation with Gaze-Aware 3D Context Encodingcited by 3

Built on by

Not cited yet.