Dual-Path Enhancements in Event-Based Eye Tracking: Augmented Robustness and Adaptive Temporal Modeling
Not on the map. Why?
Abstract (arXiv)
Event-based eye tracking has become a pivotal technology for augmented reality and human-computer interaction. Yet, existing methods struggle with real-world challenges such as abrupt eye movements and environmental noise. Building on the efficiency of the Lightweight Spatiotemporal Network-a causal architecture optimized for edge devices-we introduce two key advancements. First, a robust data augmentation pipeline incorporating temporal shift, spatial flip, and event deletion improves model resilience, reducing Euclidean distance error by 12% (1.61 vs. 1.70 baseline) on challenging samples. Second, we propose KnightPupil, a hybrid architecture combining an EfficientNet-B3 backbone for spatial feature extraction, a bidirectional GRU for contextual temporal modeling, and a Linear Time-Varying State-Space Module to adapt to sparse inputs and noise dynamically. Evaluated on the 3ET+ benchmark, our framework achieved 1.61 Euclidean distance on the private test set of the Event-based Eye Tracking Challenge at CVPR 2025, demonstrating its effectiveness for practical deployment in AR/VR systems while providing a foundation for future innovations in neuromorphic vision.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 15 of its 24 references that are in the map. First posted on arXiv 14 Apr 2025.
Builds on
15 of 24 references.
References · 15
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2019Event-based Vision: A Surveycited by 1,016
- 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 514
- 2019High Speed and High Dynamic Range Video with an Event Cameracited by 345
- 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 307
- 2019End-to-End Learning of Representations for Asynchronous Event-Based Datacited by 217
- 2018Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Carscited by 200
- 2024State Space Models for Event Camerascited by 75
- 2020Effective and Efficient Computation with Multiple-timescale Spiking Recurrent Neural Networkscited by 43
- 20233ET: Efficient Event-based Eye Tracking using a Change-Based ConvLSTM Networkcited by 30
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025evTransFER: A Transfer Learning Framework for Event-based Facial Expression Recognitioncited by 3
- 2026Enhancing Eye Feature Estimation from Event Data Streams through Adaptive Inference State Space Modelingcited by 0
- 2026Event-based Liveness Detection using Temporal Ocular Dynamics: An Exploratory Approachcited by 0
- 2026Event-based Liveness Detection using Temporal Ocular Dynamics: An Exploratory Approach29 Apr 2026
- 2026Enhancing Eye Feature Estimation from Event Data Streams through Adaptive Inference State Space Modeling14 Mar 2026
- 2025evTransFER: A Transfer Learning Framework for Event-based Facial Expression Recognition5 Aug 2025