Inference-Time Gaze Refinement for Micro-Expression Recognition: Enhancing Event-Based Eye Tracking with Motion-Aware Post-Processing
Not on the map. Why?
Abstract (arXiv)
Event-based eye tracking holds significant promise for fine-grained cognitive state inference, offering high temporal resolution and robustness to motion artifacts, critical features for decoding subtle mental states such as attention, confusion, or fatigue. In this work, we introduce a model-agnostic, inference-time refinement framework designed to enhance the output of existing event-based gaze estimation models without modifying their architecture or requiring retraining. Our method comprises two key post-processing modules: (i) Motion-Aware Median Filtering, which suppresses blink-induced spikes while preserving natural gaze dynamics, and (ii) Optical Flow-Based Local Refinement, which aligns gaze predictions with cumulative event motion to reduce spatial jitter and temporal discontinuities. To complement traditional spatial accuracy metrics, we propose a novel Jitter Metric that captures the temporal smoothness of predicted gaze trajectories based on velocity regularity and local signal complexity. Together, these contributions significantly improve the consistency of event-based gaze signals, making them better suited for downstream tasks such as micro-expression analysis and mind-state decoding. Our results demonstrate consistent improvements across multiple baseline models on controlled datasets, laying the groundwork for future integration with multimodal affect recognition systems in real-world environments. Our code implementations can be found at https://github.com/eye-tracking-for-physiological-sensing/EyeLoRiN.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 35 references that are in the map. First posted on arXiv 14 Jun 2025.
Builds on
13 of 35 references.
References · 13
- 2019Event-based Vision: A Surveycited by 1,016
- 2020Event Based, Near Eye Gaze Tracking Beyond 10,000Hzcited by 53
- 20233ET: Efficient Event-based Eye Tracking using a Change-Based ConvLSTM Networkcited by 30
- 2019Spatiotemporal Recurrent Convolutional Networks for Recognizing Spontaneous Micro-expressionscited by 25
- 2024Event-Based Eye Tracking. AIS 2024 Challenge Surveycited by 19
- 2019Micro-expression detection in long videos using optical flow and recurrent neural networkscited by 16
- 2024A Lightweight Spatiotemporal Network for Online Eye Tracking with Event Cameracited by 14
- 2018Micro-Attention for Micro-Expression recognitioncited by 13
- 2024MambaPupil: Bidirectional Selective Recurrent model for Event-based Eye trackingcited by 8
- 2024Co-designing a Sub-millisecond Latency Event-based Eye Tracking System with Submanifold Sparse CNNcited by 8
- 2025Event-Based Eye Tracking. 2025 Event-based Vision Workshopcited by 5
- 2019Extended Local Binary Patterns for Efficient and Robust Spontaneous Facial Micro-Expression Recognitioncited by 4
1 more
Built on by
Not cited yet.