mlsanityData to 14 Oct 2026

3ET: Efficient Event-based Eye Tracking using a Change-Based ConvLSTM Network

arXiv 2308.11771 ↗First posted 22 Aug 2023cs.CV cs.AI cs.LGcited by 30

Not on the map. Why?

Abstract (arXiv)

This paper presents a sparse Change-Based Convolutional Long Short-Term Memory (CB-ConvLSTM) model for event-based eye tracking, key for next-generation wearable healthcare technology such as AR/VR headsets. We leverage the benefits of retina-inspired event cameras, namely their low-latency response and sparse output event stream, over traditional frame-based cameras. Our CB-ConvLSTM architecture efficiently extracts spatio-temporal features for pupil tracking from the event stream, outperforming conventional CNN structures. Utilizing a delta-encoded recurrent path enhancing activation sparsity, CB-ConvLSTM reduces arithmetic operations by approximately 4.7× without losing accuracy when tested on a textttv2e-generated event dataset of labeled pupils. This increase in efficiency makes it ideal for real-time eye tracking in resource-constrained devices. The project code and dataset are openly available at urlhttps://github.com/qinche106/cb-convlstm-eyetracking.

Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). Builds on 11 of its 20 references that are in the map. First posted on arXiv 22 Aug 2023.

Builds on

11 of 20 references.

References · 11

  1. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
  2. 2019Event-based Vision: A Surveycited by 1,016
  3. 2020Event-based Asynchronous Sparse Convolutional Networkscited by 104
  4. 2020Event Based, Near Eye Gaze Tracking Beyond 10,000Hzcited by 53
  5. 2021TEyeD: Over 20 million real-world eye images with Pupil, Eyelid, and Iris 2D and 3D Segmentations, 2D and 3D Landmarks, 3D Eyeball, Gaze Vector, and Eye Movement Typescited by 32
  6. 2020Real-Time Face & Eye Tracking and Blink Detection using Event Camerascited by 27
  7. 2022Exploiting Spatial Sparsity for Event Cameras with Visual Transformerscited by 23
  8. 2022Real-Time Gaze Tracking with Event-Driven Eye Segmentationcited by 21
  9. 2021Spartus: A 9.4 TOp/s FPGA-based LSTM Accelerator Exploiting Spatio-Temporal Sparsitycited by 20
  10. 2015Labeled pupils in the wild: A dataset for studying pupil detection in unconstrained environmentscited by 18
  11. 2016Delta Networks for Optimized Recurrent Network Computationcited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 11; 2025: 12; 2026: 5.

30 papers.

Sort:

By area:

  1. 2023Single-Model and Any-Modality for Video Object Trackingcited by 65
  2. 2023Retina : Low-Power Eye Tracking with Event Camera and Spiking Hardwarecited by 27
  3. 2024Event-Based Eye Tracking. AIS 2024 Challenge Surveycited by 19
  4. 2024Rethinking Efficient and Effective Point-based Networks for Event Camera Classification and Regression: EventMambacited by 19
  5. 2024MambaPupil: Bidirectional Selective Recurrent model for Event-based Eye trackingcited by 8
  6. 2024Co-designing a Sub-millisecond Latency Event-based Eye Tracking System with Submanifold Sparse CNNcited by 8
  7. 2024FACET: Fast and Accurate Event-Based Eye Tracking Using Ellipse Modeling for Extended Realitycited by 8
  8. 2024FAPNet: An Effective Frequency Adaptive Point-based Eye Trackercited by 6
  9. 2025Exploring Temporal Dynamics in Event-based Eye Trackercited by 6
  10. 2025Event-Based Eye Tracking. 2025 Event-based Vision Workshopcited by 5
  11. 2024Modeling State Shifting via Local-Global Distillation for Event-Frame Gaze Trackingcited by 4
  12. 2025EgoEvGesture: Gesture Recognition Based on Egocentric Event Cameracited by 4
18 more
  1. 2024Evaluating Image-Based Face and Eye Tracking with Event Camerascited by 3
  2. 2024GG-SSMs: Graph-Generating State Space Modelscited by 3
  3. 2025GazeSCRNN: Event-based Near-eye Gaze Tracking using a Spiking Neural Networkcited by 3
  4. 2025Dual-Path Enhancements in Event-Based Eye Tracking: Augmented Robustness and Adaptive Temporal Modelingcited by 3
  5. 2025Eye Gaze Tells You Where to Compute: Gaze-Driven Efficient VLMscited by 3
  6. 2024Text-to-Events: Synthetic Event Camera Streams from Conditional Text Inputcited by 2
  7. 2024EyeTrAES: Fine-grained, Low-Latency Eye Tracking via Adaptive Event Slicingcited by 2
  8. 2025JaneEye: A 12-nm 2K-FPS 18.9-μJ/Frame Event-based Eye Tracking Acceleratorcited by 1
  9. 2026SynSacc: A Blender-to-V2E Pipeline for Synthetic Neuromorphic Eye-Movement Data and Sim-to-Real Spiking Model Trainingcited by 1
  10. 2026LAND: A Longitudinal Analysis of Neuromorphic Datasetscited by 1
  11. 2025Inference-Time Gaze Refinement for Micro-Expression Recognition: Enhancing Event-Based Eye Tracking with Motion-Aware Post-Processingcited by 0
  12. 2025Realizing Fully-Integrated, Low-Power, Event-Based Pupil Tracking with Neuromorphic Hardwarecited by 0
  13. 2025Neuromorphic Eye Tracking for Low-Latency Pupil Detectioncited by 0
  14. 2025Reconstruction as a Bridge for Event-Based Visual Question Answeringcited by 0
  15. 2025Event-based high temporal resolution measurement of shock wave motion fieldcited by 0
  16. 2026Enhancing Eye Feature Estimation from Event Data Streams through Adaptive Inference State Space Modelingcited by 0
  17. 2026Event-based Liveness Detection using Temporal Ocular Dynamics: An Exploratory Approachcited by 0
  18. 2026EveLoad: Cognitive Workload Recognition from Event-Based Eye Movementscited by 0