Fast Event-based Optical Flow Estimation by Triplet Matching
Not on the map. Why?
Abstract (arXiv)
Event cameras are novel bio-inspired sensors that offer advantages over traditional cameras (low latency, high dynamic range, low power, etc.). Optical flow estimation methods that work on packets of events trade off speed for accuracy, while event-by-event (incremental) methods have strong assumptions and have not been tested on common benchmarks that quantify progress in the field. Towards applications on resource-constrained devices, it is important to develop optical flow algorithms that are fast, light-weight and accurate. This work leverages insights from neuroscience, and proposes a novel optical flow estimation scheme based on triplet matching. The experiments on publicly available benchmarks demonstrate its capability to handle complex scenes with comparable results as prior packet-based algorithms. In addition, the proposed method achieves the fastest execution time (> 10 kHz) on standard CPUs as it requires only three events in estimation. We hope that our research opens the door to real-time, incremental motion estimation methods and applications in real-world scenarios.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 19 of its 40 references that are in the map. First posted on arXiv 23 Dec 2022.
Builds on
19 of 40 references.
References · 19
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2019Event-based Vision: A Surveycited by 1,016
- 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 307
- 2018The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perceptioncited by 254
- 2018EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Camerascited by 224
- 2016The Event-Camera Dataset and Simulator: Event-based Data for Pose Estimation, Visual Odometry, and SLAMcited by 203
- 2018A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimationcited by 178
- 2021E-RAFT: Dense Optical Flow from Event Camerascited by 152
- 2020Back to Event Basics: Self-Supervised Learning of Image Reconstruction for Event Cameras via Photometric Constancycited by 125
- 2021Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural Networkscited by 99
- 2020Spike-FlowNet: Event-based Optical Flow Estimation with Energy-Efficient Hybrid Neural Networkscited by 98
- 2022Secrets of Event-Based Optical Flowcited by 92
7 more
- 2017Continuous-Time Visual-Inertial Odometry for Event Camerascited by 57
- 2021Spatio-Temporal Recurrent Networks for Event-Based Optical Flow Estimationcited by 50
- 2018Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation: From Events to Global Motion Perceptioncited by 48
- 2021The Spatio-Temporal Poisson Point Process: A Simple Model for the Alignment of Event Camera Datacited by 27
- 2021Real-Time Optical Flow for Vehicular Perception with Low- and High-Resolution Event Camerascited by 27
- 2018Real-time high speed motion prediction using fast aperture-robust event-driven visual flowcited by 24
- 2017Spiking Optical Flow for Event-based Sensors Using IBM's TrueNorth Neurosynaptic Systemcited by 14
Built on by
Citing papers per year: 2023: 2; 2024: 4; 2025: 2; 2026: 3.
11 papers.
- 2023Neuromorphic Optical Flow and Real-time Implementation with Event Camerascited by 11
- 2023Event-based Background-Oriented Schlierencited by 11
- 2024Table tennis ball spin estimation with an event cameracited by 11
- 2024Learning Normal Flow Directly From Event Neighborhoodscited by 5
- 20256-DoF Object Tracking with Event-based Optical Flow and Framescited by 3
- 20243D Human Scan With A Moving Event Cameracited by 2
- 2025E-MoFlow: Learning Egomotion and Optical Flow from Event Data via Implicit Regularizationcited by 2
- 2024EROAM: Event-based Camera Rotational Odometry and Mapping in Real-timecited by 0
- 2026Aquatic Neuromorphic Optical Flowcited by 0
- 2026LC-Flow: Learning Local Continuous Optical Flow and Confidence from eventscited by 0
- 2026MotionDLO: Hybrid Event- and Frame-Based Tracking of Deformable Linear Objectscited by 0
- 2026MotionDLO: Hybrid Event- and Frame-Based Tracking of Deformable Linear Objects23 Aug 2026
- 2026LC-Flow: Learning Local Continuous Optical Flow and Confidence from events23 May 2026
- 2026Aquatic Neuromorphic Optical Flow8 May 2026
- 2025E-MoFlow: Learning Egomotion and Optical Flow from Event Data via Implicit Regularization14 Oct 2025
- 20256-DoF Object Tracking with Event-based Optical Flow and Frames20 Aug 2025
- 2024Learning Normal Flow Directly From Event Neighborhoods15 Dec 2024
- 2024EROAM: Event-based Camera Rotational Odometry and Mapping in Real-time17 Nov 2024
- 2024Table tennis ball spin estimation with an event camera15 Apr 2024
- 20243D Human Scan With A Moving Event Camera12 Apr 2024
- 2023Event-based Background-Oriented Schlieren1 Nov 2023
- 2023Neuromorphic Optical Flow and Real-time Implementation with Event Cameras14 Apr 2023