Towards Anytime Optical Flow Estimation with Event Cameras
Not on the map. Why?
Abstract (arXiv)
Event cameras respond to changes in log-brightness at the millisecond level, making them ideal for optical flow estimation. However, existing datasets from event cameras provide only low frame rate ground truth for optical flow, limiting the research potential of event-driven optical flow. To address this challenge, we introduce a low-latency event representation, Unified Voxel Grid, and propose EVA-Flow, an EVent-based Anytime Flow estimation network to produce high-frame-rate event optical flow with only low-frame-rate optical flow ground truth for supervision. Furthermore, we propose the Rectified Flow Warp Loss (RFWL) for the unsupervised assessment of intermediate optical flow. A comprehensive variety of experiments on MVSEC, DESC, and our EVA-FlowSet demonstrates that EVA-Flow achieves competitive performance, super-low-latency (5ms), time-dense motion estimation (200Hz), and strong generalization. Our code will be available at https://github.com/Yaozhuwa/EVA-Flow.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 45 of its 70 references that are in the map. First posted on arXiv 11 Jul 2023.
Builds on
45 of 70 references.
References · 45
- 2017Attention Is All You Needcited by 60,361
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
- 2019Event-based Vision: A Surveycited by 1,016
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2016Optical Flow Estimation using a Spatial Pyramid Networkcited by 424
- 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 423
- 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 307
- 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 303
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 275
33 more
- 2018The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perceptioncited by 254
- 2018EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Camerascited by 224
- 2019End-to-End Learning of Representations for Asynchronous Event-Based Datacited by 217
- 2022Deep Patch Visual Odometrycited by 190
- 2016Deep Feature Flow for Video Recognitioncited by 186
- 2018A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimationcited by 178
- 2021E-RAFT: Dense Optical Flow from Event Camerascited by 152
- 2015Delving Deeper into Convolutional Networks for Learning Video Representationscited by 148
- 2021XVFI: eXtreme Video Frame Interpolationcited by 126
- 2021Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural Networkscited by 99
- 2020Spike-FlowNet: Event-based Optical Flow Estimation with Energy-Efficient Hybrid Neural Networkscited by 98
- 2022Secrets of Event-Based Optical Flowcited by 92
- 2018DeepTAM: Deep Tracking and Mappingcited by 87
- 2019A Lightweight Optical Flow CNN - Revisiting Data Fidelity and Regularizationcited by 76
- 2021Time-Ordered Recent Event (TORE) Volumes for Event Camerascited by 73
- 2017Semantic Video CNNs through Representation Warpingcited by 65
- 2022Learning Dense and Continuous Optical Flow from an Event Cameracited by 60
- 2021Spatio-Temporal Recurrent Networks for Event-Based Optical Flow Estimationcited by 50
- 2022Dense Continuous-Time Optical Flow from Events and Framescited by 46
- 2020ISSAFE: Improving Semantic Segmentation in Accidents by Fusing Event-based Datacited by 42
- 2023Taming Contrast Maximization for Learning Sequential, Low-latency, Event-based Optical Flowcited by 39
- 2023BlinkFlow: A Dataset to Push the Limits of Event-based Optical Flow Estimationcited by 33
- 2023TMA: Temporal Motion Aggregation for Event-based Optical Flowcited by 32
- 2022Lightweight Event-based Optical Flow Estimation via Iterative Deblurringcited by 31
- 2020Distance Surface for Event-Based Optical Flowcited by 29
- 2021Optical Flow Estimation for Spiking Cameracited by 29
- 2022PanoFlow: Learning 360deg Optical Flow for Surrounding Temporal Understandingcited by 26
- 2021Exploring Event-driven Dynamic Context for Accident Scene Segmentationcited by 23
- 2021Binary TTC: A Temporal Geofence for Autonomous Navigationcited by 20
- 2022CSFlow: Learning Optical Flow via Cross Strip Correlation for Autonomous Drivingcited by 16
- 2022Event-based Temporally Dense Optical Flow Estimation with Sequential Learningcited by 15
- 2016Can Ground Truth Label Propagation from Video help Semantic Segmentation?cited by 9
- 20223D-FlowNet: Event-based optical flow estimation with 3D representationcited by 2
Built on by
Citing papers per year: 2024: 6; 2025: 4; 2026: 5.
15 papers.
Sort:
By area:
- 2025Low-Light Image Enhancement using Event-Based Illumination Estimationcited by 12
- 2024EMatch: A Unified Framework for Event-based Optical Flow and Stereo Matchingcited by 6
- 2024Learning Normal Flow Directly From Event Neighborhoodscited by 5
- 2024Vector-Symbolic Architecture for Event-Based Optical Flowcited by 4
- 2025Learning Efficient Meshflow and Optical Flow from Event Camerascited by 4
- 2026E-VLA: Event-Augmented Vision-Language-Action Model for Dark and Blurred Scenescited by 4
- 2024ResFlow: Fine-tuning Residual Optical Flow for Event-based High Temporal Resolution Motion Estimationcited by 3
- 2025Event-aided Semantic Scene Completioncited by 3
- 2024EI-Nexus: Towards Unmediated and Flexible Inter-Modality Local Feature Extraction and Matching for Event-Image Datacited by 1
- 2026Decoupling Amplitude and Phase Attention in Frequency Domain for RGB-Event based Visual Object Trackingcited by 1
- 2026From Contrast to Consistency: Rethinking Event-based Continuous-Time Optical Flow Estimationcited by 1
- 2024Labits: Layered Bidirectional Time Surfaces Representation for Event Camera-based Continuous Dense Trajectory Estimationcited by 0
- 2026E-WAVE: Event-based Continuous Optical Flow via Warping-Aligned Visual Encoding28 Sep 2026
- 2026On The Robustness-Resolution Tradeoff In Temporal Quantization Of Event Streams14 Sep 2026
- 2026From Contrast to Consistency: Rethinking Event-based Continuous-Time Optical Flow Estimation25 May 2026
- 2026E-VLA: Event-Augmented Vision-Language-Action Model for Dark and Blurred Scenes6 Apr 2026
- 2026Decoupling Amplitude and Phase Attention in Frequency Domain for RGB-Event based Visual Object Tracking3 Jan 2026
- 2025EvDiff: Event-Based Video Reconstruction using One-Step Diffusion Models21 Nov 2025
- 2025Learning Efficient Meshflow and Optical Flow from Event Cameras5 Oct 2025
- 2025Low-Light Image Enhancement using Event-Based Illumination Estimation13 Apr 2025
- 2025Event-aided Semantic Scene Completion4 Feb 2025
- 2024Learning Normal Flow Directly From Event Neighborhoods15 Dec 2024
- 2024ResFlow: Fine-tuning Residual Optical Flow for Event-based High Temporal Resolution Motion Estimation12 Dec 2024
- 2024Labits: Layered Bidirectional Time Surfaces Representation for Event Camera-based Continuous Dense Trajectory Estimation12 Dec 2024
- 2025Low-Light Image Enhancement using Event-Based Illumination Estimationcited by 12
- 2024EMatch: A Unified Framework for Event-based Optical Flow and Stereo Matchingcited by 6
- 2024Learning Normal Flow Directly From Event Neighborhoodscited by 5
- 2024Vector-Symbolic Architecture for Event-Based Optical Flowcited by 4
- 2025Learning Efficient Meshflow and Optical Flow from Event Camerascited by 4
- 2024ResFlow: Fine-tuning Residual Optical Flow for Event-based High Temporal Resolution Motion Estimationcited by 3
- 2025Event-aided Semantic Scene Completioncited by 3
- 2024EI-Nexus: Towards Unmediated and Flexible Inter-Modality Local Feature Extraction and Matching for Event-Image Datacited by 1
- 2026Decoupling Amplitude and Phase Attention in Frequency Domain for RGB-Event based Visual Object Trackingcited by 1
- 2026From Contrast to Consistency: Rethinking Event-based Continuous-Time Optical Flow Estimationcited by 1
- 2024Labits: Layered Bidirectional Time Surfaces Representation for Event Camera-based Continuous Dense Trajectory Estimationcited by 0
- 2026On The Robustness-Resolution Tradeoff In Temporal Quantization Of Event Streamscited by 0
12 most cited of 13 All 13 (JSON)
- 2026E-WAVE: Event-based Continuous Optical Flow via Warping-Aligned Visual Encoding28 Sep 2026
- 2026On The Robustness-Resolution Tradeoff In Temporal Quantization Of Event Streams14 Sep 2026
- 2026From Contrast to Consistency: Rethinking Event-based Continuous-Time Optical Flow Estimation25 May 2026
- 2026Decoupling Amplitude and Phase Attention in Frequency Domain for RGB-Event based Visual Object Tracking3 Jan 2026
- 2025Learning Efficient Meshflow and Optical Flow from Event Cameras5 Oct 2025
- 2025Low-Light Image Enhancement using Event-Based Illumination Estimation13 Apr 2025
- 2025Event-aided Semantic Scene Completion4 Feb 2025
- 2024Learning Normal Flow Directly From Event Neighborhoods15 Dec 2024
- 2024ResFlow: Fine-tuning Residual Optical Flow for Event-based High Temporal Resolution Motion Estimation12 Dec 2024
- 2024Labits: Layered Bidirectional Time Surfaces Representation for Event Camera-based Continuous Dense Trajectory Estimation12 Dec 2024
- 2024EI-Nexus: Towards Unmediated and Flexible Inter-Modality Local Feature Extraction and Matching for Event-Image Data29 Oct 2024
- 2024EMatch: A Unified Framework for Event-based Optical Flow and Stereo Matching31 Jul 2024
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026EventShiftFlow: Towards Hardware-efficient FPGA-based Flow Estimation
- 2025Spatio-Temporal State Space Model For Efficient Event-Based Optical Flow
- 2025Injecting Frame-Event Complementary Fusion into Diffusion for Optical Flow in Challenging Scenes
- 2025Perturbed State Space Feature Encoders for Optical Flow with Event Cameras
- 2026Bridging Event Streams and DiT: Event-Guided Video Frame Interpolation
- 2026TETO: Tracking Events with Teacher Observation for Motion Estimation and Frame Interpolation
- 2024An Event-Oriented Diffusion-Refinement Method for Sparse Events Completion
- 2025DESSERT: Diffusion-based Event-driven Single-frame Synthesis via Residual Training