LC-Flow: Learning Local Continuous Optical Flow and Confidence from events
Not on the map. Why?
Abstract (arXiv)
Event cameras capture brightness changes asynchronously with microsecond resolution, yet existing optical flow methods fail to fully exploit this temporal continuity. Frame-based approaches impose artificial accumulation latency and suffer from domain overfitting, while model-based local methods operate statelessly, discarding temporal history between predictions and yielding inaccurate flows. We propose LC-Flow, the first temporally continuous, learning-based optical flow estimator that operates purely from local events. At its core, a Continuous Local Recurrent Network maintains persistent hidden states per spatial grid, incrementally accumulating temporal context as events arrive. Unlike frame-based methods constrained to fixed accumulation windows, and unlike stateless model-based methods that recompute motion from scratch at each step, LC-Flow produces sparse local flow estimates at arbitrary timestamps with full motion history. To address the inherent ambiguity of local observations, we jointly learn a confidence score that quantifies the reliability of each prediction, explicitly handling event sparsity and the aperture problem. This confidence serves a dual role: filtering unreliable estimates for downstream tasks such as visual odometry, and providing principled weights for a multi-scale confidence-guided aggregation that reconstructs globally consistent flow from the sparse local outputs. LC-Flow achieves state-of-the-art performance among local methods on both MVSEC and DSEC, while the confidence-guided aggregation establishes a new overall state-of-the-art on the MVSEC benchmark, surpassing heavy frame-based networks that rely on global spatial priors.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 41 references that are in the map. First posted on arXiv 23 May 2026.
Builds on
29 of 41 references.
References · 29
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 304
- 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 297
- 2018The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perceptioncited by 251
- 2018EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Camerascited by 223
- 2021E-RAFT: Dense Optical Flow from Event Camerascited by 149
- 2020Back to Event Basics: Self-Supervised Learning of Image Reconstruction for Event Cameras via Photometric Constancycited by 125
- 2022AEGNN: Asynchronous Event-based Graph Neural Networkscited by 118
- 2020Spike-FlowNet: Event-based Optical Flow Estimation with Energy-Efficient Hybrid Neural Networkscited by 98
- 2022Secrets of Event-Based Optical Flowcited by 92
- 2021Time-Ordered Recent Event (TORE) Volumes for Event Camerascited by 73
17 more
- 2022Learning Dense and Continuous Optical Flow from an Event Cameracited by 59
- 2018EventNet: Asynchronous Recursive Event Processingcited by 58
- 2021Spatio-Temporal Recurrent Networks for Event-Based Optical Flow Estimationcited by 50
- 2023Taming Contrast Maximization for Learning Sequential, Low-latency, Event-based Optical Flowcited by 39
- 2023Optical flow estimation from event-based cameras and spiking neural networkscited by 33
- 2023TMA: Temporal Motion Aggregation for Event-based Optical Flowcited by 31
- 2024Scalable Event-by-event Processing of Neuromorphic Sensory Signals With Deep State-Space Modelscited by 31
- 2020Distance Surface for Event-Based Optical Flowcited by 29
- 2021Real-Time Optical Flow for Vehicular Perception with Low- and High-Resolution Event Camerascited by 27
- 2018Real-time high speed motion prediction using fast aperture-robust event-driven visual flowcited by 24
- 2022Fast Event-based Optical Flow Estimation by Triplet Matchingcited by 11
- 2024FlexEvent: Towards Flexible Event-Frame Object Detection at Varying Operational Frequenciescited by 10
- 2023EV-MGRFlowNet: Motion-Guided Recurrent Network for Unsupervised Event-based Optical Flow with Hybrid Motion-Compensation Losscited by 9
- 2024Learning Normal Flow Directly From Event Neighborhoodscited by 5
- 2025EDCFlow: Exploring Temporally Dense Difference Maps for Event-based Optical Flow Estimationcited by 5
- 2024Continuous-Time Human Motion Field from Eventscited by 1
- 2025SMF-VO: Direct Ego-Motion Estimation via Sparse Motion Fieldscited by 1
Built on by
Not cited yet.