mlsanityData to 7 Oct 2026

Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotion

arXiv 1812.08156 ↗First posted 19 Dec 2018cs.CVcited by 304

Not on the map. Why?

Abstract (arXiv)

In this work, we propose a novel framework for unsupervised learning for event cameras that learns motion information from only the event stream. In particular, we propose an input representation of the events in the form of a discretized volume that maintains the temporal distribution of the events, which we pass through a neural network to predict the motion of the events. This motion is used to attempt to remove any motion blur in the event image. We then propose a loss function applied to the motion compensated event image that measures the motion blur in this image. We train two networks with this framework, one to predict optical flow, and one to predict egomotion and depths, and evaluate these networks on the Multi Vehicle Stereo Event Camera dataset, along with qualitative results from a variety of different scenes.

Key facts. Cited by 304 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Dec 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 30; 2022: 40; 2023: 62; 2024: 75; 2025: 54; 2026: 43.

304 papers.

Sort:

By area:

  1. 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 297
  2. 2022Recurrent Vision Transformers for Object Detection with Event Camerascited by 158
  3. 2021E-RAFT: Dense Optical Flow from Event Camerascited by 149
  4. 2022AEGNN: Asynchronous Event-based Graph Neural Networkscited by 118
  5. 2021Event-Based Fusion for Motion Deblurring with Cross-modal Attentioncited by 112
  6. 2021Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural Networkscited by 99
  7. 2022Secrets of Event-Based Optical Flowcited by 92
  8. 2022Event-aided Direct Sparse Odometrycited by 91
  9. 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
  10. 2021Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Predictioncited by 88
  11. 2021Object Tracking by Jointly Exploiting Frame and Event Domaincited by 83
  12. 2022ESS: Learning Event-based Semantic Segmentation from Still Imagescited by 81
38 more
  1. 2021Time-Ordered Recent Event (TORE) Volumes for Event Camerascited by 73
  2. 2023GET: Group Event Transformer for Event-Based Visioncited by 73
  3. 2024Recent Event Camera Innovations: A Surveycited by 67
  4. 2022Learning Dense and Continuous Optical Flow from an Event Cameracited by 59
  5. 2022Event-based Video Reconstruction via Potential-assisted Spiking Neural Networkcited by 58
  6. 2024EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Imagescited by 56
  7. 2023From Chaos Comes Order: Ordering Event Representations for Object Recognition and Detectioncited by 52
  8. 2023Graph-based Asynchronous Event Processing for Rapid Object Recognitioncited by 51
  9. 2021Spatio-Temporal Recurrent Networks for Event-Based Optical Flow Estimationcited by 50
  10. 2021E2(GO)MOTION: Motion Augmented Event Stream for Egocentric Action Recognitioncited by 50
  11. 2021EvDistill: Asynchronous Events to End-task Learning via Bidirectional Reconstruction-guided Cross-modal Knowledge Distillationcited by 46
  12. 2022Dense Continuous-Time Optical Flow from Events and Framescited by 45
  13. 2023Hierarchical Neural Memory Network for Low Latency Event Processingcited by 45
  14. 2023Cross-modal Orthogonal High-rank Augmentation for RGB-Event Transformer-trackerscited by 43
  15. 2022RGB-Event Fusion for Moving Object Detection in Autonomous Drivingcited by 39
  16. 2023Taming Contrast Maximization for Learning Sequential, Low-latency, Event-based Optical Flowcited by 39
  17. 2023SODFormer: Streaming Object Detection with Transformer Using Events and Framescited by 39
  18. 2024Scene Adaptive Sparse Transformer for Event-based Object Detectioncited by 39
  19. 2024OpenESS: Event-based Semantic Scene Understanding with Open Vocabulariescited by 37
  20. 2022Event Collapse in Contrast Maximization Frameworkscited by 33
  21. 2022Low-Light Video Enhancement with Synthetic Event Guidancecited by 33
  22. 2023Optical flow estimation from event-based cameras and spiking neural networkscited by 33
  23. 2023BlinkFlow: A Dataset to Push the Limits of Event-based Optical Flow Estimationcited by 33
  24. 2024Seeing Motion at Nighttime with an Event Cameracited by 33
  25. 2022Pushing the Limits of Asynchronous Graph-based Object Detection with Event Camerascited by 32
  26. 2021Dual Transfer Learning for Event-based End-task Prediction via Pluggable Event to Image Translationcited by 31
  27. 2022Globally-Optimal Contrast Maximisation for Event Camerascited by 31
  28. 2022Lightweight Event-based Optical Flow Estimation via Iterative Deblurringcited by 31
  29. 2023TMA: Temporal Motion Aggregation for Event-based Optical Flowcited by 31
  30. 2024CMax-SLAM: Event-based Rotational-Motion Bundle Adjustment and SLAM System using Contrast Maximizationcited by 31
  31. 2023Fully neuromorphic vision and control for autonomous drone flightcited by 30
  32. 2023CMDA: Cross-Modality Domain Adaptation for Nighttime Semantic Segmentationcited by 30
  33. 2021Optical Flow Estimation for Spiking Cameracited by 29
  34. 2023Deep Event Visual Odometrycited by 29
  35. 2021EventDrop: data augmentation for event-based learningcited by 28
  36. 2021Formulating Event-based Image Reconstruction as a Linear Inverse Problem with Deep Regularization using Optical Flowcited by 28
  37. 2023Label-Free Event-based Object Recognition via Joint Learning with Image Reconstruction from Eventscited by 28
  38. 2021Real-Time Optical Flow for Vehicular Perception with Low- and High-Resolution Event Camerascited by 27

50 most cited of 304 All 304 (JSON)