Event-based Vision: A Survey
Not on the map. Why?
Abstract (arXiv)
Event cameras are bio-inspired sensors that differ from conventional frame cameras: Instead of capturing images at a fixed rate, they asynchronously measure per-pixel brightness changes, and output a stream of events that encode the time, location and sign of the brightness changes. Event cameras offer attractive properties compared to traditional cameras: high temporal resolution (in the order of microseconds), very high dynamic range (140 dB vs. 60 dB), low power consumption, and high pixel bandwidth (on the order of kHz) resulting in reduced motion blur. Hence, event cameras have a large potential for robotics and computer vision in challenging scenarios for traditional cameras, such as low-latency, high speed, and high dynamic range. However, novel methods are required to process the unconventional output of these sensors in order to unlock their potential. This paper provides a comprehensive overview of the emerging field of event-based vision, with a focus on the applications and the algorithms developed to unlock the outstanding properties of event cameras. We present event cameras from their working principle, the actual sensors that are available and the tasks that they have been used for, from low-level vision (feature detection and tracking, optic flow, etc.) to high-level vision (reconstruction, segmentation, recognition). We also discuss the techniques developed to process events, including learning-based techniques, as well as specialized processors for these novel sensors, such as spiking neural networks. Additionally, we highlight the challenges that remain to be tackled and the opportunities that lie ahead in the search for a more efficient, bio-inspired way for machines to perceive and interact with the world.
Key facts. Cited by 1,010 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 83; 2022: 103; 2023: 154; 2024: 221; 2025: 236; 2026: 213.
1,010 papers.
Sort:
By area:
- 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 297
- 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 251
- 2022Recurrent Vision Transformers for Object Detection with Event Camerascited by 158
- 2021E-RAFT: Dense Optical Flow from Event Camerascited by 149
- 2023Spike-driven Transformercited by 141
- 2021VisEvent: Reliable Object Tracking via Collaboration of Frame and Event Flowscited by 128
- 2022AEGNN: Asynchronous Event-based Graph Neural Networkscited by 118
- 2023Delivering Arbitrary-Modal Semantic Segmentationcited by 115
- 2021Event-Based Fusion for Motion Deblurring with Cross-modal Attentioncited by 112
- 2022Time Lens++: Event-based Frame Interpolation with Parametric Non-linear Flow and Multi-scale Fusioncited by 110
- 2021Temporal-wise Attention Spiking Neural Networks for Event Streams Classificationcited by 106
- 2022Attention Spiking Neural Networkscited by 103
38 more
- 2021Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural Networkscited by 99
- 2021Learning High-Speed Flight in the Wildcited by 98
- 2024Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chipscited by 97
- 2022EventNeRF: Neural Radiance Fields from a Single Colour Event Cameracited by 92
- 2022Secrets of Event-Based Optical Flowcited by 92
- 2022Event-aided Direct Sparse Odometrycited by 91
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
- 2021Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Predictioncited by 88
- 2021Object Tracking by Jointly Exploiting Frame and Event Domaincited by 83
- 2022ESS: Learning Event-based Semantic Segmentation from Still Imagescited by 81
- 2024State Space Models for Event Camerascited by 75
- 2021Time-Ordered Recent Event (TORE) Volumes for Event Camerascited by 73
- 2023Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baselinecited by 73
- 2023GET: Group Event Transformer for Event-Based Visioncited by 73
- 2022E-NeRF: Neural Radiance Fields from a Moving Event Cameracited by 70
- 2024Recent Event Camera Innovations: A Surveycited by 67
- 2022Ev-NeRF: Event Based Neural Radiance Fieldcited by 59
- 2022Learning Dense and Continuous Optical Flow from an Event Cameracited by 59
- 2022Unifying Motion Deblurring and Frame Interpolation with Eventscited by 58
- 2023Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Reviewcited by 57
- 2024ReconBoost: Boosting Can Achieve Modality Reconcilementcited by 56
- 2024EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Imagescited by 56
- 2021How to Calibrate Your Event Cameracited by 53
- 2021Motion Deblurring with Real Eventscited by 52
- 2022Neuromorphic Data Augmentation for Training Spiking Neural Networkscited by 52
- 2023From Chaos Comes Order: Ordering Event Representations for Object Recognition and Detectioncited by 52
- 2023Graph-based Asynchronous Event Processing for Rapid Object Recognitioncited by 51
- 2021E2(GO)MOTION: Motion Augmented Event Stream for Egocentric Action Recognitioncited by 50
- 2023Speck: A Smart event-based Vision Sensor with a low latency 327K Neuron Convolutional Neuronal Network Processing Pipelinecited by 50
- 2023RoboDepth: Robust Out-of-Distribution Depth Estimation under Corruptionscited by 47
- 2021EvDistill: Asynchronous Events to End-task Learning via Bidirectional Reconstruction-guided Cross-modal Knowledge Distillationcited by 46
- 2022HARDVS: Revisiting Human Activity Recognition with Dynamic Vision Sensorscited by 46
- 2021Deep Learning for HDR Imaging: State-of-the-Art and Future Trendscited by 45
- 2022Dense Continuous-Time Optical Flow from Events and Framescited by 45
- 2022VECtor: A Versatile Event-Centric Benchmark for Multi-Sensor SLAMcited by 45
- 2023Robust e-NeRF: NeRF from Sparse & Noisy Events under Non-Uniform Motioncited by 44
- 2023Frame-Event Alignment and Fusion Network for High Frame Rate Trackingcited by 43
- 2023Cross-modal Orthogonal High-rank Augmentation for RGB-Event Transformer-trackerscited by 43
50 most cited of 1,010 All 1,010 (JSON)
- 2026Vmem-varphi: Low-Compute Out-of-Distribution Detection in Spiking Neural Networks from Membrane-Potential Statistics29 Sep 2026
- 2026SFE-VGGT: Source-Free VGGT Distillation for Event-Based Monocular Depth Estimation29 Sep 2026
- 2026Stealth Is a Relation, Not a Property: How Event Representations Create Blind Spots for Timing Attacks in Event-Based Perception28 Sep 2026
- 2026ECHO: Event-Augmented Context with Hindsight and Outlook for Wrist-Only Manipulation28 Sep 2026
- 2026E-WAVE: Event-based Continuous Optical Flow via Warping-Aligned Visual Encoding28 Sep 2026
- 2026RIPE-MambaSpike: Resolution-Independent Spiking-State-Space Interfaces for Parameter-Efficient Event-Based Vision26 Sep 2026
- 2026Toward On-Chip Training of Spiking Neural Networks for Dense Event-Based Vision26 Sep 2026
- 2026DAPEVO: Deep Adaptive Patch Frame-Event Visual Odometry25 Sep 2026
- 2026The Shape of Events: Edge-Based Inductive Biases via Cross-Domain Distillation24 Sep 2026
- 2026Modelling dynamic systems transfer functions from events in computational neuromorphic imaging24 Sep 2026
- 2026Bend the Clock: Predicting Ahead to Beat Latency in Event-Based Object Detection22 Sep 2026
- 2026LiFR v2: Completion-Augmented Event Propagation for High-Rate Dense Prediction22 Sep 2026
38 more
- 2026Can Spiking Neural Networks play pinball? A neuromorphic motion detector for target tracking21 Sep 2026
- 2026Event-Frame Fusion for Inter-Frame Segmentation via Event-Guided Motion18 Sep 2026
- 2026Multi-viewpoint Geo-localization with Event Cameras18 Sep 2026
- 2026PointEvent: Rethinking Event-based Tiny Object Detection via Serialized Motion Evidence Accumulation17 Sep 2026
- 2026An Event Preserving Velocity Invariant Representation for Event Cameras17 Sep 2026
- 2026REACT: A Fully Spiking State-Space Model for Real-Time Event-Driven Temporal Perception16 Sep 2026
- 2026Mask IPL: Noise-Free Intrinsic Position Learning via Computation Graph Clipping for Event-Based Spike-Driven Tracking16 Sep 2026
- 2026EventEgoHands++: Event-based Egocentric 3D Hand Mesh Reconstruction with Real Dataset15 Sep 2026
- 2026Event-based Selective Attention for Multi-resolution Fast Region of Interest (ROI) Detection15 Sep 2026
- 2026Hyper-RED: Scalable Event Pre-training via Semantic Hypergraph Distillation15 Sep 2026
- 2026On The Robustness-Resolution Tradeoff In Temporal Quantization Of Event Streams14 Sep 2026
- 2026Event-Native Symbolic-Temporal Spike Encoding Framework for Heterogeneous Cyber Streams14 Sep 2026
- 2026An Affordable AI-Integrated Smart Cane for Multimodal Mobility Assistance of Visually Impaired Users12 Sep 2026
- 2026Pedestrian Crossing Intent Classification From Event-Based Vision Using Convolutional Spiking Neural Networks With Temporal Augmentation11 Sep 2026
- 2026EdMCGS: Event-Driven Markov Chain Gaussian Splatting for Extreme-Low-Frame-Rate Dynamic Scene Reconstruction8 Sep 2026
- 2026Efficient Multi-Timescale Event Representations for Feed-Forward Object Detection4 Sep 2026
- 2026Residual Kalman Dynamics for Event-Based UAV Forecasting1 Sep 2026
- 2026Lossy Event Compression: From Event Stream Distortion to Task Performance28 Aug 2026
- 2026ANTShapes Benchmarking Datasets for Event-Based Neuromorphic Object Classification27 Aug 2026
- 2026Real-time Unsupervised Object Discovery from Asynchronous Event Streams27 Aug 2026
- 2026Event-Based Motion Estimation via Oriented Distance Fields25 Aug 2026
- 2026Simplified Cross-Modal Calibration for Heterogeneous Event-RGB Stereo Systems24 Aug 2026
- 2026MotionDLO: Hybrid Event- and Frame-Based Tracking of Deformable Linear Objects23 Aug 2026
- 2026FLEET: Token-Based Feature Extraction for Event Camera-based Reinforcement Learning17 Aug 2026
- 2026E-S2Feat:Semantic-Guided Spiking Local Feature Detection and Description for Event Cameras14 Aug 2026
- 2026Static in Frames, Dynamic in Events: Rethinking Features in Event Cameras as Motion Cues11 Aug 2026
- 2026Moving6DPoSe: A Multimodal Database for Monocular 6D Pose Estimation and Segmentation of Moving Objects9 Aug 2026
- 2026EvTrajGS: Accurate and Efficient 3D Gaussian Splatting from Unposed Event Streams9 Aug 2026
- 2026ERF-GS: Reconstructing Fast Motion from Disjoint Event-RGB Viewpoints9 Aug 2026
- 2026eBIRD: Event-based Intensity Image Reconstruction Using Controllable Diffusion Models9 Aug 2026
- 2026EvBS: Event-guided Blur Synthesis for Domain-adaptive Motion Deblurring8 Aug 2026
- 2026SpikeWorld: Fast-State Adaptation for Frozen Spiking World Models7 Aug 2026
- 2026EvReflection: Event-Driven Micro-Dynamics for Reflection Removal6 Aug 2026
- 2026Engram-E2VID: Reference-Based Event-to-Video Reconstruction via Generative Activation of Appearance Engrams6 Aug 2026
- 2026Cooking beyond Frames: A Stereo Event Camera Dataset in the Kitchen5 Aug 2026
- 2026PLS-Calib: A Partial Least Squares Framework for Event Camera and Odometry Calibration under Ground Motion Constraints4 Aug 2026
- 2026ENCORE: Event-Assisted Complementary Motion Refinement for Learned Video Compression30 Jul 2026
- 2026Sequence-SOD: Bio-inspired Sequence-aware Spiking ObjectDetection for Event Cameras29 Jul 2026
50 newest of 1,010 All 1,010 (JSON)
- 2025MLLMs are Deeply Affected by Modality Biascited by 38
- 2023EventCLIP: Adapting CLIP for Event-based Object Recognitioncited by 36
- 2023EventBind: Learning a Unified Representation to Bind Them All for Event-based Open-world Understandingcited by 33
- 2024EventGPT: Event Stream Understanding with Multimodal Large Language Modelscited by 27
- 2025LLaVA-4D: Embedding SpatioTemporal Prompt into LMMs for 4D Scene Understandingcited by 17
- 2025EventVL: Understand Event Streams via Multimodal Large Language Modelcited by 13
- 2023Semantic-Aware Frame-Event Fusion based Pattern Recognition via Large Vision-Language Modelscited by 7
- 2025Event-Priori-Based Vision-Language Model for Efficient Visual Understandingcited by 5
- 2026EventFlash: Towards Efficient MLLMs for Event-Based Visioncited by 3
- 2025EventBench: Towards Comprehensive Benchmarking of Event-based MLLMscited by 1
- 2024RoboGolf: Mastering Real-World Minigolf with a Reflective Multi-Modality Vision-Language Modelcited by 0
- 2025Reconstruction as a Bridge for Event-Based Visual Question Answeringcited by 0
12 most cited of 13 All 13 (JSON)
- 2026RE-VLM: Event-Augmented Vision-Language Model for Scene Understanding19 May 2026
- 2026EventFlash: Towards Efficient MLLMs for Event-Based Vision3 Feb 2026
- 2025Reconstruction as a Bridge for Event-Based Visual Question Answering12 Dec 2025
- 2025EventBench: Towards Comprehensive Benchmarking of Event-based MLLMs23 Nov 2025
- 2025Event-Priori-Based Vision-Language Model for Efficient Visual Understanding9 Jun 2025
- 2025MLLMs are Deeply Affected by Modality Bias24 May 2025
- 2025LLaVA-4D: Embedding SpatioTemporal Prompt into LMMs for 4D Scene Understanding18 May 2025
- 2025EventVL: Understand Event Streams via Multimodal Large Language Model23 Jan 2025
- 2024EventGPT: Event Stream Understanding with Multimodal Large Language Models1 Dec 2024
- 2024RoboGolf: Mastering Real-World Minigolf with a Reflective Multi-Modality Vision-Language Model14 Jun 2024
- 2023Semantic-Aware Frame-Event Fusion based Pattern Recognition via Large Vision-Language Models30 Nov 2023
- 2023EventBind: Learning a Unified Representation to Bind Them All for Event-based Open-world Understanding6 Aug 2023
12 newest of 13 All 13 (JSON)
- 2024Repurposing Pre-trained Video Diffusion Models for Event-based Video Interpolationcited by 23
- 2024Motion-aware Latent Diffusion Models for Video Frame Interpolationcited by 14
- 2025DiET-GS: Diffusion Prior and Event Stream-Assisted Motion Deblurring 3D Gaussian Splattingcited by 14
- 2024E-Motion: Future Motion Simulation via Event Sequence Diffusioncited by 11
- 2025Injecting Frame-Event Complementary Fusion into Diffusion for Optical Flow in Challenging Scenescited by 2
- 2025ControlEvents: Controllable Synthesis of Event Camera Datawith Foundational Prior from Image Diffusion Modelscited by 1
- 2025DESSERT: Diffusion-based Event-driven Single-frame Synthesis via Residual Trainingcited by 1
- 2026UniE2F: A Unified Diffusion Framework for Event-to-Frame Reconstruction with Video Foundation Modelscited by 1
- 2025EvDiff: Event-Based Video Reconstruction using One-Step Diffusion Modelscited by 0
- 2025IE2Video: Adapting Pretrained Diffusion Models for Event-Based Video Reconstructioncited by 0
- 2026LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Modelscited by 0
- 2026eBIRD: Event-based Intensity Image Reconstruction Using Controllable Diffusion Modelscited by 0
- 2026eBIRD: Event-based Intensity Image Reconstruction Using Controllable Diffusion Models9 Aug 2026
- 2026LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Models9 Jul 2026
- 2026UniE2F: A Unified Diffusion Framework for Event-to-Frame Reconstruction with Video Foundation Models22 Feb 2026
- 2025DESSERT: Diffusion-based Event-driven Single-frame Synthesis via Residual Training19 Dec 2025
- 2025IE2Video: Adapting Pretrained Diffusion Models for Event-Based Video Reconstruction4 Dec 2025
- 2025EvDiff: Event-Based Video Reconstruction using One-Step Diffusion Models21 Nov 2025
- 2025Injecting Frame-Event Complementary Fusion into Diffusion for Optical Flow in Challenging Scenes12 Oct 2025
- 2025ControlEvents: Controllable Synthesis of Event Camera Datawith Foundational Prior from Image Diffusion Models26 Sep 2025
- 2025DiET-GS: Diffusion Prior and Event Stream-Assisted Motion Deblurring 3D Gaussian Splatting31 Mar 2025
- 2024Repurposing Pre-trained Video Diffusion Models for Event-based Video Interpolation10 Dec 2024
- 2024E-Motion: Future Motion Simulation via Event Sequence Diffusion11 Oct 2024
- 2024Motion-aware Latent Diffusion Models for Video Frame Interpolation21 Apr 2024
- 2024Mamba-FETrack: Frame-Event Tracking via State Space Modelcited by 21
- 2025Binarized Mamba-Transformer for Lightweight Quad Bayer HybridEVS Demosaicingcited by 7
- 2025PRE-Mamba: A 4D State Space Model for Ultra-High-Frequent Event Camera Derainingcited by 5
- 2025MambaSeg: Harnessing Mamba for Accurate and Efficient Image-Event Semantic Segmentationcited by 4
- 2024PASS: Path-selective State Space Model for Event-based Recognitioncited by 0
- 2025CETUS: Causal Event-Driven Temporal Modeling With Unified Variable-Rate Schedulingcited by 0
- 2026RIPE-MambaSpike: Resolution-Independent Spiking-State-Space Interfaces for Parameter-Efficient Event-Based Visioncited by 0
- 2026RIPE-MambaSpike: Resolution-Independent Spiking-State-Space Interfaces for Parameter-Efficient Event-Based Vision26 Sep 2026
- 2025MambaSeg: Harnessing Mamba for Accurate and Efficient Image-Event Semantic Segmentation30 Dec 2025
- 2025CETUS: Causal Event-Driven Temporal Modeling With Unified Variable-Rate Scheduling17 Sep 2025
- 2025PRE-Mamba: A 4D State Space Model for Ultra-High-Frequent Event Camera Deraining8 May 2025
- 2025Binarized Mamba-Transformer for Lightweight Quad Bayer HybridEVS Demosaicing20 Mar 2025
- 2024PASS: Path-selective State Space Model for Event-based Recognition25 Sep 2024
- 2024Mamba-FETrack: Frame-Event Tracking via State Space Model28 Apr 2024
- 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 297
- 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 251
- 2022Recurrent Vision Transformers for Object Detection with Event Camerascited by 158
- 2021E-RAFT: Dense Optical Flow from Event Camerascited by 149
- 2023Spike-driven Transformercited by 141
- 2021VisEvent: Reliable Object Tracking via Collaboration of Frame and Event Flowscited by 128
- 2022AEGNN: Asynchronous Event-based Graph Neural Networkscited by 118
- 2023Delivering Arbitrary-Modal Semantic Segmentationcited by 115
- 2021Event-Based Fusion for Motion Deblurring with Cross-modal Attentioncited by 112
- 2022Time Lens++: Event-based Frame Interpolation with Parametric Non-linear Flow and Multi-scale Fusioncited by 110
- 2021Temporal-wise Attention Spiking Neural Networks for Event Streams Classificationcited by 106
- 2022Attention Spiking Neural Networkscited by 103
12 most cited of 965 All 965 (JSON)
- 2026Vmem-varphi: Low-Compute Out-of-Distribution Detection in Spiking Neural Networks from Membrane-Potential Statistics29 Sep 2026
- 2026SFE-VGGT: Source-Free VGGT Distillation for Event-Based Monocular Depth Estimation29 Sep 2026
- 2026Stealth Is a Relation, Not a Property: How Event Representations Create Blind Spots for Timing Attacks in Event-Based Perception28 Sep 2026
- 2026ECHO: Event-Augmented Context with Hindsight and Outlook for Wrist-Only Manipulation28 Sep 2026
- 2026E-WAVE: Event-based Continuous Optical Flow via Warping-Aligned Visual Encoding28 Sep 2026
- 2026Toward On-Chip Training of Spiking Neural Networks for Dense Event-Based Vision26 Sep 2026
- 2026DAPEVO: Deep Adaptive Patch Frame-Event Visual Odometry25 Sep 2026
- 2026The Shape of Events: Edge-Based Inductive Biases via Cross-Domain Distillation24 Sep 2026
- 2026Modelling dynamic systems transfer functions from events in computational neuromorphic imaging24 Sep 2026
- 2026Bend the Clock: Predicting Ahead to Beat Latency in Event-Based Object Detection22 Sep 2026
- 2026LiFR v2: Completion-Augmented Event Propagation for High-Rate Dense Prediction22 Sep 2026
- 2026Can Spiking Neural Networks play pinball? A neuromorphic motion detector for target tracking21 Sep 2026
12 newest of 965 All 965 (JSON)