The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perception
Not on the map. Why?
Abstract (arXiv)
Event based cameras are a new passive sensing modality with a number of benefits over traditional cameras, including extremely low latency, asynchronous data acquisition, high dynamic range and very low power consumption. There has been a lot of recent interest and development in applying algorithms to use the events to perform a variety of 3D perception tasks, such as feature tracking, visual odometry, and stereo depth estimation. However, there currently lacks the wealth of labeled data that exists for traditional cameras to be used for both testing and development. In this paper, we present a large dataset with a synchronized stereo pair event based camera system, carried on a handheld rig, flown by a hexacopter, driven on top of a car and mounted on a motorcycle, in a variety of different illumination levels and environments. From each camera, we provide the event stream, grayscale images and IMU readings. In addition, we utilize a combination of IMU, a rigidly mounted lidar system, indoor and outdoor motion capture and GPS to provide accurate pose and depth images for each camera at up to 100Hz. For comparison, we also provide synchronized grayscale images and IMU readings from a frame based stereo camera system.
Key facts. Cited by 251 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Jan 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 34; 2023: 44; 2024: 49; 2025: 60; 2026: 41.
251 papers.
Sort:
By area:
- 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 297
- 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 251
- 2022AEGNN: Asynchronous Event-based Graph Neural Networkscited by 118
- 2021Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural Networkscited by 99
- 2022Secrets of Event-Based Optical Flowcited by 92
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
- 2021Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Predictioncited by 88
- 2024Recent Event Camera Innovations: A Surveycited by 67
- 2022Learning Dense and Continuous Optical Flow from an Event Cameracited by 59
- 2022Event-based Video Reconstruction via Potential-assisted Spiking Neural Networkcited by 58
- 2021Spatio-Temporal Recurrent Networks for Event-Based Optical Flow Estimationcited by 50
- 2023Event Camera Data Pre-trainingcited by 49
38 more
- 2024Towards Robust Event-guided Low-Light Image Enhancement: A Large-Scale Real-World Event-Image Dataset and Novel Approachcited by 48
- 2021EvDistill: Asynchronous Events to End-task Learning via Bidirectional Reconstruction-guided Cross-modal Knowledge Distillationcited by 46
- 2022VECtor: A Versatile Event-Centric Benchmark for Multi-Sensor SLAMcited by 45
- 2023Hierarchical Neural Memory Network for Low Latency Event Processingcited by 45
- 2021TUM-VIE: The TUM Stereo Visual-Inertial Event Datasetcited by 41
- 2022RGB-Event Fusion for Moving Object Detection in Autonomous Drivingcited by 39
- 2023Taming Contrast Maximization for Learning Sequential, Low-latency, Event-based Optical Flowcited by 39
- 2023HyperE2VID: Improving Event-Based Video Reconstruction via Hypernetworkscited by 37
- 2021Bridging the Gap between Events and Frames through Unsupervised Domain Adaptationcited by 36
- 2022DEVO: Depth-Event Camera Visual Odometry in Challenging Conditionscited by 36
- 2022ViViD++: Vision for Visibility Datasetcited by 34
- 2022Event Collapse in Contrast Maximization Frameworkscited by 33
- 2023Optical flow estimation from event-based cameras and spiking neural networkscited by 33
- 2023BlinkFlow: A Dataset to Push the Limits of Event-based Optical Flow Estimationcited by 33
- 2024Seeing Motion at Nighttime with an Event Cameracited by 33
- 2021Dual Transfer Learning for Event-based End-task Prediction via Pluggable Event to Image Translationcited by 31
- 2022EVIMO2: An Event Camera Dataset for Motion Segmentation, Optical Flow, Structure from Motion, and Visual Inertial Odometry in Indoor Scenes with Monocular or Stereo Algorithmscited by 31
- 2022Lightweight Event-based Optical Flow Estimation via Iterative Deblurringcited by 31
- 2023TMA: Temporal Motion Aggregation for Event-based Optical Flowcited by 31
- 2021Optical Flow Estimation for Spiking Cameracited by 29
- 2023Deep Event Visual Odometrycited by 29
- 2021Real-Time Optical Flow for Vehicular Perception with Low- and High-Resolution Event Camerascited by 27
- 2023Learning Optical Flow from Event Camera with Rendered Datasetcited by 26
- 2023RPEFlow: Multimodal Fusion of RGB-PointCloud-Event for Joint Optical Flow and Scene Flow Estimationcited by 26
- 2021Fusion-FlowNet: Energy-Efficient Optical Flow Estimation using Sensor Fusion and Deep Fused Spiking-Analog Network Architecturescited by 25
- 2022HALSIE: Hybrid Approach to Learning Segmentation by Simultaneously Exploiting Image and Event Modalitiescited by 24
- 2023EVREAL: Towards a Comprehensive Benchmark and Analysis Suite for Event-based Video Reconstructioncited by 24
- 2023V2CE: Video to Continuous Events Simulatorcited by 24
- 2023LEOD: Label-Efficient Object Detection for Event Camerascited by 24
- 2024eTraM: Event-based Traffic Monitoring Datasetcited by 24
- 2024Motion-prior Contrast Maximization for Dense Continuous-Time Motion Estimationcited by 24
- 2021Comparing Representations in Tracking for Event Camera-based SLAMcited by 23
- 2024A Survey on Deep Stereo Matching in the Twentiescited by 23
- 2021Exploring Event-driven Dynamic Context for Accident Scene Segmentationcited by 22
- 2021Spatiotemporal Registration for Event-based Visual Odometrycited by 21
- 2021StereoSpike: Depth Learning with a Spiking Neural Networkcited by 21
- 2022Multi-Event-Camera Depth Estimation and Outlier Rejection by Refocused Events Fusioncited by 21
- 2023Event Camera Data Dense Pre-trainingcited by 21
50 most cited of 251 All 251 (JSON)
- 2026SFE-VGGT: Source-Free VGGT Distillation for Event-Based Monocular Depth Estimation29 Sep 2026
- 2026DAPEVO: Deep Adaptive Patch Frame-Event Visual Odometry25 Sep 2026
- 2026Can Spiking Neural Networks play pinball? A neuromorphic motion detector for target tracking21 Sep 2026
- 2026Multi-viewpoint Geo-localization with Event Cameras18 Sep 2026
- 2026An Event Preserving Velocity Invariant Representation for Event Cameras17 Sep 2026
- 2026Hyper-RED: Scalable Event Pre-training via Semantic Hypergraph Distillation15 Sep 2026
- 2026Lossy Event Compression: From Event Stream Distortion to Task Performance28 Aug 2026
- 2026LiteEvent-AE: Lightweight Autoencoder for Event-Based Vision on Low-Latency Energy-Constrained Edge Devices22 Aug 2026
- 2026E-S2Feat:Semantic-Guided Spiking Local Feature Detection and Description for Event Cameras14 Aug 2026
- 2026ERF-GS: Reconstructing Fast Motion from Disjoint Event-RGB Viewpoints9 Aug 2026
- 2026Cooking beyond Frames: A Stereo Event Camera Dataset in the Kitchen5 Aug 2026
- 2026Optical Flow Sensor: A Direction-Selective Bionic Retina Design30 Jul 2026
38 more
- 2026Event3R: Asynchronous-to-Global 3D Reconstruction from Event Camera via Spatial-Temporal Feature Aggregation17 Jul 2026
- 2026Event-RGB Adaptive Tracking for Nighttime Highway Perception13 Jul 2026
- 2026Label-Free Target-Domain Adaptation for Unconstrained Event-Image Feature Matching via Dual-Stage Distillation11 Jul 2026
- 2026LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Models9 Jul 2026
- 2026OctoSense: Self-Supervised Learning for Multimodal Robot Perception25 Jun 2026
- 2026FracEvent: Event-Camera Simulation via Fractional-Relaxation Pixel Dynamics25 Jun 2026
- 2026GeoIMO: Geometry-Driven Independent Motion Classification for Event Cameras23 Jun 2026
- 2026Computation-Aware Event-to-Frame Reconstruction via Selective Attention4 Jun 2026
- 2026Event-to-Video Reconstruction using Spatio-Temporal and Frequency-Enhanced Deep Neural Networks25 May 2026
- 2026From Contrast to Consistency: Rethinking Event-based Continuous-Time Optical Flow Estimation25 May 2026
- 2026LC-Flow: Learning Local Continuous Optical Flow and Confidence from events23 May 2026
- 2026RE-VLM: Event-Augmented Vision-Language Model for Scene Understanding19 May 2026
- 2026NeuroLiDAR: Adaptive Frame Rate Depth Sensing via Neuromorphic Event-LiDAR Fusion16 May 2026
- 2026NERVE: A Neuromorphic Vision and Radar Ensemble for Multi-Sensor Fusion Research13 May 2026
- 2026Neuromorphic Monocular Depth Estimation with Uncertainty Modeling11 May 2026
- 2026REALM: An RGB- and Event-Aligned Latent Manifold for Cross-Modal Perception30 Apr 2026
- 2026Match-Any-Events: Zero-Shot Motion-Robust Feature Matching Across Wide Baselines for Event Cameras20 Apr 2026
- 2026Bidirectional Cross-Modal Prompting for Event-Frame Asymmetric Stereo16 Apr 2026
- 2026DSERT-RoLL: Robust Multi-Modal Perception for Diverse Driving Conditions with Stereo Event-RGB-Thermal Cameras, 4D Radar, and Dual-LiDAR4 Apr 2026
- 2026EventHub: Data Factory for Generalizable Event-Based Stereo Networks without Active Sensors2 Apr 2026
- 2026Generative Event Pretraining with Foundation Model Alignment24 Mar 2026
- 2026LiFR-Seg: Anytime High-Frame-Rate Segmentation via Event-Guided Propagation22 Mar 2026
- 2026Efficient Event Camera Volume System16 Mar 2026
- 2026EventVGGT: Exploring Cross-Modal Distillation for Consistent Event-based Depth Estimation10 Mar 2026
- 2026Scaling Dense Event-Stream Pretraining from Visual Foundation Models4 Mar 2026
- 2026UniE2F: A Unified Diffusion Framework for Event-to-Frame Reconstruction with Video Foundation Models22 Feb 2026
- 2026LAND: A Longitudinal Analysis of Neuromorphic Datasets17 Feb 2026
- 2026EventFlash: Towards Efficient MLLMs for Event-Based Vision3 Feb 2026
- 2026Adapting Depth Anything to Adverse Imaging Conditions with Events5 Jan 2026
- 2025Learning to Remove Lens Flare in Event Camera9 Dec 2025
- 2025EAG3R: Event-Augmented 3D Geometry Estimation for Dynamic and Extreme-Lighting Scenes30 Nov 2025
- 2025EventBench: Towards Comprehensive Benchmarking of Event-based MLLMs23 Nov 2025
- 2025EvDiff: Event-Based Video Reconstruction using One-Step Diffusion Models21 Nov 2025
- 2025One target to align them all: LiDAR, RGB and event cameras extrinsic calibration for Autonomous Driving15 Nov 2025
- 2025Breaking the Modality Wall: Time-step Mixup for Efficient Spiking Knowledge Transfer from Static to Event Domain15 Nov 2025
- 2025SMF-VO: Direct Ego-Motion Estimation via Sparse Motion Fields12 Nov 2025
- 2025PEOD: A Pixel-Aligned Event-RGB Benchmark for Object Detection under Challenging Conditions11 Nov 2025
- 2025EvtSlowTV -- A Large and Diverse Dataset for Event-Based Depth Estimation4 Nov 2025
50 newest of 251 All 251 (JSON)
- 2024Temporal Residual Guided Diffusion Framework for Event-Driven Video Reconstructioncited by 10
- 2024E2VIDiff: Perceptual Events-to-Video Reconstruction using Diffusion Priorscited by 7
- 2024LaSe-E2V: Towards Language-guided Semantic-Aware Event-to-Video Reconstructioncited by 5
- 2026UniE2F: A Unified Diffusion Framework for Event-to-Frame Reconstruction with Video Foundation Modelscited by 1
- 2025EvDiff: Event-Based Video Reconstruction using One-Step Diffusion Modelscited by 0
- 2026LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Modelscited by 0
- 2026LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Models9 Jul 2026
- 2026UniE2F: A Unified Diffusion Framework for Event-to-Frame Reconstruction with Video Foundation Models22 Feb 2026
- 2025EvDiff: Event-Based Video Reconstruction using One-Step Diffusion Models21 Nov 2025
- 2024Temporal Residual Guided Diffusion Framework for Event-Driven Video Reconstruction15 Jul 2024
- 2024E2VIDiff: Perceptual Events-to-Video Reconstruction using Diffusion Priors11 Jul 2024
- 2024LaSe-E2V: Towards Language-guided Semantic-Aware Event-to-Video Reconstruction8 Jul 2024
- 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 297
- 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 251
- 2022AEGNN: Asynchronous Event-based Graph Neural Networkscited by 118
- 2021Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural Networkscited by 99
- 2022Secrets of Event-Based Optical Flowcited by 92
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
- 2021Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Predictioncited by 88
- 2024Recent Event Camera Innovations: A Surveycited by 67
- 2022Learning Dense and Continuous Optical Flow from an Event Cameracited by 59
- 2022Event-based Video Reconstruction via Potential-assisted Spiking Neural Networkcited by 58
- 2021Spatio-Temporal Recurrent Networks for Event-Based Optical Flow Estimationcited by 50
- 2023Event Camera Data Pre-trainingcited by 49
12 most cited of 241 All 241 (JSON)
- 2026SFE-VGGT: Source-Free VGGT Distillation for Event-Based Monocular Depth Estimation29 Sep 2026
- 2026DAPEVO: Deep Adaptive Patch Frame-Event Visual Odometry25 Sep 2026
- 2026Can Spiking Neural Networks play pinball? A neuromorphic motion detector for target tracking21 Sep 2026
- 2026Multi-viewpoint Geo-localization with Event Cameras18 Sep 2026
- 2026An Event Preserving Velocity Invariant Representation for Event Cameras17 Sep 2026
- 2026Hyper-RED: Scalable Event Pre-training via Semantic Hypergraph Distillation15 Sep 2026
- 2026Lossy Event Compression: From Event Stream Distortion to Task Performance28 Aug 2026
- 2026LiteEvent-AE: Lightweight Autoencoder for Event-Based Vision on Low-Latency Energy-Constrained Edge Devices22 Aug 2026
- 2026E-S2Feat:Semantic-Guided Spiking Local Feature Detection and Description for Event Cameras14 Aug 2026
- 2026ERF-GS: Reconstructing Fast Motion from Disjoint Event-RGB Viewpoints9 Aug 2026
- 2026Cooking beyond Frames: A Stereo Event Camera Dataset in the Kitchen5 Aug 2026
- 2026Optical Flow Sensor: A Direction-Selective Bionic Retina Design30 Jul 2026
12 newest of 241 All 241 (JSON)