EventDrive: Event Cameras for Vision-Language Driving Intelligence
On the map: End-to-end autonomous driving → VLMs for autonomous driving
Abstract (arXiv)
Event cameras sense the world through asynchronous brightness changes with microsecond latency and high dynamic range, offering motion fidelity far beyond frame-based sensors and capturing temporal structure that conventional exposures often miss. These properties make events a powerful complement to RGB in autonomous driving, especially under blur, glare, and rapid motion, where frame-based perception can become unreliable. However, existing event-aware vision-language models remain limited to generic perception and do not reveal how event sensing contributes to reasoning and decision-making across the full driving loop. We present EventDrive, a large-scale benchmark and model suite that unifies event streams, RGB frames, and language supervision across four core dimensions: Perception, Understanding, Prediction, and Planning, covering captions, structured QA, grounding, motion-state recognition, trajectory forecasting, and planning tasks. Building on this foundation, EventDrive-VLM introduces a multi-horizon event pyramid and a temporal-horizon mixture-of-experts module to adaptively encode and fuse asynchronous and frame-based information for downstream reasoning. Comprehensive evaluation across diverse tasks shows that event streams provide substantial gains in temporal precision, motion awareness, and robustness, bringing event sensing into the center of driving intelligence.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in VLMs for autonomous driving, one of 9 directions in End-to-end autonomous driving. Builds on 59 of its 76 references that are in the map. First posted on arXiv 16 Jun 2026.
Builds on
59 of 76 references.
References · 59
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2023Mistral 7Bcited by 3,164
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
38 more
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
- 2019Event-based Vision: A Surveycited by 1,016
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
- 2024InternLM2 Technical Reportcited by 397
- 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 303
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
- 2018EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Camerascited by 224
- 2019End-to-End Learning of Representations for Asynchronous Event-Based Datacited by 217
- 2020Learning to Detect Objects with a 1 Megapixel Event Cameracited by 186
- 2023CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIPcited by 181
- 2022Recurrent Vision Transformers for Object Detection with Event Camerascited by 159
- 2018Asynchronous, Photometric Feature Tracking using Events and Framescited by 118
- 2022AEGNN: Asynchronous Event-based Graph Neural Networkscited by 118
- 2021Event-Based Fusion for Motion Deblurring with Cross-modal Attentioncited by 113
- 2020Event-based Asynchronous Sparse Convolutional Networkscited by 104
- 2024Mini-InternVL: A Flexible-Transfer Pocket Multimodal Model with 5% Parameters and 90% Performancecited by 94
- 2021N-ImageNet: Towards Robust, Fine-Grained Object Recognition with Event Camerascited by 92
- 2021Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Predictioncited by 90
- 2022ESS: Learning Event-based Semantic Segmentation from Still Imagescited by 82
- 2022Object Detection with Spiking Neural Networks on Automotive Event Datacited by 80
- 2024Recent Event Camera Innovations: A Surveycited by 68
- 2024SeeGround: See and Ground for Zero-Shot Open-Vocabulary 3D Visual Groundingcited by 67
- 2025Impromptu VLA: Open Weights and Open Data for Driving Vision-Language-Action Modelscited by 60
- 2024Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous Drivingcited by 54
- 2023Hierarchical Neural Memory Network for Low Latency Event Processingcited by 47
- 2022RGB-Event Fusion for Moving Object Detection in Autonomous Drivingcited by 40
- 2023SODFormer: Streaming Object Detection with Transformer Using Events and Framescited by 39
- 2024Scene Adaptive Sparse Transformer for Event-based Object Detectioncited by 39
- 2024OpenESS: Event-based Semantic Scene Understanding with Open Vocabulariescited by 38
- 2023EventCLIP: Adapting CLIP for Event-based Object Recognitioncited by 36
- 2023Optical flow estimation from event-based cameras and spiking neural networkscited by 33
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 33
- 2022Pushing the Limits of Asynchronous Graph-based Object Detection with Event Camerascited by 32
- 2023Label-Free Event-based Object Recognition via Joint Learning with Image Reconstruction from Eventscited by 28
- 2024Embracing Events and Frames with Hierarchical Feature Refinement Network for Object Detectioncited by 28
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026FlashDrive: Flash Vision-Language-Action Inference for Autonomous Driving
- 2026DRIVESPATIAL: A Benchmark for Spatiotemporal Intelligence in VLMs for Autonomous Driving
- 2026UniDrive: A Unified Vision-Language and Grounding Framework for Interpretable Risk Understanding in Autonomous Driving
- 2026Probing Visual Concepts in Lightweight Vision-Language Models for Automated Driving
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Driving
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Driving
- 2025World Model-Based End-to-End Scene Generation for Accident Anticipation in Autonomous Driving
- 2025From Segments to Scenes: Temporal Understanding for Agentic Autonomous Driving via Vision-Language Models