mlsanityData to 14 Oct 2026

EventDrive: Event Cameras for Vision-Language Driving Intelligence

arXiv 2606.18242 ↗First posted 16 Jun 2026cs.CVcited by 2

On the map: End-to-end autonomous driving → VLMs for autonomous driving

Abstract (arXiv)

Event cameras sense the world through asynchronous brightness changes with microsecond latency and high dynamic range, offering motion fidelity far beyond frame-based sensors and capturing temporal structure that conventional exposures often miss. These properties make events a powerful complement to RGB in autonomous driving, especially under blur, glare, and rapid motion, where frame-based perception can become unreliable. However, existing event-aware vision-language models remain limited to generic perception and do not reveal how event sensing contributes to reasoning and decision-making across the full driving loop. We present EventDrive, a large-scale benchmark and model suite that unifies event streams, RGB frames, and language supervision across four core dimensions: Perception, Understanding, Prediction, and Planning, covering captions, structured QA, grounding, motion-state recognition, trajectory forecasting, and planning tasks. Building on this foundation, EventDrive-VLM introduces a multi-horizon event pyramid and a temporal-horizon mixture-of-experts module to adaptively encode and fuse asynchronous and frame-based information for downstream reasoning. Comprehensive evaluation across diverse tasks shows that event streams provide substantial gains in temporal precision, motion awareness, and robustness, bringing event sensing into the center of driving intelligence.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in VLMs for autonomous driving, one of 9 directions in End-to-end autonomous driving. Builds on 59 of its 76 references that are in the map. First posted on arXiv 16 Jun 2026.

Builds on

59 of 76 references.

References · 59

  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024Qwen2.5 Technical Reportcited by 4,942
  5. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  6. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  7. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  8. 2023Mistral 7Bcited by 3,164
  9. 2025Qwen3-VL Technical Reportcited by 2,793
  10. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  11. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  12. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
38 more
  1. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  2. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  3. 2022Planning-oriented Autonomous Drivingcited by 1,087
  4. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
  5. 2019Event-based Vision: A Surveycited by 1,016
  6. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
  7. 2024InternLM2 Technical Reportcited by 397
  8. 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 303
  9. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
  10. 2018EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Camerascited by 224
  11. 2019End-to-End Learning of Representations for Asynchronous Event-Based Datacited by 217
  12. 2020Learning to Detect Objects with a 1 Megapixel Event Cameracited by 186
  13. 2023CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIPcited by 181
  14. 2022Recurrent Vision Transformers for Object Detection with Event Camerascited by 159
  15. 2018Asynchronous, Photometric Feature Tracking using Events and Framescited by 118
  16. 2022AEGNN: Asynchronous Event-based Graph Neural Networkscited by 118
  17. 2021Event-Based Fusion for Motion Deblurring with Cross-modal Attentioncited by 113
  18. 2020Event-based Asynchronous Sparse Convolutional Networkscited by 104
  19. 2024Mini-InternVL: A Flexible-Transfer Pocket Multimodal Model with 5% Parameters and 90% Performancecited by 94
  20. 2021N-ImageNet: Towards Robust, Fine-Grained Object Recognition with Event Camerascited by 92
  21. 2021Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Predictioncited by 90
  22. 2022ESS: Learning Event-based Semantic Segmentation from Still Imagescited by 82
  23. 2022Object Detection with Spiking Neural Networks on Automotive Event Datacited by 80
  24. 2024Recent Event Camera Innovations: A Surveycited by 68
  25. 2024SeeGround: See and Ground for Zero-Shot Open-Vocabulary 3D Visual Groundingcited by 67
  26. 2025Impromptu VLA: Open Weights and Open Data for Driving Vision-Language-Action Modelscited by 60
  27. 2024Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous Drivingcited by 54
  28. 2023Hierarchical Neural Memory Network for Low Latency Event Processingcited by 47
  29. 2022RGB-Event Fusion for Moving Object Detection in Autonomous Drivingcited by 40
  30. 2023SODFormer: Streaming Object Detection with Transformer Using Events and Framescited by 39
  31. 2024Scene Adaptive Sparse Transformer for Event-based Object Detectioncited by 39
  32. 2024OpenESS: Event-based Semantic Scene Understanding with Open Vocabulariescited by 38
  33. 2023EventCLIP: Adapting CLIP for Event-based Object Recognitioncited by 36
  34. 2023Optical flow estimation from event-based cameras and spiking neural networkscited by 33
  35. 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 33
  36. 2022Pushing the Limits of Asynchronous Graph-based Object Detection with Event Camerascited by 32
  37. 2023Label-Free Event-based Object Recognition via Joint Learning with Image Reconstruction from Eventscited by 28
  38. 2024Embracing Events and Frames with Hierarchical Feature Refinement Network for Object Detectioncited by 28

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026FlashDrive: Flash Vision-Language-Action Inference for Autonomous Driving
  2. 2026DRIVESPATIAL: A Benchmark for Spatiotemporal Intelligence in VLMs for Autonomous Driving
  3. 2026UniDrive: A Unified Vision-Language and Grounding Framework for Interpretable Risk Understanding in Autonomous Driving
  4. 2026Probing Visual Concepts in Lightweight Vision-Language Models for Automated Driving
  5. 2026SUV: Future Scene Understanding as Video Generation for End-to-End Driving
  6. 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Driving
  7. 2025World Model-Based End-to-End Scene Generation for Accident Anticipation in Autonomous Driving
  8. 2025From Segments to Scenes: Temporal Understanding for Agentic Autonomous Driving via Vision-Language Models