CMU-Drive and V2V-VLA: Cooperative Multi-agent Unified Driving with Reasoning Benchmark and Vehicle-to-Vehicle Vision-Language-Action Models
On the map: Vision-language-action models → VLA for autonomous driving
also in 1 more
Abstract (arXiv)
Vision-Language-Action (VLA) models have recently achieved impressive performance for end-to-end autonomous driving, yet existing approaches are primarily designed for an individual single autonomous driving agent with limited support for cooperative perception, reasoning, and planning. We present Cooperative Multi-agent Unified Driving with Reasoning (CMU-Drive), a closed-loop end-to-end benchmark for evaluating cooperative autonomous driving with multiple connected autonomous vehicles (CAVs) operating in safety-critical driving scenarios with background traffic participants. We further propose Vehicle-to-Vehicle Vision-Language-Action (V2V-VLA), a cooperative VLA model that integrates cooperative driving into a single forward pass by jointly generating driving actions, future waypoints, language reasoning, and communication policies. Experiments on CMU-Drive establish the first benchmark and baseline for cooperative VLA driving and provide a foundation for future research on multi-agent, closed-loop, end-to-end cooperative autonomous driving. Our code, benchmark, and model checkpoint will be publicly released to facilitate open-source research.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 27 of its 31 references that are in the map. First posted on arXiv 7 Aug 2026.
Builds on
27 of 31 references.
Closest ancestors · 3
Same direction, newest first
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future18 Dec
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail30 Oct
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning16 Jun
Other references · 24
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Drivingcited by 250
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
- 2023V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perceptioncited by 155
- 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 149
- 2024OpenEMMA: Open-Source Multimodal Model for End-to-End Autonomous Drivingcited by 93
- 2024TUMTraf V2X Cooperative Perception Datasetcited by 66
12 more
- 2024V2XPnP: Vehicle-to-Everything Spatio-Temporal Fusion for Multi-Agent Perception and Predictioncited by 31
- 2025SpaceDrive: Infusing Spatial Awareness into VLM-based Autonomous Drivingcited by 28
- 2025V2V-LLM: Vehicle-to-Vehicle Cooperative Autonomous Driving with Multimodal Large Language Modelscited by 27
- 2024Towards Collaborative Autonomous Driving: Simulation Platform and End-to-End Systemcited by 20
- 2025CoLMDriver: LLM-based Negotiation Benefits Cooperative Autonomous Drivingcited by 13
- 2024CooPre: Cooperative Pretraining for V2X Cooperative Perceptioncited by 11
- 2025QuantV2X: A Fully Quantized Multi-Agent System for Cooperative Perceptioncited by 11
- 2024Cocoon: Robust Multi-Modal Perception with Uncertainty-Aware Sensor Fusioncited by 9
- 2025TurboTrain: Towards Efficient and Balanced Multi-Task Learning for Multi-Agent Perception and Predictioncited by 9
- 2025V2V-GoT: Vehicle-to-Vehicle Cooperative Autonomous Driving with Multimodal Large Language Models and Graph-of-Thoughtscited by 7
- 2025Mixed Signals: A Diverse Point Cloud Dataset for Heterogeneous LiDAR V2X Collaborationcited by 5
- 2026MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systemscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025A Survey on Vision-Language-Action Models for Autonomous Driving
- 2025Reasoning-VLA: A Fast and General Vision-Language-Action Reasoning Model for Autonomous Driving
- 2026Roadside-Cooperative Autonomous Driving: From Data Platform to Vision-Language End-to-End Reasoning
- 2026RT-VLA: Real-Time Vision-Language-Action Models via Knowledge Distillation
- 2024Towards Interactive and Learnable Cooperative Driving Automation: a Large Language Model-Driven Decision-Making Framework
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving
- 2026A Collaborative Multi-Modality Interaction for VLA-based End-to-End Autonomous Driving
- 2024V2X-VLM: End-to-End V2X Cooperative Autonomous Driving Through Large Vision-Language Models