Roadside-Cooperative Autonomous Driving: From Data Platform to Vision-Language End-to-End Reasoning
On the map: LLM reasoning → Chain-of-thought reasoning for driving
also in 1 more
Abstract (arXiv)
Vehicle-to-Everything (V2X) cooperation enables beyond-line-of-sight perception, mitigating occlusions in single-vehicle sensing. However, existing V2X benchmarks provide limited support for closed-loop evaluation and language-grounded supervision, hindering the development of vision-language models (VLMs) for end-to-end cooperative driving. To address these limitations, we introduce V2XBench, a simulation platform featuring synchronized ego--roadside sensing and closed-loop evaluation, together with Chat-V2XBench, a progressively structured VQA dataset for cooperative reasoning. Building upon this benchmark infrastructure, we propose AURORA, an end-to-end cooperative driving framework. Equipped with a dual-view perception architecture, AURORA mitigates spatial and semantic discrepancies across ego and roadside viewpoints through a query-level Cross-View Query Alignment and Fusion (CQAF) module. Leveraging the resulting unified tokens, a LoRA-adapted VLM bridges semantic reasoning and generative trajectory planning. Extensive closed-loop evaluations on V2XBench demonstrate that AURORA achieves state-of-the-art performance in heavily occluded scenarios, with a Route Completion rate of 98.21% and a Driving Score of 76.02, while requiring low roadside communication bandwidth. Ultimately, this work pioneers an extensible V2X--VLM paradigm, paving the way for next-generation cooperative autonomous driving.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 0 of its 30 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
0 of 30 references.
No references here yet.
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024V2X-VLM: End-to-End V2X Cooperative Autonomous Driving Through Large Vision-Language Models
- 2025V2V-GoT: Vehicle-to-Vehicle Cooperative Autonomous Driving with Multimodal Large Language Models and Graph-of-Thoughts
- 2025V2X-UniPool: Unifying Multimodal Perception and Knowledge Reasoning for Autonomous Driving
- 2026CMU-Drive and V2V-VLA: Cooperative Multi-agent Unified Driving with Reasoning Benchmark and Vehicle-to-Vehicle Vision-Language-Action Models
- 2025Research Challenges and Progress in the End-to-End V2X Cooperative Autonomous Driving Competition
- 2026DH-VLM: Dual-Horizon Cooperative Latent Reasoning for Autonomous Driving
- 2026V2X-QA: A Comprehensive Reasoning Dataset and Benchmark for Multimodal Large Language Models in Autonomous Driving Across Ego, Infrastructure, and Cooperative Views
- 2025SOLVE: Synergy of Language-Vision and End-to-End Networks for Autonomous Driving