X-Driver: Explainable Autonomous Driving with Vision-Language Models
On the map: Multimodal LLMs / vision-language models → Driving VLMs and open-vocabulary detection
also in 1 more
Abstract (arXiv)
End-to-end autonomous driving has advanced significantly, offering benefits such as system simplicity and stronger driving performance in both open-loop and closed-loop settings than conventional pipelines. However, existing frameworks still suffer from low success rates in closed-loop evaluations, highlighting their limitations in real-world deployment. In this paper, we introduce X-Driver, a unified multi-modal large language models(MLLMs) framework designed for closed-loop autonomous driving, leveraging Chain-of-Thought(CoT) and autoregressive modeling to enhance perception and decision-making. We validate X-Driver across multiple autonomous driving tasks using public benchmarks in CARLA simulation environment, including Bench2Drive[6]. Our experimental results demonstrate superior closed-loop performance, surpassing the current state-of-the-art(SOTA) while improving the interpretability of driving decisions. These findings underscore the importance of structured reasoning in end-to-end driving and establish X-Driver as a strong baseline for future research in closed-loop autonomous driving.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Driving VLMs and open-vocabulary detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 17 of its 18 references that are in the map. First posted on arXiv 8 May 2025.
Builds on
17 of 18 references.
Closest ancestors · 3
Same direction, newest first
- 2024PKRD-CoT: A Unified Chain-of-thought Prompting for Multi-Modal Large Language Models in Autonomous Driving2 Dec
- 2024GPT-4V as Traffic Assistant: An In-depth Look at Vision Language Model on Complex Traffic Events3 Feb
- 2023A Survey on Multimodal Large Language Models for Autonomous Driving21 Nov
Other references · 14
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2017Neural Discrete Representation Learningcited by 4,712
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 305
- 2023ChatGPT for Robotics: Design Principles and Model Abilitiescited by 299
- 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Drivingcited by 252
- 2024DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Drivingcited by 67
Built on by
Citing papers per year: 2025: 3; 2026: 6.
9 papers.
- 2025SpaceDrive: Infusing Spatial Awareness into VLM-based Autonomous Drivingcited by 28
- 2025Chain-of-Thought for Autonomous Driving: A Comprehensive Survey and Future Prospectscited by 12
- 2026Bench2Drive-VL: Benchmarks for Closed-Loop Autonomous Driving with Vision-Language Modelscited by 10
- 2025A Survey of Multi-sensor Fusion Perception for Embodied AI: Background, Methods, Challenges and Prospectscited by 5
- 2026SparseOccVLA: Bridging Occupancy and Vision-Language Models via Sparse Queries for Unified 4D Scene Understanding and Planningcited by 4
- 2026Distill to Think, Foresee to Act: Cognitive-Physical Reinforcement Learning for Autonomous Drivingcited by 3
- 2026An LLM-Explainable DRL Framework for Passenger-Directed Autonomous Drivingcited by 0
- 2026OmniSpace: Efficient Geometry Awareness for Autonomous Vehicles MLLMscited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Drivingcited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving31 Aug 2026
- 2026OmniSpace: Efficient Geometry Awareness for Autonomous Vehicles MLLMs21 Jun 2026
- 2026An LLM-Explainable DRL Framework for Passenger-Directed Autonomous Driving2 Jun 2026
- 2026Distill to Think, Foresee to Act: Cognitive-Physical Reinforcement Learning for Autonomous Driving20 May 2026
- 2026Bench2Drive-VL: Benchmarks for Closed-Loop Autonomous Driving with Vision-Language Models1 Apr 2026
- 2026SparseOccVLA: Bridging Occupancy and Vision-Language Models via Sparse Queries for Unified 4D Scene Understanding and Planning10 Jan 2026
- 2025SpaceDrive: Infusing Spatial Awareness into VLM-based Autonomous Driving11 Dec 2025
- 2025A Survey of Multi-sensor Fusion Perception for Embodied AI: Background, Methods, Challenges and Prospects24 Jun 2025
- 2025Chain-of-Thought for Autonomous Driving: A Comprehensive Survey and Future Prospects26 May 2025
Similar, not cited
Close in wording, no citation either way
- 2025Bench2ADVLM: A Closed-Loop Benchmark for Vision-language Models in Autonomous Driving
- 2025DriveRX: A Vision-Language Reasoning Model for Cross-Task Autonomous Driving
- 2023Reason2Drive: Towards Interpretable and Chain-based Reasoning for Autonomous Driving
- 2025LightEMMA: A Longitudinal Evaluation of Vision-Language Models for Autonomous Driving
- 2025LMAD: Integrated End-to-End Vision-Language Model for Explainable Autonomous Driving
- 2025ReasonPlan: Unified Scene Prediction and Decision Reasoning for Closed-loop Autonomous Driving
- 2026Language2Drive: Do Vision-Language-Action Models Really Follow the Instructions in Autonomous Driving?
- 2025CoT4AD: A Vision-Language-Action Model with Explicit Chain-of-Thought Reasoning for Autonomous Driving