mlsanityData to 14 Oct 2026

X-Driver: Explainable Autonomous Driving with Vision-Language Models

arXiv 2505.05098 ↗First posted 8 May 2025cs.RO cs.CL cs.CVcited by 9

On the map: Multimodal LLMs / vision-language models → Driving VLMs and open-vocabulary detection

also in 1 more
Abstract (arXiv)

End-to-end autonomous driving has advanced significantly, offering benefits such as system simplicity and stronger driving performance in both open-loop and closed-loop settings than conventional pipelines. However, existing frameworks still suffer from low success rates in closed-loop evaluations, highlighting their limitations in real-world deployment. In this paper, we introduce X-Driver, a unified multi-modal large language models(MLLMs) framework designed for closed-loop autonomous driving, leveraging Chain-of-Thought(CoT) and autoregressive modeling to enhance perception and decision-making. We validate X-Driver across multiple autonomous driving tasks using public benchmarks in CARLA simulation environment, including Bench2Drive[6]. Our experimental results demonstrate superior closed-loop performance, surpassing the current state-of-the-art(SOTA) while improving the interpretability of driving decisions. These findings underscore the importance of structured reasoning in end-to-end driving and establish X-Driver as a strong baseline for future research in closed-loop autonomous driving.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Driving VLMs and open-vocabulary detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 17 of its 18 references that are in the map. First posted on arXiv 8 May 2025.

Builds on

17 of 18 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024PKRD-CoT: A Unified Chain-of-thought Prompting for Multi-Modal Large Language Models in Autonomous Driving2 Dec
  2. 2024GPT-4V as Traffic Assistant: An In-depth Look at Vision Language Model on Complex Traffic Events3 Feb
  3. 2023A Survey on Multimodal Large Language Models for Autonomous Driving21 Nov

Other references · 14

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2017Neural Discrete Representation Learningcited by 4,712
  5. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  6. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  7. 2022Planning-oriented Autonomous Drivingcited by 1,087
  8. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  9. 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 305
  10. 2023ChatGPT for Robotics: Design Principles and Model Abilitiescited by 299
  11. 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Drivingcited by 252
  12. 2024DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Drivingcited by 67
2 more
  1. 2025CoT-Drive: Efficient Motion Forecasting for Autonomous Driving with LLMs and Chain-of-Thought Promptingcited by 26
  2. 2025Sce2DriveX: A Generalized MLLM Framework for Scene-to-Drive Learningcited by 25

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 6.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Bench2ADVLM: A Closed-Loop Benchmark for Vision-language Models in Autonomous Driving
  2. 2025DriveRX: A Vision-Language Reasoning Model for Cross-Task Autonomous Driving
  3. 2023Reason2Drive: Towards Interpretable and Chain-based Reasoning for Autonomous Driving
  4. 2025LightEMMA: A Longitudinal Evaluation of Vision-Language Models for Autonomous Driving
  5. 2025LMAD: Integrated End-to-End Vision-Language Model for Explainable Autonomous Driving
  6. 2025ReasonPlan: Unified Scene Prediction and Decision Reasoning for Closed-loop Autonomous Driving
  7. 2026Language2Drive: Do Vision-Language-Action Models Really Follow the Instructions in Autonomous Driving?
  8. 2025CoT4AD: A Vision-Language-Action Model with Explicit Chain-of-Thought Reasoning for Autonomous Driving