dVLM-AD: Enhance Diffusion Vision-Language-Model for Driving via Controllable Reasoning
On the map: LLM reasoning → Chain-of-thought reasoning for driving
also in 2 more
Abstract (arXiv)
The autonomous driving community is increasingly focused on addressing the challenges posed by out-of-distribution (OOD) driving scenarios. A dominant research trend seeks to enhance end-to-end (E2E) driving systems by integrating vision-language models (VLMs), leveraging their rich world knowledge and reasoning abilities to improve generalization across diverse environments. However, most existing VLMs or vision-language agents (VLAs) are built upon autoregressive (AR) models. In this paper, we observe that existing AR-based VLMs -- limited by causal attention and sequential token generation -- often fail to maintain consistency and controllability between high-level reasoning and low-level planning. In contrast, recent discrete diffusion VLMs equipped with bidirectional attention exhibit superior controllability and reliability through iterative denoising. Building on these observations, we introduce dVLM-AD, a diffusion-based vision-language model that unifies perception, structured reasoning, and low-level planning for end-to-end driving. Evaluated on nuScenes and WOD-E2E, dVLM-AD yields more consistent reasoning-action pairs and achieves planning performance comparable to existing driving VLM/VLA systems despite a modest backbone, outperforming AR-based baselines with a 9 percent improvement in behavior-trajectory consistency and a 6 percent increase in RFS on long-tail WOD-E2E scenarios. These results suggest a controllable and reliable pathway for scalable end-to-end driving.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 53 of its 76 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
53 of 76 references.
Closest ancestors · 5
Same direction, newest first
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail30 Oct
- 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Driving17 Sep
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning16 Jun
- 2024VLM-AD: End-to-End Autonomous Driving through Vision-Language Model Supervision19 Dec
- 2024DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Driving25 Mar
Other references · 48
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
36 more
- 2025Large Language Diffusion Modelscited by 872
- 2025Dream 7B: Diffusion Large Language Modelscited by 515
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 273
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 241
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
- 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 145
- 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 119
- 2025Dimple: Discrete Diffusion Multimodal Large Language Model with Parallel Decodingcited by 101
- 2025H-CoT: Hijacking the Chain-of-Thought Safety Reasoning Mechanism to Jailbreak Large Reasoning Models, Including OpenAI o1/o3, DeepSeek-R1, and Gemini 2.0 Flash Thinkingcited by 94
- 2024OpenEMMA: Open-Source Multimodal Model for End-to-End Autonomous Drivingcited by 93
- 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policiescited by 90
- 2025Revolutionizing Reinforcement Learning Framework for Diffusion Large Language Modelscited by 80
- 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsificationcited by 70
- 2025Diffusion Language Models Know the Answer Before Decodingcited by 68
- 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Drivingcited by 64
- 2025Impromptu VLA: Open Weights and Open Data for Driving Vision-Language-Action Modelscited by 60
- 2025WOD-E2E: Waymo Open Dataset for End-to-End Driving in Challenging Long-tail Scenarioscited by 60
- 2024Tokenize the World into Object-level Knowledge to Address Long-tail Events in Autonomous Drivingcited by 55
- 2025ChatVLA-2: Vision-Language-Action Model with Open-World Embodied Reasoning from Pretrained Knowledgecited by 49
- 2025DriveLMM-o1: A Step-by-Step Reasoning Dataset and Large Multimodal Model for Driving Scenario Understandingcited by 35
- 2025Beyond Fixed: Training-Free Variable-Length Denoising for Diffusion Large Language Modelscited by 32
- 2025AutoDrive-R2: Incentivizing Reasoning and Self-Reflection Capacity for VLA Model in Autonomous Drivingcited by 32
- 2025IRL-VLA: Training an Vision-Language-Action Policy via Reward World Modelcited by 31
- 2025LLaDA-VLA: Vision Language Diffusion Action Modelscited by 30
- 2025dVLA: Diffusion Vision-Language-Action Model with Multimodal Chain-of-Thoughtcited by 30
- 2025LoHoVLA: A Unified Vision-Language-Action Model for Long-Horizon Embodied Taskscited by 25
- 2025Discrete Diffusion for Reflective Vision-Language-Action Models in Autonomous Drivingcited by 24
- 2025DriveAction: A Benchmark for Exploring Human-like Driving Decisions in VLA Modelscited by 17
- 2025Unveiling the Potential of Diffusion Large Language Model in Controllable Generationcited by 14
- 2025Poutine: Vision-Language-Trajectory Pre-Training and Reinforcement Learning Post-Training Enable Robust End-to-End Autonomous Drivingcited by 11
- 2025LightEMMA: A Longitudinal Evaluation of Vision-Language Models for Autonomous Drivingcited by 6
- 2025Path Drift in Large Reasoning Models:How First-Person Commitments Override Safetycited by 5
Built on by
Citing papers per year: 2025: 2; 2026: 12.
14 papers.
Sort:
By area:
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 32
- 2025Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbonecited by 18
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Drivingcited by 17
- 2026Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Drivingcited by 8
- 2026MindVLA-U1: VLA Beats VA with Unified Streaming Architecture for Autonomous Drivingcited by 6
- 2026Fast-dDrive: Efficient Block-Diffusion VLM for Autonomous Drivingcited by 5
- 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Drivingcited by 5
- 2026Discrete-WAM: Unified Discrete Vision-Action Token Editing for World-Policy Learningcited by 3
- 2026LAD-Drive: Bridging Language and Trajectory with Action-Aware Diffusion Transformerscited by 2
- 2026Probing Visual Concepts in Lightweight Vision-Language Models for Automated Drivingcited by 2
- 2026Planning-aligned Token Compression for Long-Context Autonomous Drivingcited by 2
- 2026NTR: Neural Token Reconstruction for Scene Token Bottleneck in End-to-End Drivingcited by 1
2 more
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving31 Aug 2026
- 2026Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Driving31 Aug 2026
- 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Driving7 Aug 2026
- 2026Planning-aligned Token Compression for Long-Context Autonomous Driving5 Jun 2026
- 2026Discrete-WAM: Unified Discrete Vision-Action Token Editing for World-Policy Learning4 Jun 2026
- 2026NTR: Neural Token Reconstruction for Scene Token Bottleneck in End-to-End Driving29 May 2026
- 2026Fast-dDrive: Efficient Block-Diffusion VLM for Autonomous Driving22 May 2026
- 2026MindVLA-U1: VLA Beats VA with Unified Streaming Architecture for Autonomous Driving12 May 2026
- 2026Action Emergence from Streaming Intent12 May 2026
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving2 Apr 2026
- 2026Probing Visual Concepts in Lightweight Vision-Language Models for Automated Driving6 Mar 2026
- 2026LAD-Drive: Bridging Language and Trajectory with Action-Aware Diffusion Transformers2 Mar 2026
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 32
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Drivingcited by 17
- 2026MindVLA-U1: VLA Beats VA with Unified Streaming Architecture for Autonomous Drivingcited by 6
- 2026Fast-dDrive: Efficient Block-Diffusion VLM for Autonomous Drivingcited by 5
- 2026Fast-dDrive: Efficient Block-Diffusion VLM for Autonomous Driving22 May 2026
- 2026MindVLA-U1: VLA Beats VA with Unified Streaming Architecture for Autonomous Driving12 May 2026
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving2 Apr 2026
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future18 Dec 2025
- 2025Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbonecited by 18
- 2026Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Drivingcited by 8
- 2026Probing Visual Concepts in Lightweight Vision-Language Models for Automated Drivingcited by 2
- 2026Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Driving31 Aug 2026
- 2026Probing Visual Concepts in Lightweight Vision-Language Models for Automated Driving6 Mar 2026
- 2025Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbone27 Dec 2025
- 2026Action Emergence from Streaming Intentcited by 0
- 2026Action Emergence from Streaming Intent12 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025ViLaD: A Large Vision Language Diffusion Framework for End-to-End Autonomous Driving
- 2023Vision Language Models in Autonomous Driving: A Survey and Outlook
- 2025VLAD: A VLM-Augmented Autonomous Driving Framework with Hierarchical Planning and Interpretable Decision Process
- 2025VERDI: VLM-Embedded Reasoning for Autonomous Driving
- 2026NaviDriveVLM: Decoupling High-Level Reasoning and Motion Planning for Autonomous Driving
- 2025VLMPlanner: Integrating Visual Language Models with Motion Planning
- 2025Bench2ADVLM: A Closed-Loop Benchmark for Vision-language Models in Autonomous Driving
- 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learning