Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learning
On the map: LLM reasoning → Chain-of-thought reasoning for driving
also in 2 more
Abstract (arXiv)
Large vision-language models (VLMs) for autonomous driving (AD) are evolving beyond perception and cognition tasks toward motion planning. However, we identify two critical challenges in this direction: (1) VLMs tend to learn shortcuts by relying heavily on history input information, achieving seemingly strong planning results without genuinely understanding the visual inputs; and (2) the chain-ofthought (COT) reasoning processes are always misaligned with the motion planning outcomes, and how to effectively leverage the complex reasoning capability to enhance planning remains largely underexplored. In this paper, we start from a small-scale domain-specific VLM and propose Drive-R1 designed to bridges the scenario reasoning and motion planning for AD. Drive-R1 first undergoes the supervised finetuning on a elaborate dataset containing both long and short COT data. Drive-R1 is encouraged to reason step-by-step from visual input to final planning decisions. Subsequently, Drive-R1 is trained within a reinforcement learning framework that incentivizes the discovery of reasoning paths that are more informative for planning, guided by rewards based on predicted trajectories and meta actions. Experimental evaluations on the nuScenes and DriveLM-nuScenes benchmarks demonstrate that Drive-R1 achieves superior performance compared to existing state-of-the-art VLMs. We believe that Drive-R1 presents a promising direction for bridging reasoning and planning in AD, offering methodological insights for future research and applications.
Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 19 of its 47 references that are in the map. First posted on arXiv 23 Jun 2025.
Builds on
19 of 47 references.
Closest ancestors · 2
Same direction, newest first
- 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoning10 Mar
- 2024OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoning2 May
Other references · 17
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
- 2023GPT-Driver: Learning to Drive with GPTcited by 347
- 2025Demystifying Long Chain-of-Thought Reasoning in LLMscited by 326
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimizationcited by 239
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 231
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 198
- 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Modelscited by 144
5 more
- 2025Small Models Struggle to Learn from Strong Reasonerscited by 113
- 2018Baidu Apollo EM Motion Plannercited by 100
- 2025Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Modelscited by 99
- 2024Can LVLMs Obtain a Driver's License? A Benchmark Towards Reliable AGI for Autonomous Drivingcited by 22
- 2025Fine-Grained Evaluation of Large Vision-Language Models in Autonomous Drivingcited by 19
Built on by
Citing papers per year: 2025: 12; 2026: 26.
38 papers.
Sort:
By area:
- 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 180
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 146
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 33
- 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Drivingcited by 28
- 2025A Survey on Agentic Multimodal Large Language Modelscited by 23
- 2026Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failurescited by 19
- 2025Advancing Multi-agent Traffic Simulation via R1-Style Reinforcement Fine-Tuningcited by 14
- 2025EvaDrive: Evolutionary Adversarial Policy Optimization for End-to-End Autonomous Drivingcited by 12
- 2026DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Drivingcited by 11
- 2026Bench2Drive-VL: Benchmarks for Closed-Loop Autonomous Driving with Vision-Language Modelscited by 10
- 2025Reinforcement Learning for Large Model: A Surveycited by 9
- 2026AutoMoT: A Unified Vision-Language-Action Model with Asynchronous Mixture-of-Transformers for End-to-End Autonomous Drivingcited by 9
26 more
- 2025TakeAD: Preference-based Post-optimization for End-to-end Autonomous Driving with Expert Takeover Datacited by 8
- 2025TuneAgent: Agentic Operating System Kernel Tuning with Reinforcement Learningcited by 5
- 2026SAMoE-VLA: A Scene Adaptive Mixture-of-Experts Vision-Language-Action Model for Autonomous Drivingcited by 4
- 2026Fine-tuning is Not Enough: A Parallel Framework for Collaborative Imitation and Reinforcement Learning in End-to-end Autonomous Drivingcited by 4
- 2025More Than Meets the Eye? Uncovering the Reasoning-Planning Disconnect in Training Vision-Language Driving Modelscited by 3
- 2026ADV-0: Closed-Loop Min-Max Adversarial Training for Long-Tail Robustness in Autonomous Drivingcited by 3
- 2026Distill to Think, Foresee to Act: Cognitive-Physical Reinforcement Learning for Autonomous Drivingcited by 3
- 2025VLM-UDMC: VLM-Enhanced Unified Decision-Making and Motion Control for Urban Autonomous Drivingcited by 2
- 2026Constrained Group Relative Policy Optimizationcited by 2
- 2026DynFlowDrive: Flow-Based Dynamic World Modeling for Autonomous Drivingcited by 2
- 2026S-GRPO: Unified Post-Training for Large Vision-Language Modelscited by 2
- 2026Post-Training in End-to-End Autonomous Drivingcited by 2
- 2026Reinforced Curriculum Pre-Alignment for Domain-Adaptive VLMscited by 1
- 2026Sim2Real-AD: A Modular Sim-to-Real Framework for Deploying VLM-Guided Reinforcement Learning in Real-World Autonomous Drivingcited by 1
- 2026Driving Intents Amplify Planning-Oriented Reinforcement Learningcited by 1
- 2026VLADriveBench: Evaluating CoT-Action Relationship in VLA for Autonomous Drivingcited by 1
- 2026Neuro-Symbolic Drive: Rule-Grounded Faithful Reasoning for Driving VLAscited by 1
- 2026Do Vision-Language-Action Models Mean What They Say? On the Role of Faithfulness in Embodied Reasoningcited by 1
- 2025From Human Intention to Action Prediction: Intention-Driven End-to-End Autonomous Drivingcited by 0
- 2026VECTOR-Drive: Tightly Coupled Vision-Language and Trajectory Expert Routing for End-to-End Autonomous Drivingcited by 0
- 2026Does Visual Information Play a Decisive Role in Vision-Language-Action Model Driving Behavior?cited by 0
- 2026Latent-Centroid Steering: Single-Pass Classifier-Free Guidance for Command-Aligned Autonomous Drivingcited by 0
- 2026FactorDrive: Adaptive Multi-Step Reasoning Driven by Planning-Critical Factors for End-to-End Autonomous Drivingcited by 0
- 2026CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Predictioncited by 0
- 2026Model-based Bootstrap for Offline Policy Evaluation in Tabular Reinforcement Learningcited by 0
- 2026CoVLM-Bench: A Real-World Benchmark for Cooperative Driving Question Answering and Planningcited by 0
- 2026CoVLM-Bench: A Real-World Benchmark for Cooperative Driving Question Answering and Planning22 Sep 2026
- 2026Model-based Bootstrap for Offline Policy Evaluation in Tabular Reinforcement Learning17 Sep 2026
- 2026CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Prediction31 Aug 2026
- 2026FactorDrive: Adaptive Multi-Step Reasoning Driven by Planning-Critical Factors for End-to-End Autonomous Driving10 Aug 2026
- 2026Latent-Centroid Steering: Single-Pass Classifier-Free Guidance for Command-Aligned Autonomous Driving31 Jul 2026
- 2026Post-Training in End-to-End Autonomous Driving9 Jul 2026
- 2026Do Vision-Language-Action Models Mean What They Say? On the Role of Faithfulness in Embodied Reasoning6 Jul 2026
- 2026Neuro-Symbolic Drive: Rule-Grounded Faithful Reasoning for Driving VLAs22 Jun 2026
- 2026VLADriveBench: Evaluating CoT-Action Relationship in VLA for Autonomous Driving10 Jun 2026
- 2026Does Visual Information Play a Decisive Role in Vision-Language-Action Model Driving Behavior?29 May 2026
- 2026Distill to Think, Foresee to Act: Cognitive-Physical Reinforcement Learning for Autonomous Driving20 May 2026
- 2026Driving Intents Amplify Planning-Oriented Reinforcement Learning12 May 2026
26 more
- 2026VECTOR-Drive: Tightly Coupled Vision-Language and Trajectory Expert Routing for End-to-End Autonomous Driving9 May 2026
- 2026S-GRPO: Unified Post-Training for Large Vision-Language Models17 Apr 2026
- 2026Sim2Real-AD: A Modular Sim-to-Real Framework for Deploying VLM-Guided Reinforcement Learning in Real-World Autonomous Driving3 Apr 2026
- 2026Bench2Drive-VL: Benchmarks for Closed-Loop Autonomous Driving with Vision-Language Models1 Apr 2026
- 2026DynFlowDrive: Flow-Based Dynamic World Modeling for Autonomous Driving20 Mar 2026
- 2026ADV-0: Closed-Loop Min-Max Adversarial Training for Long-Tail Robustness in Autonomous Driving16 Mar 2026
- 2026AutoMoT: A Unified Vision-Language-Action Model with Asynchronous Mixture-of-Transformers for End-to-End Autonomous Driving16 Mar 2026
- 2026Fine-tuning is Not Enough: A Parallel Framework for Collaborative Imitation and Reinforcement Learning in End-to-end Autonomous Driving14 Mar 2026
- 2026DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Driving11 Mar 2026
- 2026SAMoE-VLA: A Scene Adaptive Mixture-of-Experts Vision-Language-Action Model for Autonomous Driving9 Mar 2026
- 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Driving2 Mar 2026
- 2026Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failures1 Mar 2026
- 2026Reinforced Curriculum Pre-Alignment for Domain-Adaptive VLMs11 Feb 2026
- 2026Constrained Group Relative Policy Optimization5 Feb 2026
- 2025TakeAD: Preference-based Post-optimization for End-to-end Autonomous Driving with Expert Takeover Data19 Dec 2025
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future18 Dec 2025
- 2025From Human Intention to Action Prediction: Intention-Driven End-to-End Autonomous Driving13 Dec 2025
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail30 Oct 2025
- 2025A Survey on Agentic Multimodal Large Language Models13 Oct 2025
- 2025More Than Meets the Eye? Uncovering the Reasoning-Planning Disconnect in Training Vision-Language Driving Models6 Oct 2025
- 2025Advancing Multi-agent Traffic Simulation via R1-Style Reinforcement Fine-Tuning28 Sep 2025
- 2025A Survey of Reinforcement Learning for Large Reasoning Models10 Sep 2025
- 2025TuneAgent: Agentic Operating System Kernel Tuning with Reinforcement Learning18 Aug 2025
- 2025Reinforcement Learning for Large Model: A Survey11 Aug 2025
- 2025EvaDrive: Evolutionary Adversarial Policy Optimization for End-to-End Autonomous Driving5 Aug 2025
- 2025VLM-UDMC: VLM-Enhanced Unified Decision-Making and Motion Control for Urban Autonomous Driving21 Jul 2025
- 2025EvaDrive: Evolutionary Adversarial Policy Optimization for End-to-End Autonomous Drivingcited by 12
- 2025TakeAD: Preference-based Post-optimization for End-to-end Autonomous Driving with Expert Takeover Datacited by 8
- 2026Fine-tuning is Not Enough: A Parallel Framework for Collaborative Imitation and Reinforcement Learning in End-to-end Autonomous Drivingcited by 4
- 2026ADV-0: Closed-Loop Min-Max Adversarial Training for Long-Tail Robustness in Autonomous Drivingcited by 3
- 2026Distill to Think, Foresee to Act: Cognitive-Physical Reinforcement Learning for Autonomous Drivingcited by 3
- 2025VLM-UDMC: VLM-Enhanced Unified Decision-Making and Motion Control for Urban Autonomous Drivingcited by 2
- 2026Post-Training in End-to-End Autonomous Drivingcited by 2
- 2026Sim2Real-AD: A Modular Sim-to-Real Framework for Deploying VLM-Guided Reinforcement Learning in Real-World Autonomous Drivingcited by 1
- 2026Driving Intents Amplify Planning-Oriented Reinforcement Learningcited by 1
- 2025From Human Intention to Action Prediction: Intention-Driven End-to-End Autonomous Drivingcited by 0
- 2026CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Predictioncited by 0
- 2026CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Prediction31 Aug 2026
- 2026Post-Training in End-to-End Autonomous Driving9 Jul 2026
- 2026Distill to Think, Foresee to Act: Cognitive-Physical Reinforcement Learning for Autonomous Driving20 May 2026
- 2026Driving Intents Amplify Planning-Oriented Reinforcement Learning12 May 2026
- 2026Sim2Real-AD: A Modular Sim-to-Real Framework for Deploying VLM-Guided Reinforcement Learning in Real-World Autonomous Driving3 Apr 2026
- 2026ADV-0: Closed-Loop Min-Max Adversarial Training for Long-Tail Robustness in Autonomous Driving16 Mar 2026
- 2026Fine-tuning is Not Enough: A Parallel Framework for Collaborative Imitation and Reinforcement Learning in End-to-end Autonomous Driving14 Mar 2026
- 2025TakeAD: Preference-based Post-optimization for End-to-end Autonomous Driving with Expert Takeover Data19 Dec 2025
- 2025From Human Intention to Action Prediction: Intention-Driven End-to-End Autonomous Driving13 Dec 2025
- 2025EvaDrive: Evolutionary Adversarial Policy Optimization for End-to-End Autonomous Driving5 Aug 2025
- 2025VLM-UDMC: VLM-Enhanced Unified Decision-Making and Motion Control for Urban Autonomous Driving21 Jul 2025
- 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 180
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 146
- 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Drivingcited by 28
- 2026SAMoE-VLA: A Scene Adaptive Mixture-of-Experts Vision-Language-Action Model for Autonomous Drivingcited by 4
- 2025More Than Meets the Eye? Uncovering the Reasoning-Planning Disconnect in Training Vision-Language Driving Modelscited by 3
- 2026Constrained Group Relative Policy Optimizationcited by 2
- 2026S-GRPO: Unified Post-Training for Large Vision-Language Modelscited by 2
- 2026VLADriveBench: Evaluating CoT-Action Relationship in VLA for Autonomous Drivingcited by 1
- 2026Neuro-Symbolic Drive: Rule-Grounded Faithful Reasoning for Driving VLAscited by 1
- 2026Do Vision-Language-Action Models Mean What They Say? On the Role of Faithfulness in Embodied Reasoningcited by 1
- 2026FactorDrive: Adaptive Multi-Step Reasoning Driven by Planning-Critical Factors for End-to-End Autonomous Drivingcited by 0
- 2026FactorDrive: Adaptive Multi-Step Reasoning Driven by Planning-Critical Factors for End-to-End Autonomous Driving10 Aug 2026
- 2026Do Vision-Language-Action Models Mean What They Say? On the Role of Faithfulness in Embodied Reasoning6 Jul 2026
- 2026Neuro-Symbolic Drive: Rule-Grounded Faithful Reasoning for Driving VLAs22 Jun 2026
- 2026VLADriveBench: Evaluating CoT-Action Relationship in VLA for Autonomous Driving10 Jun 2026
- 2026S-GRPO: Unified Post-Training for Large Vision-Language Models17 Apr 2026
- 2026SAMoE-VLA: A Scene Adaptive Mixture-of-Experts Vision-Language-Action Model for Autonomous Driving9 Mar 2026
- 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Driving2 Mar 2026
- 2026Constrained Group Relative Policy Optimization5 Feb 2026
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail30 Oct 2025
- 2025More Than Meets the Eye? Uncovering the Reasoning-Planning Disconnect in Training Vision-Language Driving Models6 Oct 2025
- 2025A Survey of Reinforcement Learning for Large Reasoning Models10 Sep 2025
- 2025A Survey on Agentic Multimodal Large Language Modelscited by 23
- 2026Bench2Drive-VL: Benchmarks for Closed-Loop Autonomous Driving with Vision-Language Modelscited by 10
- 2026AutoMoT: A Unified Vision-Language-Action Model with Asynchronous Mixture-of-Transformers for End-to-End Autonomous Drivingcited by 9
- 2026Reinforced Curriculum Pre-Alignment for Domain-Adaptive VLMscited by 1
- 2026Latent-Centroid Steering: Single-Pass Classifier-Free Guidance for Command-Aligned Autonomous Drivingcited by 0
- 2026CoVLM-Bench: A Real-World Benchmark for Cooperative Driving Question Answering and Planningcited by 0
- 2026CoVLM-Bench: A Real-World Benchmark for Cooperative Driving Question Answering and Planning22 Sep 2026
- 2026Latent-Centroid Steering: Single-Pass Classifier-Free Guidance for Command-Aligned Autonomous Driving31 Jul 2026
- 2026Bench2Drive-VL: Benchmarks for Closed-Loop Autonomous Driving with Vision-Language Models1 Apr 2026
- 2026AutoMoT: A Unified Vision-Language-Action Model with Asynchronous Mixture-of-Transformers for End-to-End Autonomous Driving16 Mar 2026
- 2026Reinforced Curriculum Pre-Alignment for Domain-Adaptive VLMs11 Feb 2026
- 2025A Survey on Agentic Multimodal Large Language Models13 Oct 2025
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 33
- 2026Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failurescited by 19
- 2026DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Drivingcited by 11
- 2026VECTOR-Drive: Tightly Coupled Vision-Language and Trajectory Expert Routing for End-to-End Autonomous Drivingcited by 0
- 2026Does Visual Information Play a Decisive Role in Vision-Language-Action Model Driving Behavior?cited by 0
- 2026Does Visual Information Play a Decisive Role in Vision-Language-Action Model Driving Behavior?29 May 2026
- 2026VECTOR-Drive: Tightly Coupled Vision-Language and Trajectory Expert Routing for End-to-End Autonomous Driving9 May 2026
- 2026DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Driving11 Mar 2026
- 2026Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failures1 Mar 2026
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future18 Dec 2025
- 2025Reinforcement Learning for Large Model: A Surveycited by 9
- 2025Reinforcement Learning for Large Model: A Survey11 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2026AutoDrive-P3: Unified Chain of Perception-Prediction-Planning Thought via Reinforcement Fine-Tuning
- 2026NaviDriveVLM: Decoupling High-Level Reasoning and Motion Planning for Autonomous Driving
- 2025DriveAgent-R1: Advancing VLM-based Autonomous Driving with Active Perception and Hybrid Thinking
- 2025LaViPlan : Language-Guided Visual Path Planning with RLVR
- 2025VLMPlanner: Integrating Visual Language Models with Motion Planning
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning
- 2026Found-RL: foundation model-enhanced reinforcement learning for autonomous driving
- 2026DriveMA: Rethinking Language Interfaces in Driving VLAs with One-Step Meta-Actions