AutoDrive-R2: Incentivizing Reasoning and Self-Reflection Capacity for VLA Model in Autonomous Driving
On the map: Vision-language-action models → VLA for autonomous driving
also in 1 more
Abstract (arXiv)
Vision-Language-Action (VLA) models in autonomous driving systems have recently demonstrated transformative potential by integrating multimodal perception with decision-making capabilities. However, the interpretability and coherence of the decision process and the plausibility of action sequences remain largely underexplored. To address these issues, we propose AutoDrive-R2, a novel VLA framework that enhances both reasoning and self-reflection capabilities of autonomous driving systems through chain-of-thought (CoT) processing and reinforcement learning (RL). Specifically, we first propose an innovative CoT dataset named nuScenesR2-6K for supervised fine-tuning, which effectively builds cognitive bridges between input information and output trajectories through a four-step logical chain with self-reflection for validation. Moreover, to maximize both reasoning and self-reflection during the RL stage, we further employ the Group Relative Policy Optimization (GRPO) algorithm within a physics-grounded reward framework that incorporates spatial alignment, vehicle dynamic, and temporal smoothness criteria to ensure reliable and realistic trajectory planning. Extensive evaluation results across both nuScenes and Waymo datasets demonstrates the state-of-the-art performance and robust generalization capacity of our proposed method.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 34 of its 42 references that are in the map. First posted on arXiv 2 Sep 2025.
Builds on
34 of 42 references.
Closest ancestors · 3
Same direction, newest first
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning16 Jun
- 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Driving22 May
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model30 Mar
Other references · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023Visual Instruction Tuningcited by 7,792
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
19 more
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
- 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Modelscited by 417
- 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 301
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
- 2018Learning to Drive in a Daycited by 266
- 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 239
- 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
- 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenescited by 191
- 2025GPG: A Simple and Strong Reinforcement Learning Baseline for Model Reasoningcited by 147
- 2023MobileVLM : A Fast, Strong and Open Vision Language Assistant for Mobile Devicescited by 120
- 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoningcited by 108
- 2023FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Drivingcited by 67
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 52
- 2025FingER: Content Aware Fine-grained Evaluation with Reasoning for AI-Generated Videoscited by 22
- 2021What data do we need for training an AV motion planner?cited by 15
- 2022Flash: Fast and Light Motion Prediction for Autonomous Driving with Bayesian Inverse Planning and Learned Motion Profilescited by 6
- 2022DiPA: Probabilistic Multi-Modal Interactive Prediction for Autonomous Drivingcited by 5
Built on by
Citing papers per year: 2025: 10; 2026: 22.
32 papers.
Sort:
By area:
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 136
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 46
- 2025MindDrive: A Vision-Language-Action Model for Autonomous Driving via Online Reinforcement Learningcited by 25
- 2025From Editor to Dense Geometry Estimatorcited by 20
- 2025A Survey on Agentic Multimodal Large Language Modelscited by 19
- 2026NoRD: A Data-Efficient Vision-Language-Action Model that Drives without Reasoningcited by 15
- 2025Reasoning-VLA: A Fast and General Vision-Language-Action Reasoning Model for Autonomous Drivingcited by 14
- 2025dVLM-AD: Enhance Diffusion Vision-Language-Model for Driving via Controllable Reasoningcited by 14
- 2026PROGRESSLM: Towards Progress Reasoning in Vision-Language Modelscited by 13
- 2026AutoDrive-P3: Unified Chain of Perception-Prediction-Planning Thought via Reinforcement Fine-Tuningcited by 13
- 2026DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Drivingcited by 11
- 2026Learning Vision-Language-Action World Models for Autonomous Drivingcited by 11
20 more
- 2026MindDriver: Introducing Progressive Multimodal Reasoning for Autonomous Drivingcited by 10
- 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoningcited by 8
- 2026Accelerating Structured Chain-of-Thought in Autonomous Vehiclescited by 6
- 2026MindVLA-U1: VLA Beats VA with Unified Streaming Architecture for Autonomous Drivingcited by 6
- 2025CoC-VLA: Delving into Adversarial Domain Transfer for Explainable Autonomous Driving via Chain-of-Causality Visual-Language-Action Modelcited by 5
- 2026One-Step Flow Policy: Self-Distillation for Fast Visuomotor Policiescited by 5
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AIcited by 3
- 2026Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Drivingcited by 2
- 2026The Blind Spot of Adaptation: Quantifying and Mitigating Forgetting in Fine-tuned Driving Modelscited by 1
- 2026Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modelingcited by 1
- 2026OpenLongTail: Generative Scaling of Long-Tail Driving Datacited by 1
- 2025From Human Intention to Action Prediction: Intention-Driven End-to-End Autonomous Drivingcited by 0
- 2026Latency Analysis and Optimization of Alpamayo 1 via Efficient Trajectory Generationcited by 0
- 2026PixelPilot: Scalable Vision-Language-Action Models for End-to-End Autonomous Drivingcited by 0
- 2026MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Modelscited by 0
- 2026Drive the Thoughts: Runtime Monitoring of VLA Reasoning-Trajectory Consistencycited by 0
- 2026CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Predictioncited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Drivingcited by 0
- 2026VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulationcited by 0
- 2026CAR-VLA: Complexity-Aware and Risk-Adaptive Reasoning for Autonomous Drivingcited by 0
- 2026CAR-VLA: Complexity-Aware and Risk-Adaptive Reasoning for Autonomous Driving28 Sep 2026
- 2026VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulation2 Sep 2026
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving31 Aug 2026
- 2026CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Prediction31 Aug 2026
- 2026Drive the Thoughts: Runtime Monitoring of VLA Reasoning-Trajectory Consistency30 Aug 2026
- 2026OpenLongTail: Generative Scaling of Long-Tail Driving Data10 Jul 2026
- 2026MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Models10 Jul 2026
- 2026PixelPilot: Scalable Vision-Language-Action Models for End-to-End Autonomous Driving6 Jul 2026
- 2026Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Driving22 Jun 2026
- 2026Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modeling13 May 2026
- 2026MindVLA-U1: VLA Beats VA with Unified Streaming Architecture for Autonomous Driving12 May 2026
- 2026Latency Analysis and Optimization of Alpamayo 1 via Efficient Trajectory Generation9 May 2026
20 more
- 2026Learning Vision-Language-Action World Models for Autonomous Driving10 Apr 2026
- 2026The Blind Spot of Adaptation: Quantifying and Mitigating Forgetting in Fine-tuned Driving Models6 Apr 2026
- 2026AutoDrive-P3: Unified Chain of Perception-Prediction-Planning Thought via Reinforcement Fine-Tuning30 Mar 2026
- 2026One-Step Flow Policy: Self-Distillation for Fast Visuomotor Policies12 Mar 2026
- 2026DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Driving11 Mar 2026
- 2026MindDriver: Introducing Progressive Multimodal Reasoning for Autonomous Driving25 Feb 2026
- 2026NoRD: A Data-Efficient Vision-Language-Action Model that Drives without Reasoning24 Feb 2026
- 2026Accelerating Structured Chain-of-Thought in Autonomous Vehicles2 Feb 2026
- 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoning1 Feb 2026
- 2026PROGRESSLM: Towards Progress Reasoning in Vision-Language Models21 Jan 2026
- 2025MindDrive: A Vision-Language-Action Model for Autonomous Driving via Online Reinforcement Learning15 Dec 2025
- 2025From Human Intention to Action Prediction: Intention-Driven End-to-End Autonomous Driving13 Dec 2025
- 2025dVLM-AD: Enhance Diffusion Vision-Language-Model for Driving via Controllable Reasoning4 Dec 2025
- 2025CoC-VLA: Delving into Adversarial Domain Transfer for Explainable Autonomous Driving via Chain-of-Causality Visual-Language-Action Model25 Nov 2025
- 2025Reasoning-VLA: A Fast and General Vision-Language-Action Reasoning Model for Autonomous Driving25 Nov 2025
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail30 Oct 2025
- 2025A Survey on Agentic Multimodal Large Language Models13 Oct 2025
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI6 Oct 2025
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Survey23 Sep 2025
- 2025From Editor to Dense Geometry Estimator4 Sep 2025
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 136
- 2026NoRD: A Data-Efficient Vision-Language-Action Model that Drives without Reasoningcited by 15
- 2025Reasoning-VLA: A Fast and General Vision-Language-Action Reasoning Model for Autonomous Drivingcited by 14
- 2025dVLM-AD: Enhance Diffusion Vision-Language-Model for Driving via Controllable Reasoningcited by 14
- 2026PROGRESSLM: Towards Progress Reasoning in Vision-Language Modelscited by 13
- 2026AutoDrive-P3: Unified Chain of Perception-Prediction-Planning Thought via Reinforcement Fine-Tuningcited by 13
- 2026MindDriver: Introducing Progressive Multimodal Reasoning for Autonomous Drivingcited by 10
- 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoningcited by 8
- 2026Accelerating Structured Chain-of-Thought in Autonomous Vehiclescited by 6
- 2026PixelPilot: Scalable Vision-Language-Action Models for End-to-End Autonomous Drivingcited by 0
- 2026Drive the Thoughts: Runtime Monitoring of VLA Reasoning-Trajectory Consistencycited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Drivingcited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving31 Aug 2026
- 2026Drive the Thoughts: Runtime Monitoring of VLA Reasoning-Trajectory Consistency30 Aug 2026
- 2026PixelPilot: Scalable Vision-Language-Action Models for End-to-End Autonomous Driving6 Jul 2026
- 2026AutoDrive-P3: Unified Chain of Perception-Prediction-Planning Thought via Reinforcement Fine-Tuning30 Mar 2026
- 2026MindDriver: Introducing Progressive Multimodal Reasoning for Autonomous Driving25 Feb 2026
- 2026NoRD: A Data-Efficient Vision-Language-Action Model that Drives without Reasoning24 Feb 2026
- 2026Accelerating Structured Chain-of-Thought in Autonomous Vehicles2 Feb 2026
- 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoning1 Feb 2026
- 2026PROGRESSLM: Towards Progress Reasoning in Vision-Language Models21 Jan 2026
- 2025dVLM-AD: Enhance Diffusion Vision-Language-Model for Driving via Controllable Reasoning4 Dec 2025
- 2025Reasoning-VLA: A Fast and General Vision-Language-Action Reasoning Model for Autonomous Driving25 Nov 2025
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail30 Oct 2025
- 2025CoC-VLA: Delving into Adversarial Domain Transfer for Explainable Autonomous Driving via Chain-of-Causality Visual-Language-Action Modelcited by 5
- 2026Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modelingcited by 1
- 2025From Human Intention to Action Prediction: Intention-Driven End-to-End Autonomous Drivingcited by 0
- 2026CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Predictioncited by 0
- 2026VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulationcited by 0
- 2026VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulation2 Sep 2026
- 2026CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Prediction31 Aug 2026
- 2026Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modeling13 May 2026
- 2025From Human Intention to Action Prediction: Intention-Driven End-to-End Autonomous Driving13 Dec 2025
- 2025CoC-VLA: Delving into Adversarial Domain Transfer for Explainable Autonomous Driving via Chain-of-Causality Visual-Language-Action Model25 Nov 2025
- 2025MindDrive: A Vision-Language-Action Model for Autonomous Driving via Online Reinforcement Learningcited by 25
- 2026DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Drivingcited by 11
- 2026MindVLA-U1: VLA Beats VA with Unified Streaming Architecture for Autonomous Drivingcited by 6
- 2026Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Drivingcited by 2
- 2026CAR-VLA: Complexity-Aware and Risk-Adaptive Reasoning for Autonomous Drivingcited by 0
- 2026CAR-VLA: Complexity-Aware and Risk-Adaptive Reasoning for Autonomous Driving28 Sep 2026
- 2026Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Driving22 Jun 2026
- 2026MindVLA-U1: VLA Beats VA with Unified Streaming Architecture for Autonomous Driving12 May 2026
- 2026DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Driving11 Mar 2026
- 2025MindDrive: A Vision-Language-Action Model for Autonomous Driving via Online Reinforcement Learning15 Dec 2025
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 46
- 2025A Survey on Agentic Multimodal Large Language Modelscited by 19
- 2026The Blind Spot of Adaptation: Quantifying and Mitigating Forgetting in Fine-tuned Driving Modelscited by 1
- 2026MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Modelscited by 0
- 2026MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Models10 Jul 2026
- 2026The Blind Spot of Adaptation: Quantifying and Mitigating Forgetting in Fine-tuned Driving Models6 Apr 2026
- 2025A Survey on Agentic Multimodal Large Language Models13 Oct 2025
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Survey23 Sep 2025
- 2025From Editor to Dense Geometry Estimatorcited by 20
- 2026One-Step Flow Policy: Self-Distillation for Fast Visuomotor Policiescited by 5
- 2026One-Step Flow Policy: Self-Distillation for Fast Visuomotor Policies12 Mar 2026
- 2025From Editor to Dense Geometry Estimator4 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learning
- 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Driving
- 2025VDRive: Leveraging Reinforced VLA and Diffusion Policy for End-to-end Autonomous Driving
- 2025DriveMind: A Dual Visual Language Model-based Reinforcement Learning Framework for Autonomous Driving
- 2025DriveRX: A Vision-Language Reasoning Model for Cross-Task Autonomous Driving
- 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Driving
- 2026Rethinking Language's Role in Efficient VLA for Autonomous Vehicles: Toward Smarter, Trustworthy Driving
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Driving