mlsanityData to 7 Oct 2026

AutoDrive-R2: Incentivizing Reasoning and Self-Reflection Capacity for VLA Model in Autonomous Driving

arXiv 2509.01944 ↗First posted 2 Sep 2025cs.RO cs.CVcited by 32

On the map: Vision-language-action models → VLA for autonomous driving

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) models in autonomous driving systems have recently demonstrated transformative potential by integrating multimodal perception with decision-making capabilities. However, the interpretability and coherence of the decision process and the plausibility of action sequences remain largely underexplored. To address these issues, we propose AutoDrive-R2, a novel VLA framework that enhances both reasoning and self-reflection capabilities of autonomous driving systems through chain-of-thought (CoT) processing and reinforcement learning (RL). Specifically, we first propose an innovative CoT dataset named nuScenesR2-6K for supervised fine-tuning, which effectively builds cognitive bridges between input information and output trajectories through a four-step logical chain with self-reflection for validation. Moreover, to maximize both reasoning and self-reflection during the RL stage, we further employ the Group Relative Policy Optimization (GRPO) algorithm within a physics-grounded reward framework that incorporates spatial alignment, vehicle dynamic, and temporal smoothness criteria to ensure reliable and realistic trajectory planning. Extensive evaluation results across both nuScenes and Waymo datasets demonstrates the state-of-the-art performance and robust generalization capacity of our proposed method.

Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 34 of its 42 references that are in the map. First posted on arXiv 2 Sep 2025.

Builds on

34 of 42 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning16 Jun
  2. 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Driving22 May
  3. 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model30 Mar

Other references · 31

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  6. 2023Visual Instruction Tuningcited by 7,792
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  8. 2025Qwen2.5-VL Technical Reportcited by 5,418
  9. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  10. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  11. 2022Planning-oriented Autonomous Drivingcited by 1,068
  12. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
19 more
  1. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
  2. 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
  3. 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Modelscited by 417
  4. 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 301
  5. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
  6. 2018Learning to Drive in a Daycited by 266
  7. 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
  8. 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 239
  9. 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
  10. 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenescited by 191
  11. 2025GPG: A Simple and Strong Reinforcement Learning Baseline for Model Reasoningcited by 147
  12. 2023MobileVLM : A Fast, Strong and Open Vision Language Assistant for Mobile Devicescited by 120
  13. 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoningcited by 108
  14. 2023FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Drivingcited by 67
  15. 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 52
  16. 2025FingER: Content Aware Fine-grained Evaluation with Reasoning for AI-Generated Videoscited by 22
  17. 2021What data do we need for training an AV motion planner?cited by 15
  18. 2022Flash: Fast and Light Motion Prediction for Autonomous Driving with Bayesian Inverse Planning and Learned Motion Profilescited by 6
  19. 2022DiPA: Probabilistic Multi-Modal Interactive Prediction for Autonomous Drivingcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 10; 2026: 22.

32 papers.

Sort:

By area:

  1. 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 136
  2. 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 46
  3. 2025MindDrive: A Vision-Language-Action Model for Autonomous Driving via Online Reinforcement Learningcited by 25
  4. 2025From Editor to Dense Geometry Estimatorcited by 20
  5. 2025A Survey on Agentic Multimodal Large Language Modelscited by 19
  6. 2026NoRD: A Data-Efficient Vision-Language-Action Model that Drives without Reasoningcited by 15
  7. 2025Reasoning-VLA: A Fast and General Vision-Language-Action Reasoning Model for Autonomous Drivingcited by 14
  8. 2025dVLM-AD: Enhance Diffusion Vision-Language-Model for Driving via Controllable Reasoningcited by 14
  9. 2026PROGRESSLM: Towards Progress Reasoning in Vision-Language Modelscited by 13
  10. 2026AutoDrive-P3: Unified Chain of Perception-Prediction-Planning Thought via Reinforcement Fine-Tuningcited by 13
  11. 2026DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Drivingcited by 11
  12. 2026Learning Vision-Language-Action World Models for Autonomous Drivingcited by 11
20 more
  1. 2026MindDriver: Introducing Progressive Multimodal Reasoning for Autonomous Drivingcited by 10
  2. 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoningcited by 8
  3. 2026Accelerating Structured Chain-of-Thought in Autonomous Vehiclescited by 6
  4. 2026MindVLA-U1: VLA Beats VA with Unified Streaming Architecture for Autonomous Drivingcited by 6
  5. 2025CoC-VLA: Delving into Adversarial Domain Transfer for Explainable Autonomous Driving via Chain-of-Causality Visual-Language-Action Modelcited by 5
  6. 2026One-Step Flow Policy: Self-Distillation for Fast Visuomotor Policiescited by 5
  7. 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AIcited by 3
  8. 2026Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Drivingcited by 2
  9. 2026The Blind Spot of Adaptation: Quantifying and Mitigating Forgetting in Fine-tuned Driving Modelscited by 1
  10. 2026Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modelingcited by 1
  11. 2026OpenLongTail: Generative Scaling of Long-Tail Driving Datacited by 1
  12. 2025From Human Intention to Action Prediction: Intention-Driven End-to-End Autonomous Drivingcited by 0
  13. 2026Latency Analysis and Optimization of Alpamayo 1 via Efficient Trajectory Generationcited by 0
  14. 2026PixelPilot: Scalable Vision-Language-Action Models for End-to-End Autonomous Drivingcited by 0
  15. 2026MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Modelscited by 0
  16. 2026Drive the Thoughts: Runtime Monitoring of VLA Reasoning-Trajectory Consistencycited by 0
  17. 2026CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Predictioncited by 0
  18. 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Drivingcited by 0
  19. 2026VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulationcited by 0
  20. 2026CAR-VLA: Complexity-Aware and Risk-Adaptive Reasoning for Autonomous Drivingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learning
  2. 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Driving
  3. 2025VDRive: Leveraging Reinforced VLA and Diffusion Policy for End-to-end Autonomous Driving
  4. 2025DriveMind: A Dual Visual Language Model-based Reinforcement Learning Framework for Autonomous Driving
  5. 2025DriveRX: A Vision-Language Reasoning Model for Cross-Task Autonomous Driving
  6. 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Driving
  7. 2026Rethinking Language's Role in Efficient VLA for Autonomous Vehicles: Toward Smarter, Trustworthy Driving
  8. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Driving