mlsanityData to 14 Oct 2026

DriveRX: A Vision-Language Reasoning Model for Cross-Task Autonomous Driving

arXiv 2505.20665 ↗First posted 27 May 2025cs.CVcited by 5

On the map: LLM reasoning → Chain-of-thought reasoning for driving

also in 1 more
Abstract (arXiv)

Effective autonomous driving hinges on robust reasoning across perception, prediction, planning, and behavior. However, conventional end-to-end models fail to generalize in complex scenarios due to the lack of structured reasoning. While recent vision-language models (VLMs) have been applied to driving tasks, they typically rely on isolated modules and static supervision, limiting their ability to support multi-stage decision-making. We present AutoDriveRL, a unified training framework that formulates autonomous driving as a structured reasoning process over four core tasks. Each task is independently modeled as a vision-language QA problem and optimized using task-specific reward models, enabling fine-grained reinforcement signals at different reasoning stages. Within this framework, we train DriveRX, a cross-task reasoning VLM designed for multi-stage decision-making. DriveRX achieves strong performance on the public benchmark, outperforming GPT-4o in behavior reasoning and demonstrating robustness under complex or corrupted driving conditions. DriveRX serves as a high-level semantic reasoning backbone, producing structured stage-wise reasoning chains that enhance decision consistency. These outputs also provide high-quality supervisory signals for annotation and downstream planning/control models. We release the AutoDriveRL framework and DriveRX to support future research.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 24 of its 73 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

24 of 73 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generation25 Mar
  2. 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoning10 Mar
  3. 2024VLM-AD: End-to-End Autonomous Driving through Vision-Language Model Supervision19 Dec
  4. 2024OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoning2 May

Other references · 20

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  5. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  6. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
  7. 2025SimpleRL-Zoo: Investigating and Taming Zero Reinforcement Learning for Open Base Models in the Wildcited by 511
  8. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
  9. 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worstcited by 397
  10. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
  11. 2023GPT-Driver: Learning to Drive with GPTcited by 347
  12. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningcited by 303
8 more
  1. 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenescited by 191
  2. 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMscited by 147
  3. 2025DriveTransformer: Unified Transformer for Scalable End-to-End Autonomous Drivingcited by 126
  4. 2025Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data, and Metric Perspectivescited by 122
  5. 2024Align Anything: Training All-Modality Models to Follow Instructions with Language Feedbackcited by 39
  6. 2025DriveLMM-o1: A Step-by-Step Reasoning Dataset and Large Multimodal Model for Driving Scenario Understandingcited by 36
  7. 2025VisuoThink: Empowering LVLM Reasoning with Multimodal Tree Searchcited by 36
  8. 2025Sce2DriveX: A Generalized MLLM Framework for Scene-to-Drive Learningcited by 25

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning
  2. 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learning
  3. 2025DriveMind: A Dual Visual Language Model-based Reinforcement Learning Framework for Autonomous Driving
  4. 2026DriveReward: A Comprehensive Dataset and Generative Vision-Language Reward Model for Autonomous Driving
  5. 2023Reason2Drive: Towards Interpretable and Chain-based Reasoning for Autonomous Driving
  6. 2025AutoDrive-R2: Incentivizing Reasoning and Self-Reflection Capacity for VLA Model in Autonomous Driving
  7. 2025AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving
  8. 2026AutoDrive-P3: Unified Chain of Perception-Prediction-Planning Thought via Reinforcement Fine-Tuning