DriveAgent-R1: Advancing VLM-based Autonomous Driving with Active Perception and Hybrid Thinking
On the map: LLM reasoning → Chain-of-thought reasoning for driving
also in 2 more
Abstract (arXiv)
The advent of Vision-Language Models (VLMs) has significantly advanced end-to-end autonomous driving, demonstrating powerful reasoning abilities for high-level behavior planning tasks. However, existing methods are often constrained by a passive perception paradigm, relying solely on text-based reasoning. This passivity restricts the model's capacity to actively seek crucial visual evidence when faced with uncertainty. To address this, we introduce DriveAgent-R1, the first autonomous driving agent capable of active perception for planning. In complex scenarios, DriveAgent-R1 proactively invokes tools to perform visual reasoning, firmly grounding its decisions in visual evidence, thereby enhancing both interpretability and reliability. Furthermore, we propose a hybrid thinking framework, inspired by human driver cognitive patterns, allowing the agent to adaptively switch between efficient text-only reasoning and robust tool-augmented visual reasoning based on scene complexity. This capability is cultivated through a three-stage progressive training strategy, featuring a core Cascaded Reinforcement Learning (Cascaded RL) phase. Extensive experiments on the Drive-Internal dataset, which is rich in long-tail scenarios, and the public nuScenes dataset show that, with only 3B parameters, DriveAgent-R1 achieves competitive performance comparable to top closed model systems such as GPT-5 and to human driving proficiency while remaining deployment-friendly, offering a proven path toward building more intelligent autonomous driving systems.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 17 of its 54 references that are in the map. First posted on arXiv 28 Jul 2025.
Builds on
17 of 54 references.
Closest ancestors · 2
Same direction, newest first
- 2025AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving21 May
- 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoning10 Mar
Other references · 15
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
- 2023GPT-Driver: Learning to Drive with GPTcited by 344
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 267
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thoughtcited by 204
- 2023Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Futurecited by 184
- 2025Think Only When You Need with Large Hybrid-Reasoning Modelscited by 64
- 2025Visual Thoughts: A Unified Perspective of Understanding Multimodal Chain-of-Thoughtcited by 34
- 2025Unsupervised Visual Chain-of-Thought Reasoning via Preference Optimizationcited by 22
Built on by
Citing papers per year: 2025: 2; 2026: 9.
11 papers.
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 32
- 2026Think3D: Thinking with Space for Spatial Reasoningcited by 22
- 2025OccVLA: Vision-Language-Action Model with Implicit 3D Occupancy Supervisioncited by 16
- 2026NoRD: A Data-Efficient Vision-Language-Action Model that Drives without Reasoningcited by 15
- 2026Learning Vision-Language-Action World Models for Autonomous Drivingcited by 11
- 2026See Further, Think Deeper: Advancing VLM's Reasoning Ability with Low-level Visual Cues and Reflectioncited by 3
- 2026IDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Drivingcited by 2
- 2026PixelPilot: Scalable Vision-Language-Action Models for End-to-End Autonomous Drivingcited by 0
- 2026WorkDrive: Roadwork Chain of Causation for Autonomous Drivingcited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Drivingcited by 0
- 2026Towards Active Cross-View Object Geo-Localizationcited by 0
- 2026Towards Active Cross-View Object Geo-Localization17 Sep 2026
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving31 Aug 2026
- 2026WorkDrive: Roadwork Chain of Causation for Autonomous Driving16 Jul 2026
- 2026PixelPilot: Scalable Vision-Language-Action Models for End-to-End Autonomous Driving6 Jul 2026
- 2026IDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Driving29 May 2026
- 2026See Further, Think Deeper: Advancing VLM's Reasoning Ability with Low-level Visual Cues and Reflection27 Apr 2026
- 2026Learning Vision-Language-Action World Models for Autonomous Driving10 Apr 2026
- 2026NoRD: A Data-Efficient Vision-Language-Action Model that Drives without Reasoning24 Feb 2026
- 2026Think3D: Thinking with Space for Spatial Reasoning19 Jan 2026
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future18 Dec 2025
- 2025OccVLA: Vision-Language-Action Model with Implicit 3D Occupancy Supervision6 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learning
- 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Driving
- 2025dVLM-AD: Enhance Diffusion Vision-Language-Model for Driving via Controllable Reasoning
- 2025OmniDrive-R1: Reinforcement-driven Interleaved Multi-modal Chain-of-Thought for Trustworthy Vision-Language Autonomous Driving
- 2023A Language Agent for Autonomous Driving
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail
- 2026AutoDrive-P3: Unified Chain of Perception-Prediction-Planning Thought via Reinforcement Fine-Tuning
- 2025VERDI: VLM-Embedded Reasoning for Autonomous Driving