Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving
On the map: LLM reasoning → Chain-of-thought reasoning for driving
Abstract (arXiv)
Chain-of-thought (CoT) reasoning powers generative models by eliciting intermediate steps before producing an answer. In autonomous driving, the answer is a continuous action. Thus its reasoning must share the same spatiotemporal structure as the physical world. This survey studies the resulting shift from textual CoT to action-grounded reasoning. Surveying 171 papers, including 130 method papers and 41 benchmarks, datasets, surveys, and analysis papers, we propose a representation-centered taxonomy that treats the form of the intermediate state as the organizing axis. We systematize the 130 methods into four categories: language-based, visual-spatial, latent-dynamic, and externalized reasoning, further divided into 13 subtypes tied to distinct regions of interests. Our synthesis shows that the open frontier of reasoning in driving agents lies in intermediate representations that can be grounded in the real world, coupled to real-time action, and verified under safety-critical systems. Project page: https://github.com/tangzhengxu/awesome-av-cot.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 97 of its 168 references that are in the map. First posted on arXiv 31 Aug 2026.
Builds on
97 of 168 references.
Closest ancestors · 43
Same direction, newest first
- 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanation20 Apr
- 2026Bridging Large-Model Reasoning and Real-Time Control via Agentic Fast-Slow Planning2 Apr
- 2026KLDrive: Fine-Grained 3D Scene Reasoning for Autonomous Driving based on Knowledge Graph22 Mar
- 2026A Survey of Reasoning in Autonomous Driving Systems: Open Challenges and Emerging Paradigms11 Mar
- 2026NaviDriveVLM: Decoupling High-Level Reasoning and Motion Planning for Autonomous Driving9 Mar
- 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Driving2 Mar
- 2026DriveCombo: Benchmarking Compositional Traffic Rule Reasoning in Autonomous Driving2 Mar
- 2026MindDriver: Introducing Progressive Multimodal Reasoning for Autonomous Driving25 Feb
- 2026Accelerating Structured Chain-of-Thought in Autonomous Vehicles2 Feb
- 2026AgentDrive: An Open Benchmark Dataset for Agentic AI Reasoning with LLM-Generated Scenarios in Autonomous Systems23 Jan
- 2026ThinkDrive: Chain-of-Thought Guided Progressive Reinforcement Learning Fine-Tuning for Autonomous Driving8 Jan
- 2025Counterfactual VLA: Self-Reflective Vision-Language-Action Model with Adaptive Reasoning30 Dec
31 more
- 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Driving28 Dec
- 2025LLaViDA: A Large Language Vision Driving Assistant for Explicit Reasoning and Enhanced Trajectory Planning20 Dec
- 2025OmniDrive-R1: Reinforcement-driven Interleaved Multi-modal Chain-of-Thought for Trustworthy Vision-Language Autonomous Driving16 Dec
- 2025FutureX: Enhance End-to-End Autonomous Driving via Latent Chain-of-Thought World Model12 Dec
- 2025SpaceDrive: Infusing Spatial Awareness into VLM-based Autonomous Driving11 Dec
- 2025Latent Chain-of-Thought World Modeling for End-to-End Driving11 Dec
- 2025COVLM-RL: Critical Object-Oriented Reasoning for Autonomous Driving Using VLM-Guided Reinforcement Learning10 Dec
- 2025dVLM-AD: Enhance Diffusion Vision-Language-Model for Driving via Controllable Reasoning4 Dec
- 2025Think Before You Drive: World Model-Inspired Multimodal Grounding for Autonomous Vehicles3 Dec
- 2025OpenREAD: Reinforced Open-Ended Reasoning for End-to-End Autonomous Driving with LLM-as-Critic1 Dec
- 2025CoT4AD: A Vision-Language-Action Model with Explicit Chain-of-Thought Reasoning for Autonomous Driving27 Nov
- 2025Reasoning-VLA: A Fast and General Vision-Language-Action Reasoning Model for Autonomous Driving25 Nov
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail30 Oct
- 2025Enhancing Vision-Language Models for Autonomous Driving through Task-Specific Prompting and Spatial Reasoning28 Oct
- 2025Robust Driving QA through Metadata-Grounded Context and Task-Specific Prompts21 Oct
- 2025More Than Meets the Eye? Uncovering the Reasoning-Planning Disconnect in Training Vision-Language Driving Models6 Oct
- 2025MTRDrive: Memory-Tool Synergistic Reasoning for Robust Autonomous Driving in Corner Cases25 Sep
- 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Driving17 Sep
- 2025DriveAgent-R1: Advancing VLM-based Autonomous Driving with Active Perception and Hybrid Thinking28 Jul
- 2025HMVLM: Multistage Reasoning-Enhanced Vision-Language Model for Long-Tailed Driving Scenarios6 Jun
- 2025V2X-UniPool: Unifying Multimodal Perception and Knowledge Reasoning for Autonomous Driving3 Jun
- 2025DriveRX: A Vision-Language Reasoning Model for Cross-Task Autonomous Driving27 May
- 2025Chain-of-Thought for Autonomous Driving: A Comprehensive Survey and Future Prospects26 May
- 2025VERDI: VLM-Embedded Reasoning for Autonomous Driving21 May
- 2025AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving21 May
- 2025DSDrive: Distilling Large Language Model for Lightweight End-to-End Autonomous Driving with Unified Reasoning and Planning8 May
- 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoning10 Mar
- 2024WiseAD: Knowledge Augmented End-to-End Autonomous Driving with Vision-Language Model13 Dec
- 2024FASIONAD : FAst and Slow FusION Thinking Systems for Human-Like Autonomous Driving with Adaptive Feedback27 Nov
- 2024DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Driving25 Mar
- 2023LLM-Assist: Enhancing Closed-Loop Planning with Language-Based Reasoning30 Dec
Other references · 54
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
- 2023GPT-Driver: Learning to Drive with GPTcited by 347
- 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 231
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 198
- 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Drivingcited by 190
- 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Drivingcited by 64
- 2024AgentsCoDriver: Large Language Model Empowered Collaborative Driving with Lifelong Learningcited by 40
- 2026SGDrive: Scene-to-Goal Hierarchical World Cognition for Autonomous Drivingcited by 38
- 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Drivingcited by 37
- 2025AutoDrive-R2: Incentivizing Reasoning and Self-Reflection Capacity for VLA Model in Autonomous Drivingcited by 34
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 33
38 more
- 2025V2V-LLM: Vehicle-to-Vehicle Cooperative Autonomous Driving with Multimodal Large Language Modelscited by 27
- 2025MindDrive: A Vision-Language-Action Model for Autonomous Driving via Online Reinforcement Learningcited by 25
- 2025Discrete Diffusion for Reflective Vision-Language-Action Models in Autonomous Drivingcited by 24
- 2026UniDrive-WM: Unified Understanding, Planning and Generation World Model for Autonomous Drivingcited by 20
- 2026Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failurescited by 19
- 2025DriveAction: A Benchmark for Exploring Human-like Driving Decisions in VLA Modelscited by 17
- 2026DriveDreamer-Policy: A Geometry-Grounded World-Action Model for Unified Generation and Planningcited by 17
- 2024SimpleLLM4AD: An End-to-End Vision-Language Model with Graph Visual Question Answering for Autonomous Drivingcited by 16
- 2025Retrieval-Based Interleaved Visual Chain-of-Thought in Real-World Driving Scenarioscited by 16
- 2025TeLL-Drive: Enhancing Autonomous Driving with Teacher LLM-Guided Deep Reinforcement Learningcited by 13
- 2024CALMM-Drive: Confidence-Aware Autonomous Driving with Large Multimodal Modelcited by 12
- 2025FASIONAD++ : Integrating High-Level Instruction and Information Bottleneck in FAt-Slow fusION Systems for Enhanced Safety in Autonomous Driving with Adaptive Feedbackcited by 12
- 2025Towards Human-Centric Autonomous Driving: A Fast-Slow Architecture Integrating Large Language Model Guidance with Reinforcement Learningcited by 11
- 2026SteerVLA: Steering Vision-Language-Action Models in Long-Tail Driving Scenarioscited by 11
- 2026DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Drivingcited by 11
- 2026Learning Vision-Language-Action World Models for Autonomous Drivingcited by 11
- 2025DriveQA: Passing the Driving Knowledge Testcited by 10
- 2025UniUGP: Unifying Understanding, Generation, and Planing For End-to-end Autonomous Drivingcited by 10
- 2026Bench2Drive-VL: Benchmarks for Closed-Loop Autonomous Driving with Vision-Language Modelscited by 10
- 2025X-Driver: Explainable Autonomous Driving with Vision-Language Modelscited by 9
- 2023Evaluation of Large Language Models for Decision Making in Autonomous Drivingcited by 8
- 2025Bench2ADVLM: A Closed-Loop Benchmark for Vision-language Models in Autonomous Drivingcited by 8
- 2025RoboDriveVLM: A Novel Benchmark and Baseline towards Robust Vision-Language Models for Autonomous Drivingcited by 8
- 2025Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenescited by 7
- 2025LightEMMA: A Longitudinal Evaluation of Vision-Language Models for Autonomous Drivingcited by 6
- 2025LeAD: The LLM Enhanced Planning System Converged with End-to-end Autonomous Drivingcited by 5
- 2025CogDriver: Integrating Cognitive Inertia for Temporally Coherent Planning in Autonomous Drivingcited by 5
- 2026Natural Language Instructions for Scene-Responsive Human-in-the-Loop Motion Planning in Autonomous Driving using Vision-Language-Action Modelscited by 5
- 2026HiST-VLA: A Hierarchical Spatio-Temporal Vision-Language-Action Model for End-to-End Autonomous Drivingcited by 5
- 2025DriveMind: A Dual Visual Language Model-based Reinforcement Learning Framework for Autonomous Drivingcited by 3
- 2025The Case for Negative Data: From Crash Reports to Counterfactuals for Reasonable Drivingcited by 3
- 2025DiffVLA++: Bridging Cognitive Reasoning and End-to-End Driving through Metric-Guided Alignmentcited by 3
- 2026Self-Supervised Bootstrapping of Action-Predictive Embodied Reasoningcited by 3
- 2026RAD-LAD: Rule and Language Grounded Autonomous Driving in Real-Timecited by 3
- 2025Multimodal Framework for Explainable Autonomous Driving: Integrating Video, Sensor, and Textual Data for Enhanced Decision-Making and Transparencycited by 2
- 2025VLM-UDMC: VLM-Enhanced Unified Decision-Making and Motion Control for Urban Autonomous Drivingcited by 2
- 2025The System Description of CPS Team for Track on Driving with Language of CVPR 2024 Autonomous Grand Challengecited by 2
- 2025From Segments to Scenes: Temporal Understanding for Agentic Autonomous Driving via Vision-Language Modelscited by 2
50 most cited of 54 All 54 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Grounding What Shapes the Plan: Rethinking Groundedness for Physical Intelligence in Autonomous Driving
- 2026GRAVA: Grounded Reasoning-to-Action Representation and Learning for Autonomous Driving
- 2026Reasoning models do not yet follow their reasoning in autonomous driving: The KITScenes LongTail Dataset
- 2026VLADriveBench: Evaluating CoT-Action Relationship in VLA for Autonomous Driving
- 2026AnchorReasoning: A Visual Grounding and Causal Reasoning Dataset in Long-Tail Autonomous Driving Scenarios
- 2026C-CoT: Counterfactual Chain-of-Thought with Vision-Language Models for Safe Autonomous Driving
- 2026Is VLA Reasoning Faithful? Probing Safety of Chain-of-Causation in Autonomous Driving Models
- 2026Neuro-Symbolic Drive: Rule-Grounded Faithful Reasoning for Driving VLAs