CoT4AD: A Vision-Language-Action Model with Explicit Chain-of-Thought Reasoning for Autonomous Driving
On the map: LLM reasoning → Chain-of-thought reasoning for driving
also in 2 more
Abstract (arXiv)
Vision-Language-Action (VLA) models have recently attracted growing attention in end-to-end autonomous driving for their strong reasoning capabilities and rich world knowledge. However, existing VLAs often suffer from limited numerical reasoning ability and overly simplified input-output mappings, which hinder their performance in complex driving scenarios requiring step-by-step causal reasoning. To address these challenges, we propose CoT4AD, a novel VLA framework that introduces Chain-of-Thought (CoT) reasoning for autonomous driving to enhance both numerical and causal reasoning in Vision-Language Models (VLMs). CoT4AD integrates visual observations and language instructions to perform semantic reasoning, scene understanding, and trajectory planning. During training, it explicitly models a perception-question-prediction-action CoT to align the reasoning space with the action space across multiple driving tasks. During inference, it performs implicit CoT reasoning to enable consistent numerical reasoning and robust decision-making in dynamic environments. Extensive experiments on both real-world and simulated benchmarks, including nuScenes and Bench2Drive, demonstrate that CoT4AD achieves state-of-the-art performance in both open-loop and closed-loop evaluations. Code will be released upon paper acceptance.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 20 of its 67 references that are in the map. First posted on arXiv 27 Nov 2025.
Builds on
20 of 67 references.
Closest ancestors · 1
Same direction, newest first
Other references · 19
- 2023GPT-4 Technical Reportcited by 18,396
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,296
- 2016End to End Learning for Self-Driving Carscited by 1,009
- 2023Vision Transformers Need Registerscited by 871
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 346
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 231
- 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenescited by 191
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 176
7 more
- 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
- 2025DriveTransformer: Unified Transformer for Scalable End-to-End Autonomous Drivingcited by 126
- 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Drivingcited by 64
- 2025Exploring the Limits of Vision-Language-Action Manipulations in Cross-task Generalizationcited by 33
- 2024DriveGPT: Scaling Autoregressive Behavior Models for Drivingcited by 29
- 2024GPT-4V as Traffic Assistant: An In-depth Look at Vision Language Model on Complex Traffic Eventscited by 16
- 2024Soft Prompt Tuning for Cross-Lingual Transfer: When Less is Morecited by 7
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026SteerVLA: Steering Vision-Language-Action Models in Long-Tail Driving Scenarioscited by 11
- 2026MARINER: A 3E-Driven Benchmark for Fine-Grained Perception and Complex Reasoning in Open-Water Environmentscited by 0
- 2026WorkDrive: Roadwork Chain of Causation for Autonomous Drivingcited by 0
- 2026HyPASE: Hyperbolic Geometry for Parameter-Efficient Speech Emotion Fine-Tuning Framework for Large Audio-Language Modelscited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Drivingcited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving31 Aug 2026
- 2026HyPASE: Hyperbolic Geometry for Parameter-Efficient Speech Emotion Fine-Tuning Framework for Large Audio-Language Models5 Aug 2026
- 2026WorkDrive: Roadwork Chain of Causation for Autonomous Driving16 Jul 2026
- 2026MARINER: A 3E-Driven Benchmark for Fine-Grained Perception and Complex Reasoning in Open-Water Environments9 Apr 2026
- 2026SteerVLA: Steering Vision-Language-Action Models in Long-Tail Driving Scenarios9 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026VLADriveBench: Evaluating CoT-Action Relationship in VLA for Autonomous Driving
- 2025Latent Chain-of-Thought World Modeling for End-to-End Driving
- 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learning
- 2025A Survey on Vision-Language-Action Models for Autonomous Driving
- 2026RT-VLA: Real-Time Vision-Language-Action Models via Knowledge Distillation
- 2025Reasoning-VLA: A Fast and General Vision-Language-Action Reasoning Model for Autonomous Driving
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning
- 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanation