mlsanityData to 14 Oct 2026

Cognitive Dual-Process Planning for Autonomous Driving with Structured Scene Knowledge and Verifiable Reasoning-Action Consistency

arXiv 2607.19194 ↗First posted 21 Jul 2026cs.RO cs.CVcited by 0

On the map: LLM reasoning → Chain-of-thought reasoning for driving

also in 1 more
Abstract (arXiv)

High-level planning for autonomous driving is a knowledge-intensive engineering decision task that requires accurate scene understanding, timely inference, and internally consistent action selection. Vision-language models (VLMs) can make intermediate reasoning explicit, but their use in deployed planners is constrained by costly structured supervision, unnecessary reasoning in routine scenes, and possible inconsistencies between generated rationales and driving actions. We present a cognitive dual-process planning framework that represents planning-relevant scene knowledge in a machine-parsable structured chain-of-thought (S-CoT) schema. An automated data engine integrates perception foundation models, critical-path filtering, and an expert VLM to generate S-CoT supervision without manual annotation of individual rationales. A lightweight visual Arbiter estimates scene complexity from multilevel vision-encoder features before language decoding and routes each input to either fast meta-action prediction or slow structured reasoning. For slow-path outputs, a deterministic rule-based validator checks whether the parsed S-CoT fields are consistent with the final meta-action and provides verifiable rewards for Group Relative Policy Optimization (GRPO). In a 195-scene manual audit, the generated annotations achieve 91.8% CoT accuracy and a 98.5% Logical Consistency Score (LCS). On 574 manually verified NAVSIM test samples, the planner achieves 80.14% planning accuracy and 97.20% LCS while reducing average latency by 17.39% relative to applying slow reasoning to every scene. Evaluation on external long-tail subsets further identifies conditions under which routing and planning performance degrade. Together, these results show how explicit scene knowledge can be operationalized through adaptive reasoning and rule-based verification to support high-level VLM planning decisions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 23 of its 66 references that are in the map. First posted on arXiv 21 Jul 2026.

Builds on

23 of 66 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail30 Oct
  2. 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Driving17 Sep
  3. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning16 Jun
  4. 2025DriveRX: A Vision-Language Reasoning Model for Cross-Task Autonomous Driving27 May
  5. 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoning10 Mar
  6. 2024VLM-AD: End-to-End Autonomous Driving through Vision-Language Model Supervision19 Dec
  7. 2024FASIONAD : FAst and Slow FusION Thinking Systems for Human-Like Autonomous Driving with Adaptive Feedback27 Nov
  8. 2024DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Driving25 Mar

Other references · 15

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2025Qwen3-VL Technical Reportcited by 2,793
  7. 2016End to End Learning for Self-Driving Carscited by 1,009
  8. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehiclescited by 493
  9. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
  10. 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 249
  11. 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Modelscited by 207
  12. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 185
3 more
  1. 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 176
  2. 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
  3. 2025Towards Human-Centric Autonomous Driving: A Fast-Slow Architecture Integrating Large Language Model Guidance with Reinforcement Learningcited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Driving
  2. 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learning
  3. 2026AutoDrive-P3: Unified Chain of Perception-Prediction-Planning Thought via Reinforcement Fine-Tuning
  4. 2026FactorDrive: Adaptive Multi-Step Reasoning Driven by Planning-Critical Factors for End-to-End Autonomous Driving
  5. 2025CoT4AD: A Vision-Language-Action Model with Explicit Chain-of-Thought Reasoning for Autonomous Driving
  6. 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving
  7. 2026SGDrive: Scene-to-Goal Hierarchical World Cognition for Autonomous Driving
  8. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Driving