Reasoning to Regulate: Chain-of-Thought for Traffic Rule Understanding
On the map: LLM reasoning → Chain-of-thought reasoning for driving
Abstract (arXiv)
Understanding and complying with traffic regulations is a safety-critical requirement for autonomous driving, yet remains challenging due to the diversity and context dependence of traffic signage. Importantly, regulation understanding is not a simple recognition task, but a reasoning problem: whether a rule applies depends on interpreting the sign in relation to the spatial layout of lanes and scene context. To support such reasoning, MapDR provide fine-grained annotations that link each traffic sign's regulatory rules to the specific lanes they govern. Existing methods, however, largely treat this as direct sequence prediction, ignoring the underlying reasoning that connects sign semantics and map structure. To address this limitation, we explicitly incorporate reasoning into this task and propose a framework that equips vision-language models (VLMs) with chain-of-thought (CoT) capabilities. We first design a scalable CoT curation pipeline that bootstraps rationales from a strong LLM through a two-round strategy and employs a VLM-based verifier to filter out incorrect cases, yielding a high-quality set of (CoT, answer) pairs. Building on this foundation, we adopt a two-stage training scheme: supervised fine-tuning (SFT) to teach rationale-to-answer generation, followed by GRPO reinforcement learning with answer-grounded, fine-grained rewards to further improve final answer accuracy. Extensive experiments on MapDR show that our approach significantly improves both interpretability and accuracy, establishing the first reasoning-based framework for regulation-aware autonomous driving.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 42 of its 48 references that are in the map. First posted on arXiv 27 Jul 2026.
Builds on
42 of 48 references.
Closest ancestors · 7
Same direction, newest first
- 2025AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving21 May
- 2025OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoning6 Apr
- 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoning10 Mar
- 2025CoT-Drive: Efficient Motion Forecasting for Autonomous Driving with LLMs and Chain-of-Thought Prompting10 Mar
- 2024VLM-AD: End-to-End Autonomous Driving through Vision-Language Model Supervision19 Dec
- 2024PKRD-CoT: A Unified Chain-of-thought Prompting for Multi-Modal Large Language Models in Autonomous Driving2 Dec
- 2024DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Driving25 Mar
Other references · 35
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023Let's Verify Step by Stepcited by 3,789
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
- 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 494
23 more
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 461
- 2023Fine-Grained Human Feedback Gives Better Rewards for Language Model Trainingcited by 401
- 2016Solving General Arithmetic Word Problemscited by 360
- 2024Direct Language Model Alignment from Online AI Feedbackcited by 260
- 2023Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Drivingcited by 232
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Modelscited by 212
- 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
- 2023OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mappingcited by 83
- 2024Evaluating Mathematical Reasoning Beyond Accuracycited by 69
- 2025BREAD: Branched Rollouts from Expert Anchors Bridge SFT & RL for Reasoningcited by 63
- 2023A Comprehensive Analysis of the Effectiveness of Large Language Models as Automatic Dialogue Evaluatorscited by 45
- 2023LATR: 3D Lane Detection from Monocular Images with Transformercited by 44
- 2023TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoningcited by 41
- 2025Unveiling the Key Factors for Distilling Chain-of-Thought Reasoningcited by 40
- 2023LogiCoT: Logical Chain-of-Thought Instruction-Tuningcited by 31
- 2024RoboTron-Drive: All-in-One Large Multimodal Model for Autonomous Drivingcited by 30
- 2024TopoLogic: An Interpretable Pipeline for Lane Topology Reasoning on Driving Scenescited by 29
- 2025Sce2DriveX: A Generalized MLLM Framework for Scene-to-Drive Learningcited by 25
- 2024RoadPainter: Points Are Ideal Navigators for Topology transformERcited by 17
- 2025Generative Planning with 3D-vision Language Pre-training for End-to-End Autonomous Drivingcited by 16
- 2024Driving by the Rules: A Benchmark for Integrating Traffic Sign Regulations into Vectorized HD Mapcited by 11
- 2024DV-3DLane: End-to-end Multi-modal 3D Lane Detection with Dual-view Representationcited by 9
- 2024Anchor3DLane++: 3D Lane Detection via Sample-Adaptive Sparse 3D Anchor Regressioncited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DriveCombo: Benchmarking Compositional Traffic Rule Reasoning in Autonomous Driving
- 2026SignReasoner: Compositional Reasoning for Complex Traffic Sign Understanding via Functional Structure Units
- 2025DriveQA: Passing the Driving Knowledge Test
- 2026Bridging Structure and Language: Graph-Based Visual Reasoning for Autonomous Road Understanding
- 2025Mapillary Vistas Validation for Fine-Grained Traffic Signs: A Benchmark Revealing Vision-Language Model Limitations
- 2023Reason2Drive: Towards Interpretable and Chain-based Reasoning for Autonomous Driving
- 2025Fine-Grained Evaluation of Large Vision-Language Models in Autonomous Driving
- 2024Driving with Regulation: Trustworthy and Interpretable Decision-Making for Autonomous Driving with Retrieval-Augmented Reasoning