DriveCombo: Benchmarking Compositional Traffic Rule Reasoning in Autonomous Driving
On the map: LLM reasoning → Chain-of-thought reasoning for driving
also in 2 more
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) are rapidly becoming the intelligence brain of end-to-end autonomous driving systems. A key challenge is to assess whether MLLMs can truly understand and follow complex real-world traffic rules. However, existing benchmarks mainly focus on single-rule scenarios like traffic sign recognition, neglecting the complexity of multi-rule concurrency and conflicts in real driving. Consequently, models perform well on simple tasks but often fail or violate rules in real world complex situations. To bridge this gap, we propose DriveCombo, a text and vision-based benchmark for compositional traffic rule reasoning. Inspired by human drivers' cognitive development, we propose a systematic Five-Level Cognitive Ladder that evaluates reasoning from single-rule understanding to multi-rule integration and conflict resolution, enabling quantitative assessment across cognitive stages. We further propose a Rule2Scene Agent that maps language-based traffic rules to dynamic driving scenes through rule crafting and scene generation, enabling scene-level traffic rule visual reasoning. Evaluations of 14 mainstream MLLMs reveal performance drops as task complexity grows, particularly during rule conflicts. After splitting the dataset and fine-tuning on the training set, we further observe substantial improvements in both traffic rule reasoning and downstream planning capabilities. These results highlight the effectiveness of DriveCombo in advancing compliant and intelligent autonomous driving systems.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 19 of its 57 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
19 of 57 references.
References · 19
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Gemma 3 Technical Reportcited by 1,686
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 571
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 439
- 2023GPT-Driver: Learning to Drive with GPTcited by 344
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
7 more
- 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Modelscited by 204
- 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Drivingcited by 188
- 2023A Language Agent for Autonomous Drivingcited by 161
- 2019Talk2Car: Taking Control of Your Self-Driving Carcited by 141
- 2025Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data, and Metric Perspectivescited by 120
- 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
- 2024RAC3: Retrieval-Augmented Corner Case Comprehension for Autonomous Driving with Vision-Language Modelscited by 7
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Large Multimodal Agents for Intelligent Transportation Systems: Architectures, Evidence, and Deployment Challengescited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Drivingcited by 0
- 2026InsClaimBench: Benchmarking Insurance Claim Adjudication Across the Decision Chaincited by 0
- 2026InsClaimBench: Benchmarking Insurance Claim Adjudication Across the Decision Chain7 Oct 2026
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving31 Aug 2026
- 2026Large Multimodal Agents for Intelligent Transportation Systems: Architectures, Evidence, and Deployment Challenges8 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Reasoning to Regulate: Chain-of-Thought for Traffic Rule Understanding
- 2025DriveQA: Passing the Driving Knowledge Test
- 2025Fine-Grained Evaluation of Large Vision-Language Models in Autonomous Driving
- 2026A Survey of Reasoning in Autonomous Driving Systems: Open Challenges and Emerging Paradigms
- 2023Reason2Drive: Towards Interpretable and Chain-based Reasoning for Autonomous Driving
- 2026V2X-QA: A Comprehensive Reasoning Dataset and Benchmark for Multimodal Large Language Models in Autonomous Driving Across Ego, Infrastructure, and Cooperative Views
- 2026DRIVESPATIAL: A Benchmark for Spatiotemporal Intelligence in VLMs for Autonomous Driving
- 2026GeoDrive-Bench: Benchmarking Region-Specific Multimodal Reasoning in Autonomous Driving