SignReasoner: Compositional Reasoning for Complex Traffic Sign Understanding via Functional Structure Units
On the map: LLM reasoning → Chain-of-thought reasoning for driving
Abstract (arXiv)
Accurate semantic understanding of complex traffic signs-including those with intricate layouts, multi-lingual text, and composite symbols-is critical for autonomous driving safety. Current models, both specialized small ones and large Vision Language Models (VLMs), suffer from a significant bottleneck: a lack of compositional generalization, leading to failure when encountering novel sign configurations. To overcome this, we propose SignReasoner, a novel paradigm that transforms general VLMs into expert traffic sign reasoners. Our core innovation is Functional Structure Unit (FSU), which shifts from common instance-based modeling to flexible function-based decomposition. By breaking down complex signs into minimal, core functional blocks (e.g., Direction, Notice, Lane), our model learns the underlying structural grammar, enabling robust generalization to unseen compositions. We define this decomposition as the FSU-Reasoning task and introduce a two-stage VLM post-training pipeline to maximize performance: Iterative Caption-FSU Distillation that enhances the model's accuracy in both FSU-reasoning and caption generation; FSU-GRPO that uses Tree Edit Distance (TED) to compute FSU differences as the rewards in GRPO algorithm, boosting reasoning abilities. Experiments on the newly proposed FSU-Reasoning benchmark, TrafficSignEval, show that SignReasoner achieves new SOTA with remarkable data efficiency and no architectural modification, significantly improving the traffic sign understanding in various VLMs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 18 of its 44 references that are in the map. First posted on arXiv 12 Apr 2026.
Builds on
18 of 44 references.
References · 18
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2023Qwen Technical Reportcited by 3,344
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
6 more
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningcited by 303
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
- 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 135
- 2024VLM-RL: A Unified Vision Language Models and Reinforcement Learning Framework for Safe Autonomous Drivingcited by 51
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Reasoning to Regulate: Chain-of-Thought for Traffic Rule Understanding
- 2026DriveCombo: Benchmarking Compositional Traffic Rule Reasoning in Autonomous Driving
- 2025Mapillary Vistas Validation for Fine-Grained Traffic Signs: A Benchmark Revealing Vision-Language Model Limitations
- 2024Cross-domain Multi-step Thinking: Zero-shot Fine-grained Traffic Sign Recognition in the Wild
- 2025DriveQA: Passing the Driving Knowledge Test
- 2026Traffic Sign Recognition in Autonomous Driving: Dataset, Benchmark, and Field Experiment
- 2026Bridging Structure and Language: Graph-Based Visual Reasoning for Autonomous Road Understanding
- 2025SignRAG: A Retrieval-Augmented System for Scalable Zero-Shot Road Sign Recognition