# Traffic-R1: Reinforced LLMs Bring Human-Like Reasoning to Traffic Signal Control Systems

arXiv: https://arxiv.org/abs/2508.02344 · HTML: https://mlsanity.com/paper/2508.02344/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning.
- Builds on 19 of its 58 references that are in the map.
- First posted on arXiv 4 Aug 2025.

## Placed in

- LLM reasoning / [Chain-of-thought reasoning for driving](https://mlsanity.com/lr/chain-of-thought-reasoning-for-driving/)

## Builds on (most cited first, 19 of 19)

- [Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback](https://mlsanity.com/paper/2204.05862/) (2022)
- [DAPO: An Open-Source LLM Reinforcement Learning System at Scale](https://mlsanity.com/paper/2503.14476/) (2025)
- [HybridFlow: A Flexible and Efficient RLHF Framework](https://mlsanity.com/paper/2409.19256/) (2024)
- [DeepSeek-V3 Technical Report](https://mlsanity.com/paper/2412.19437/) (2024)
- [Large Language Models: A Survey](https://mlsanity.com/paper/2402.06196/) (2024)
- [RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learning](https://mlsanity.com/paper/2504.20073/) (2025)
- [Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Models](https://mlsanity.com/paper/2501.09686/) (2025)
- [Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy Optimization](https://mlsanity.com/paper/2210.01241/) (2022)
- [DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Models](https://mlsanity.com/paper/2309.16292/) (2023)
- [Vision Language Models in Autonomous Driving: A Survey and Outlook](https://mlsanity.com/paper/2310.14414/) (2023)
- [A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systems](https://mlsanity.com/paper/2504.09037/) (2025)
- [Faithfulness vs. Plausibility: On the (Un)Reliability of Explanations from Large Language Models](https://mlsanity.com/paper/2402.04614/) (2024)
- [LLMLight: Large Language Models as Traffic Signal Control Agents](https://mlsanity.com/paper/2312.16044/) (2023)
- [LLM-Assisted Light: Leveraging Large Language Model Capabilities for Human-Mimetic Traffic Signal Control in Complex Urban Environments](https://mlsanity.com/paper/2403.08337/) (2024)
- [Efficient Pressure: Improving efficiency for signalized intersections](https://mlsanity.com/paper/2112.02336/) (2021)
- [CoLLMLight: Cooperative Large Language Model Agents for Network-Wide Traffic Signal Control](https://mlsanity.com/paper/2503.11739/) (2025)
- [The Real Deal: A Review of Challenges and Opportunities in Moving Reinforcement Learning-Based Traffic Signal Control Systems Towards Reality](https://mlsanity.com/paper/2206.11996/) (2022)
- [TSCLIP: Robust CLIP Fine-Tuning for Worldwide Cross-Regional Traffic Sign Recognition](https://mlsanity.com/paper/2409.15077/) (2024)
- [VLMLight: Safety-Critical Traffic Signal Control via Vision-Language Meta-Control and Dual-Branch Reasoning Architecture](https://mlsanity.com/paper/2505.19486/) (2025)

## Built on by (most cited first, 13 of 13)

- [TimeOmni-VL: Unified Models for Time Series Understanding and Generation](https://mlsanity.com/paper/2602.17149/) (2026)
- [Urban-R1: Reinforced MLLMs Mitigate Geospatial Biases for Urban General Intelligence](https://mlsanity.com/paper/2510.16555/) (2025)
- [ReRec: Reasoning-Augmented LLM-based Recommendation Assistant via Reinforcement Fine-tuning](https://mlsanity.com/paper/2604.07851/) (2026)
- [A Dual Large Language Models Architecture with Herald Guided Prompts for Parallel Fine Grained Traffic Signal Control](https://mlsanity.com/paper/2511.00136/) (2025)
- [SignalClaw: LLM-Guided Evolutionary Synthesis of Interpretable Traffic Signal Control Skills](https://mlsanity.com/paper/2604.05535/) (2026)
- [LLM Agents for Time-Series: A Survey](https://mlsanity.com/paper/2608.26226/) (2026)
- [ExpressMind: A Multimodal Pretrained Large Language Model for Expressway Operation](https://mlsanity.com/paper/2603.16495/) (2026)
- [CuraLight: Debate-Guided Data Curation for LLM-Centered Traffic Signal Control](https://mlsanity.com/paper/2604.05663/) (2026)
- [DGLight: DQN-Guided GRPO Fine-Tuning of Large Language Models for Traffic Signal Control](https://mlsanity.com/paper/2604.25259/) (2026)
- [ReasonLight: A Multimodal Foundation Model-Enhanced Reinforcement Learning Framework for Zero-Shot Traffic Signal Control](https://mlsanity.com/paper/2605.29425/) (2026)
- [LLM-Based Hierarchical Coordinated Control with Continuation-Aware Policy Learning](https://mlsanity.com/paper/2608.15041/) (2026)
- [ProcessLight: Process Supervision for Large Language Model Based Traffic Signal Control](https://mlsanity.com/paper/2609.22746/) (2026)
- [VLALight: A Vision-Language-Action Model for Traffic Signal Control](https://mlsanity.com/paper/2609.36934/) (2026)

## Abstract (arXiv)

We introduce Traffic-R1, a 3B-parameter foundation model with human-like reasoning for Traffic signal control (TSC), developed via self-exploration and iterative reinforcement of LLM with expert guidance in a simulated traffic environment. Compared with traditional reinforcement learning and recent LLM-based methods, Traffic-R1 offers three main advantages: zero-shot generalization, transferring unchanged to new road networks and out-of-distribution incidents by leveraging internal traffic-control policies and reasoning; a compact 3B-parameter design that supports real-time inference on mobile-class chips for edge deployment; and an explainable TSC process that enables multi-intersection coordination through communication and an asynchronous communication network. Extensive benchmarks show Traffic-R1 outperforms strong baselines and training-intensive RL controllers. In production, the model now manages signals affecting over 55,000 drivers daily, reduces average queue lengths by more than 5%, and halves operator workload. Our model is available at https://huggingface.co/Season998/Traffic-R1.