DGLight: DQN-Guided GRPO Fine-Tuning of Large Language Models for Traffic Signal Control
On the map: LLM reasoning → Chain-of-thought reasoning for driving
Abstract (arXiv)
Traffic signal control (TSC) plays a central role in reducing congestion and maintaining urban mobility. This dissertation introduces DGLight, a critic-guided reinforcement-learning framework for adapting a pretrained large language model to TSC. DGLight first trains a CoLight-based Deep Q-Network critic to estimate traffic-aware action values from structured intersection states, then uses the frozen critic to score candidate language-model actions and optimize the policy with Group Relative Policy Optimization (GRPO). The resulting controller maps traffic states to interpretable reasoning traces and signal decisions while learning from dense per-state supervision rather than raw cumulative environment rewards. Experiments on TSC benchmarks covering Jinan and Hangzhou show that DGLight is the strongest overall method among the compared LLM-based controllers, remains competitive with strong RL baselines, and transfers well to city datasets not used to fit the critic. Qualitative examples further show that the model's generated reasoning is interpretable and aligned with the chosen signal phase. The project code is available hrefhttps://github.com/yyccbb/FYPLLMTSChere.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 13 of its 18 references that are in the map. First posted on arXiv 28 Apr 2026.
Builds on
13 of 18 references.
Closest ancestors · 1
Same direction, newest first
Other references · 12
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2015Trust Region Policy Optimizationcited by 2,503
- 2019CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identificationcited by 119
- 2023LLMLight: Large Language Models as Traffic Signal Control Agentscited by 73
- 2024LLM-Assisted Light: Leveraging Large Language Model Capabilities for Human-Mimetic Traffic Signal Control in Complex Urban Environmentscited by 31
- 2024iLLM-TSC: Integration reinforcement learning and large language model for traffic signal control policy improvementcited by 23
- 2024CoSLight: Co-optimizing Collaborator Selection and Decision-making to Enhance Traffic Signal Controlcited by 7
- 2026LATS: Large Language Model Assisted Teacher-Student Framework for Multi-Agent Reinforcement Learning in Traffic Signal Controlcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025A Dual Large Language Models Architecture with Herald Guided Prompts for Parallel Fine Grained Traffic Signal Control
- 2026ProcessLight: Process Supervision for Large Language Model Based Traffic Signal Control
- 2025Evolutionary Discovery of Heuristic Policies for Traffic Signal Control
- 2023Traffic Signal Control Using Lightweight Transformers: An Offline-to-Online RL Approach
- 2026OracleTSC: Oracle-Informed Reward Hurdle and Uncertainty Regularization for Traffic Signal Control
- 2023A Fully Data-Driven Approach for Realistic Traffic Signal Control Using Offline Reinforcement Learning
- 2025CoLLMLight: Cooperative Large Language Model Agents for Network-Wide Traffic Signal Control
- 2025VLMLight: Safety-Critical Traffic Signal Control via Vision-Language Meta-Control and Dual-Branch Reasoning Architecture