VLMLight: Safety-Critical Traffic Signal Control via Vision-Language Meta-Control and Dual-Branch Reasoning Architecture
On the map: LLM reasoning → Chain-of-thought reasoning for driving
Abstract (arXiv)
Traffic signal control (TSC) is a core challenge in urban mobility, where real-time decisions must balance efficiency and safety. Existing methods - ranging from rule-based heuristics to reinforcement learning (RL) - often struggle to generalize to complex, dynamic, and safety-critical scenarios. We introduce VLMLight, a novel TSC framework that integrates vision-language meta-control with dual-branch reasoning. At the core of VLMLight is the first image-based traffic simulator that enables multi-view visual perception at intersections, allowing policies to reason over rich cues such as vehicle type, motion, and spatial density. A large language model (LLM) serves as a safety-prioritized meta-controller, selecting between a fast RL policy for routine traffic and a structured reasoning branch for critical cases. In the latter, multiple LLM agents collaborate to assess traffic phases, prioritize emergency vehicles, and verify rule compliance. Experiments show that VLMLight reduces waiting times for emergency vehicles by up to 65% over RL-only systems, while preserving real-time performance in standard conditions with less than 1% degradation. VLMLight offers a scalable, interpretable, and safety-aware solution for next-generation traffic signal control.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 25 of its 46 references that are in the map. First posted on arXiv 26 May 2025.
Builds on
25 of 46 references.
References · 25
- 2023GPT-4 Technical Reportcited by 18,396
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learningcited by 290
- 2019Multi-Agent Deep Reinforcement Learning for Large-scale Traffic Signal Controlcited by 164
- 2019CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identificationcited by 119
- 2019A Survey on Traffic Signal Control Methodscited by 79
- 2023LLMLight: Large Language Models as Traffic Signal Control Agentscited by 73
13 more
- 2020AttendLight: Universal Attention-Based Reinforcement Learning Model for Traffic Signal Controlcited by 62
- 2018Deep Reinforcement Learning for Traffic Light Control in Vehicular Networkscited by 52
- 2024LLM-Assisted Light: Leveraging Large Language Model Capabilities for Human-Mimetic Traffic Signal Control in Complex Urban Environmentscited by 31
- 2024iLLM-TSC: Integration reinforcement learning and large language model for traffic signal control policy improvementcited by 23
- 2022LibSignal: An Open Library for Traffic Signal Controlcited by 16
- 2022SafeLight: A Reinforcement Learning Method toward Collision-free Traffic Signal Controlcited by 15
- 2023Reinforcement Learning Approaches for Traffic Signal Control under Missing Datacited by 13
- 2023UniTSA: A Universal Reinforcement Learning Framework for V2X Traffic Signal Controlcited by 13
- 2021A Decentralized Reinforcement Learning Framework for Efficient Passage of Emergency Vehiclescited by 9
- 2024Traffic Signal Cycle Control with Centralized Critic and Decentralized Actors under Varying Intervention Frequenciescited by 6
- 2024MalLight: Influence-Aware Coordinated Traffic Signal Control for Traffic Signal Malfunctionscited by 5
- 2024SynTraC: A Synthetic Dataset for Traffic Signal Control from Traffic Monitoring Camerascited by 4
- 2024DiffLight: A Partial Rewards Conditioned Diffusion Model for Traffic Signal Control with Missing Datacited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025Traffic-R1: Reinforced LLMs Bring Human-Like Reasoning to Traffic Signal Control Systemscited by 12
- 2026ReasonLight: A Multimodal Foundation Model-Enhanced Reinforcement Learning Framework for Zero-Shot Traffic Signal Controlcited by 0
- 2026VLALight: A Vision-Language-Action Model for Traffic Signal Controlcited by 0
- 2026VLALight: A Vision-Language-Action Model for Traffic Signal Control29 Sep 2026
- 2026ReasonLight: A Multimodal Foundation Model-Enhanced Reinforcement Learning Framework for Zero-Shot Traffic Signal Control28 May 2026
- 2025Traffic-R1: Reinforced LLMs Bring Human-Like Reasoning to Traffic Signal Control Systems4 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2026VLALight: Lightweight Vision-Language-Action Models for Emergency-Aware Traffic Signal Control
- 2026RedLight-VLA: Models for traffic-rule grounding and behavioral emphasis in driving policies
- 2025VLMPlanner: Integrating Visual Language Models with Motion Planning
- 2026ProcessLight: Process Supervision for Large Language Model Based Traffic Signal Control
- 2024MTLight: Efficient Multi-Task Reinforcement Learning for Traffic Signal Control
- 2023Traffic Signal Control Using Lightweight Transformers: An Offline-to-Online RL Approach
- 2025CoLLMLight: Cooperative Large Language Model Agents for Network-Wide Traffic Signal Control
- 2026Explainable Reinforcement Learning for Adaptive Traffic Signal Control