VLALight: A Vision-Language-Action Model for Traffic Signal Control
Not on the map. Why?
Abstract (arXiv)
Traffic signal control (TSC) is essential for improving urban mobility and reducing congestion. Although roadside cameras are widely deployed at signalized intersections and provide rich visual observations of evolving traffic, existing TSC methods typically rely on manually engineered traffic states or separate perception modules, creating a gap between physical observations and control decisions. We present VLALight, the first vision-language-action (VLA) model for end-to-end traffic signal control from multi-view roadside videos. VLALight directly maps visual observations to coordinated signal actions through multi-target spatiotemporal traffic reasoning and topology-aware cooperative perception across intersections. To establish this capability, we develop a two-stage supervised cold-start training strategy for visual traffic understanding and signal decision-making, followed by cooperative agentic reinforcement learning that jointly optimizes local control and network-wide traffic efficiency. Furthermore, VLALight introduces adaptive fast and slow reasoning modes, enabling the policy to allocate deeper reasoning only when additional deliberation provides sufficient control benefits. Through balanced mode-aware rollouts and relative advantage optimization, VLALight learns to trade off decision quality and inference cost. Extensive experiments on seven real-world traffic-flow datasets across three urban networks demonstrate that VLALight consistently outperforms transportation-based, RL-based, and LLM/VLM-based baselines. Ablation studies validate the effectiveness of cooperative perception, network-level optimization, and adaptive reasoning. These results demonstrate the potential of VLA models for real-world physical traffic control. Our project is available at https://github.com/usail-hkust/VLALight.git.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 29 of its 56 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
29 of 56 references.
References · 29
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,022
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,823
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 656
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 343
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 335
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 254
- 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 183
- 2019CoLight: Learning Network-level Cooperation for Traffic Signal Controlcited by 134
- 2023Vision Language Models in Autonomous Driving: A Survey and Outlookcited by 126
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulationcited by 102
- 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Modelscited by 91
- 2019Learning Phase Competition for Traffic Signal Controlcited by 84
17 more
- 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Cachingcited by 84
- 2019A Survey on Traffic Signal Control Methodscited by 78
- 2023LLMLight: Large Language Models as Traffic Signal Control Agentscited by 73
- 2020AttendLight: Universal Attention-Based Reinforcement Learning Model for Traffic Signal Controlcited by 60
- 2024LLM-Assisted Light: Leveraging Large Language Model Capabilities for Human-Mimetic Traffic Signal Control in Complex Urban Environmentscited by 31
- 2021Expression might be enough: representing pressure and demand for reinforcement learning based traffic signal controlcited by 28
- 2021Efficient Pressure: Improving efficiency for signalized intersectionscited by 24
- 2024iLLM-TSC: Integration reinforcement learning and large language model for traffic signal control policy improvementcited by 23
- 2020IG-RL: Inductive Graph Reinforcement Learning for Massive-Scale Traffic Signal Controlcited by 21
- 2025CoLLMLight: Cooperative Large Language Model Agents for Network-Wide Traffic Signal Controlcited by 15
- 2023Reinforcement Learning Approaches for Traffic Signal Control under Missing Datacited by 13
- 2025Traffic-R1: Reinforced LLMs Bring Human-Like Reasoning to Traffic Signal Control Systemscited by 12
- 2021DynSTGAT: Dynamic Spatial-Temporal Graph Attention Network for Traffic Signal Controlcited by 11
- 2024CoSLight: Co-optimizing Collaborator Selection and Decision-making to Enhance Traffic Signal Controlcited by 7
- 2025VLMLight: Safety-Critical Traffic Signal Control via Vision-Language Meta-Control and Dual-Branch Reasoning Architecturecited by 3
- 2025TranSimHub:A Unified Air-Ground Simulation Platform for Multi-Modal Perception and Decision-Makingcited by 3
- 2024CityLight: A Neighborhood-inclusive Universal Model for Coordinated City-scale Traffic Signal Controlcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026VLALight: Lightweight Vision-Language-Action Models for Emergency-Aware Traffic Signal Control
- 2026RedLight-VLA: Models for traffic-rule grounding and behavioral emphasis in driving policies
- 2026LATS: Large Language Model Assisted Teacher-Student Framework for Multi-Agent Reinforcement Learning in Traffic Signal Control
- 2026RT-VLA: Real-Time Vision-Language-Action Models via Knowledge Distillation
- 2026Reasoning to Regulate: Chain-of-Thought for Traffic Rule Understanding
- 2026Roadside-Cooperative Autonomous Driving: From Data Platform to Vision-Language End-to-End Reasoning
- 2025VLMPlanner: Integrating Visual Language Models with Motion Planning
- 2026CrashSight: A Phase-Aware, Infrastructure-Centric Video Benchmark for Traffic Crash Scene Understanding and Reasoning