VLALight: Lightweight Vision-Language-Action Models for Emergency-Aware Traffic Signal Control
Not on the map. Why?
Abstract (arXiv)
Traffic signal control (TSC) is essential for mitigating urban congestion. Recent advances in vision-language models (VLMs) enable richer interpretation of intersection scenes, opening new opportunities for visual-context-aware TSC. However, the loose coupling and repeated information conversion between modules can lead to the loss of fine-grained visual details, while sequential inference introduces substantial latency. To address these limitations, we propose VLALight, a lightweight end-to-end vision-language-action framework that directly maps intersection observations and signal-phase information to discrete signal actions. To handle the multi-view nature of TSC, VLALight combines multiple directional camera views into a unified visual input and uses textual instructions to establish their correspondence with traffic movements and signal phases. This design enables direct action prediction with a compact 0.5 B-parameter model, without intermediate image-to-text descriptions or handcrafted traffic-state representations. Experiments show that VLALight delivers the best emergency-vehicle service of all compared methods, reducing pooled emergency waiting time by 21.1% over the cascaded VLMLight while running in real time on local hardware and generalizing to unseen intersection topologies and traffic-flow patterns.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 25 Sep 2026.
Builds on
20 of 35 references.
References · 20
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2015Deep Reinforcement Learning with Double Q-learningcited by 1,745
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
8 more
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 145
- 2019CoLight: Learning Network-level Cooperation for Traffic Signal Controlcited by 138
- 2023LLMLight: Large Language Models as Traffic Signal Control Agentscited by 73
- 2025SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learningcited by 72
- 2020AttendLight: Universal Attention-Based Reinforcement Learning Model for Traffic Signal Controlcited by 62
- 2023Prompt to Transfer: Sim-to-Real Transfer for Traffic Signal Control with Prompt Learningcited by 36
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
- 2024Large Language Models (LLMs) as Traffic Control Systems at Urban Intersections: A New Paradigmcited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026VLALight: A Vision-Language-Action Model for Traffic Signal Control
- 2025VLMLight: Safety-Critical Traffic Signal Control via Vision-Language Meta-Control and Dual-Branch Reasoning Architecture
- 2026CrashSight: A Phase-Aware, Infrastructure-Centric Video Benchmark for Traffic Crash Scene Understanding and Reasoning
- 2026ReasonLight: A Multimodal Foundation Model-Enhanced Reinforcement Learning Framework for Zero-Shot Traffic Signal Control
- 2026RedLight-VLA: Models for traffic-rule grounding and behavioral emphasis in driving policies
- 2024LLM-Assisted Light: Leveraging Large Language Model Capabilities for Human-Mimetic Traffic Signal Control in Complex Urban Environments
- 2025STER-VLM: Spatio-Temporal With Enhanced Reference Vision-Language Models
- 2025ChatBEV: Empowering Traffic Scene Understanding and Simulation via Vision-Language Model