mlsanityData to 7 Oct 2026

UniTSA: A Universal Reinforcement Learning Framework for V2X Traffic Signal Control

arXiv 2312.05090 ↗First posted 8 Dec 2023eess.SY cs.LG cs.SYcited by 12

Not on the map. Why?

Abstract (arXiv)

Traffic congestion is a persistent problem in urban areas, which calls for the development of effective traffic signal control (TSC) systems. While existing Reinforcement Learning (RL)-based methods have shown promising performance in optimizing TSC, it is challenging to generalize these methods across intersections of different structures. In this work, a universal RL-based TSC framework is proposed for Vehicle-to-Everything (V2X) environments. The proposed framework introduces a novel agent design that incorporates a junction matrix to characterize intersection states, making the proposed model applicable to diverse intersections. To equip the proposed RL-based framework with enhanced capability of handling various intersection structures, novel traffic state augmentation methods are tailor-made for signal light control systems. Finally, extensive experimental results derived from multiple intersection configurations confirm the effectiveness of the proposed framework. The source code in this work is available at https://github.com/wmn7/Universal_Light

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 19 of its 56 references that are in the map. First posted on arXiv 8 Dec 2023.

Builds on

19 of 56 references.

References · 19

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2020Meta-Learning in Neural Networks: A Surveycited by 944
  4. 2020Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixelscited by 573
  5. 2020Reinforcement Learning with Augmented Datacited by 452
  6. 2019Multi-Agent Deep Reinforcement Learning for Large-scale Traffic Signal Controlcited by 159
  7. 2020Generalization in Reinforcement Learning by Soft Data Augmentationcited by 132
  8. 2019Learning Phase Competition for Traffic Signal Controlcited by 84
  9. 2019A Survey on Traffic Signal Control Methodscited by 78
  10. 2020AttendLight: Universal Attention-Based Reinforcement Learning Model for Traffic Signal Controlcited by 60
  11. 2018Deep Reinforcement Learning for Traffic Light Control in Vehicular Networkscited by 51
  12. 2017Traffic Light Control Using Deep Policy-Gradient and Value-Function Based Reinforcement Learningcited by 33
7 more
  1. 2017Deep Deterministic Policy Gradient for Urban Traffic Light Controlcited by 30
  2. 2021Expression might be enough: representing pressure and demand for reinforcement learning based traffic signal controlcited by 28
  3. 20206G for Vehicle-to-Everything (V2X) Communications: Enabling Technologies, Challenges, and Opportunitiescited by 24
  4. 2022EMVLight: a Multi-agent Reinforcement Learning Framework for an Emergency Vehicle Decentralized Routing and Traffic Signal Control Systemcited by 9
  5. 2022CoTV: Cooperative Control for Traffic Light Signals and Connected Autonomous Vehicles using Deep Reinforcement Learningcited by 5
  6. 2022A Bibliometric Analysis and Review on Reinforcement Learning for Transportation Applicationscited by 2
  7. 2020Road State Inference via Channel State Informationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 4; 2026: 5.

12 papers.

  1. 2024LLM-Assisted Light: Leveraging Large Language Model Capabilities for Human-Mimetic Traffic Signal Control in Complex Urban Environmentscited by 31
  2. 2024iLLM-TSC: Integration reinforcement learning and large language model for traffic signal control policy improvementcited by 23
  3. 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
  4. 2024Towards Multi-agent Reinforcement Learning based Traffic Signal Control through Spatio-temporal Hypergraphscited by 5
  5. 2025VLMLight: Safety-Critical Traffic Signal Control via Vision-Language Meta-Control and Dual-Branch Reasoning Architecturecited by 3
  6. 2025A Dual Large Language Models Architecture with Herald Guided Prompts for Parallel Fine Grained Traffic Signal Controlcited by 2
  7. 2025Unicorn: A Universal and Collaborative Reinforcement Learning Approach Towards Generalizable Network-Wide Traffic Signal Controlcited by 1
  8. 2026LATS: Large Language Model Assisted Teacher-Student Framework for Multi-Agent Reinforcement Learning in Traffic Signal Controlcited by 1
  9. 2026Heterogeneous Vertiport Selection Optimization for On-Demand Air Taxi Services: A Deep Reinforcement Learning Approachcited by 0
  10. 2026CuraLight: Debate-Guided Data Curation for LLM-Centered Traffic Signal Controlcited by 0
  11. 2026OracleTSC: Oracle-Informed Reward Hurdle and Uncertainty Regularization for Traffic Signal Controlcited by 0
  12. 2026ReasonLight: A Multimodal Foundation Model-Enhanced Reinforcement Learning Framework for Zero-Shot Traffic Signal Controlcited by 0