CoLight: Learning Network-level Cooperation for Traffic Signal Control
Not on the map. Why?
Abstract (arXiv)
Cooperation among the traffic signals enables vehicles to move through intersections more quickly. Conventional transportation approaches implement cooperation by pre-calculating the offsets between two intersections. Such pre-calculated offsets are not suitable for dynamic traffic environments. To enable cooperation of traffic signals, in this paper, we propose a model, CoLight, which uses graph attentional networks to facilitate communication. Specifically, for a target intersection in a network, CoLight can not only incorporate the temporal and spatial influences of neighboring intersections to the target intersection, but also build up index-free modeling of neighboring intersections. To the best of our knowledge, we are the first to use graph attentional networks in the setting of reinforcement learning for traffic signal control and to conduct experiments on the large-scale road network with hundreds of traffic signals. In experiments, we demonstrate that by learning the communication, the proposed model can achieve superior performance against the state-of-the-art methods.
Key facts. Cited by 133 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 18; 2023: 24; 2024: 19; 2025: 27; 2026: 23.
133 papers.
Sort:
By area:
- 2023LLMLight: Large Language Models as Traffic Signal Control Agentscited by 73
- 2023Open-TI: Open Traffic Intelligence with Augmented Language Modelcited by 38
- 2023Urban Generative Intelligence (UGI): A Foundational Platform for Agents in Embodied City Environmentcited by 37
- 2023Prompt to Transfer: Sim-to-Real Transfer for Traffic Signal Control with Prompt Learningcited by 36
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Modelscited by 36
- 2021Expression might be enough: representing pressure and demand for reinforcement learning based traffic signal controlcited by 28
- 2021Efficient Pressure: Improving efficiency for signalized intersectionscited by 24
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Surveycited by 23
- 2021The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learningcited by 23
- 2021Intelligent Electric Vehicle Charging Recommendation Based on Multi-Agent Reinforcement Learningcited by 20
- 2022LibSignal: An Open Library for Traffic Signal Controlcited by 16
- 2025CoLLMLight: Cooperative Large Language Model Agents for Network-Wide Traffic Signal Controlcited by 15
38 more
- 2021Reinforcement Learning for Mixed Autonomy Intersectionscited by 14
- 2022Unified Automatic Control of Vehicular Systems with Reinforcement Learningcited by 13
- 2023Reinforcement Learning Approaches for Traffic Signal Control under Missing Datacited by 13
- 2021Network-wide traffic signal control optimization using a multi-agent deep reinforcement learningcited by 12
- 2021DynSTGAT: Dynamic Spatial-Temporal Graph Attention Network for Traffic Signal Controlcited by 11
- 2022Multi-Agent Reinforcement Learning for Traffic Signal Control through Universal Communication Methodcited by 10
- 2024X-Light: Cross-City Traffic Signal Control Using Transformer on Transformer as Meta Multi-Agent Reinforcement Learnercited by 10
- 2022EMVLight: a Multi-agent Reinforcement Learning Framework for an Emergency Vehicle Decentralized Routing and Traffic Signal Control Systemcited by 9
- 2023DuaLight: Enhancing Traffic Signal Control by Leveraging Scenario-Specific and Scenario-Shared Knowledgecited by 9
- 2021A Decentralized Reinforcement Learning Framework for Efficient Passage of Emergency Vehiclescited by 8
- 2021ModelLight: Model-Based Meta-Reinforcement Learning for Traffic Signal Controlcited by 8
- 2022The Real Deal: A Review of Challenges and Opportunities in Moving Reinforcement Learning-Based Traffic Signal Control Systems Towards Realitycited by 8
- 2021Leveraging Queue Length and Attention Mechanisms for Enhanced Traffic Signal Control Optimizationcited by 7
- 2023DenseLight: Efficient Control for Large-scale Traffic Signals with Dense Feedbackcited by 7
- 2023Multi-Agent Reinforcement Learning Based on Representational Communication for Large-Scale Traffic Signal Controlcited by 7
- 2024CoSLight: Co-optimizing Collaborator Selection and Decision-making to Enhance Traffic Signal Controlcited by 7
- 2021MetaVIM: Meta Variationally Intrinsic Motivated Reinforcement Learning for Decentralized Traffic Signal Controlcited by 6
- 2021Learning to Simulate on Sparse Trajectory Datacited by 6
- 2022CBLab: Supporting the Training of Large-scale Traffic Control Policies with Scalable Traffic Simulationcited by 6
- 2023Scalable Communication for Multi-Agent Reinforcement Learning via Transformer-Based Email Mechanismcited by 6
- 2023Large-Scale Traffic Signal Control Using Constrained Network Partition and Adaptive Deep Reinforcement Learningcited by 6
- 2021Independent Reinforcement Learning for Weakly Cooperative Multiagent Traffic Control Problemcited by 5
- 2022Model-based graph reinforcement learning for inductive traffic signal controlcited by 5
- 2022Reinforcement learning for traffic signal control in hybrid action spacecited by 5
- 2023SocialLight: Distributed Cooperation Learning towards Network-Wide Traffic Signal Controlcited by 5
- 2023Improving the generalizability and robustness of large-scale traffic signal controlcited by 5
- 2024Towards Multi-agent Reinforcement Learning based Traffic Signal Control through Spatio-temporal Hypergraphscited by 5
- 2024MalLight: Influence-Aware Coordinated Traffic Signal Control for Traffic Signal Malfunctionscited by 5
- 2025USTBench: Benchmarking and Dissecting Spatiotemporal Reasoning of LLMs as Urban Agentscited by 5
- 2021Multi-intersection Traffic Optimisation: A Benchmark Dataset and a Strong Baselinecited by 4
- 2021Deep Reinforcement Q-Learning for Intelligent Traffic Signal Control with Partial Detectioncited by 4
- 2021Learning to Share in Multi-Agent Reinforcement Learningcited by 4
- 2024DiffLight: A Partial Rewards Conditioned Diffusion Model for Traffic Signal Control with Missing Datacited by 4
- 2025Large Language Model Powered Intelligent Urban Agents: Concepts, Capabilities, and Applicationscited by 4
- 2021Delayed Propagation Transformer: A Universal Computation Engine towards Practical Control in Cyber-Physical Systemscited by 3
- 2022Learning to Help Emergency Vehicles Arrive Faster: A Cooperative Vehicle-Road Scheduling Approachcited by 3
- 2022TinyLight: Adaptive Traffic Signal Control on Devices with Extremely Limited Resourcescited by 3
- 2022Feudal Multi-Agent Reinforcement Learning with Adaptive Network Partition for Traffic Signal Controlcited by 3
50 most cited of 133 All 133 (JSON)
- 2026VLALight: A Vision-Language-Action Model for Traffic Signal Control29 Sep 2026
- 2026VLALight: Lightweight Vision-Language-Action Models for Emergency-Aware Traffic Signal Control25 Sep 2026
- 2026ProcessLight: Process Supervision for Large Language Model Based Traffic Signal Control19 Sep 2026
- 2026SimTIO: A Simulation-Grounded Multi-Agent LLM Framework for Compositional Traffic Intervention Optimization4 Sep 2026
- 2026LLM Agents for Time-Series: A Survey26 Aug 2026
- 2026Is Per-Agent Policy Composition Safe? Rethinking Successor-Feature Transfer in Cooperative Multi-Agent Reinforcement Learning12 Aug 2026
- 2026Explainable Reinforcement Learning for Adaptive Traffic Signal Control4 Jul 2026
- 2026DSIP: A Dynamic Coordination Planner for Signal-Free Intersections using Diffusion-Model-Based Multi-Agent Motion Planning29 Jun 2026
- 2026Reinforcement Learning-Based Traffic Signal Control for IoT-Enabled Intersections20 Jun 2026
- 2026OverFlowLight: Real-Time Gridlock Prevention and Traffic Signal Optimization for Urban Intersections24 May 2026
- 2026DeCoR: Design and Control Co-Optimization for Urban Streets Using Reinforcement Learning20 May 2026
- 2026Core-Halo Decomposition: Decentralizing Large-Scale Fixed-Point Problems9 May 2026
38 more
- 2026OracleTSC: Oracle-Informed Reward Hurdle and Uncertainty Regularization for Traffic Signal Control8 May 2026
- 2026LLM-Augmented Traffic Signal Control with LSTM-Based Traffic State Prediction and Safety-Constrained Decision Support26 Apr 2026
- 2026TrafficClaw: A Generalizable LLM Agent in the Unified Physical Environment for Urban Traffic Control19 Apr 2026
- 2026C2T: Captioning-Structure and LLM-Aligned Common-Sense Reward Learning for Traffic--Vehicle Coordination10 Apr 2026
- 2026CuraLight: Debate-Guided Data Curation for LLM-Centered Traffic Signal Control7 Apr 2026
- 2026SignalClaw: LLM-Guided Evolutionary Synthesis of Interpretable Traffic Signal Control Skills7 Apr 2026
- 2026CoordLight: Learning Decentralized Coordination for Network-Wide Traffic Signal Control25 Mar 2026
- 2026LATS: Large Language Model Assisted Teacher-Student Framework for Multi-Agent Reinforcement Learning in Traffic Signal Control25 Mar 2026
- 2026Emergency Preemption Without Online Exploration: A Decision Transformer Approach20 Mar 2026
- 2026A Robust and Efficient Multi-Agent Reinforcement Learning Framework for Traffic Signal Control12 Mar 2026
- 2026Spatiotemporal Decision Transformer for Traffic Coordination2 Feb 2026
- 2025CFLight: Enhancing Safety with Traffic Signal Control through Counterfactual Learning10 Dec 2025
- 2025Evolutionary Discovery of Heuristic Policies for Traffic Signal Control28 Nov 2025
- 2025MAESTRO: Multi-Agent Environment Shaping through Task and Reward Optimization24 Nov 2025
- 2025SymLight: Exploring Interpretable and Deployable Symbolic Policies for Traffic Signal Control8 Nov 2025
- 2025A Dual Large Language Models Architecture with Herald Guided Prompts for Parallel Fine Grained Traffic Signal Control31 Oct 2025
- 2025The Distribution Shift Problem in Transportation Networks using Reinforcement Learning and AI18 Sep 2025
- 2025A Hierarchical Deep Reinforcement Learning Framework for Traffic Signal Control with Predictable Cycle Planning3 Sep 2025
- 2025GPLight+: A Genetic Programming Method for Learning Symmetric Traffic Signal Control Policy22 Aug 2025
- 2025A Hierarchical Signal Coordination and Control System Using a Hybrid Model-based and Reinforcement Learning Approach12 Aug 2025
- 2025Bespoke multiresolution analysis of graph signals25 Jul 2025
- 2025Large Language Model Powered Intelligent Urban Agents: Concepts, Capabilities, and Applications1 Jul 2025
- 2025HALO: Hierarchical Reinforcement Learning for Large-Scale Adaptive Traffic Signal Control17 Jun 2025
- 2025Topology-Assisted Spatio-Temporal Pattern Disentangling for Scalable MARL in Large-scale Autonomous Traffic Control14 Jun 2025
- 2025SUMO-MCP: Leveraging the Model Context Protocol for Autonomous Traffic Simulation and Optimization4 Jun 2025
- 2025USTBench: Benchmarking and Dissecting Spatiotemporal Reasoning of LLMs as Urban Agents23 May 2025
- 2025Urban Computing in the Era of Large Language Models2 Apr 2025
- 2025A Constrained Multi-Agent Reinforcement Learning Approach to Autonomous Traffic Signal Control30 Mar 2025
- 2025Generalized Phase Pressure Control Enhanced Reinforcement Learning for Traffic Signal Control26 Mar 2025
- 2025A Parallel Hybrid Action Space Reinforcement Learning Model for Real-world Adaptive Traffic Signal Control18 Mar 2025
- 2025CoLLMLight: Cooperative Large Language Model Agents for Network-Wide Traffic Signal Control14 Mar 2025
- 2025Unicorn: A Universal and Collaborative Reinforcement Learning Approach Towards Generalizable Network-Wide Traffic Signal Control14 Mar 2025
- 2025Enhancing Traffic Signal Control through Model-based Reinforcement Learning and Policy Reuse11 Mar 2025
- 2025Using a single actor to output personalized policy for different intersections10 Mar 2025
- 2025Communication Strategy on Macro-and-Micro Traffic State in Cooperative Deep Reinforcement Learning for Regional Traffic Signal Control18 Feb 2025
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Models18 Feb 2025
- 2025FitLight: Federated Imitation Learning for Plug-and-Play Autonomous Traffic Signal Control17 Feb 2025
- 2025FuzzyLight: A Robust Two-Stage Fuzzy Approach for Traffic Signal Control Works in Real Cities27 Jan 2025
50 newest of 133 All 133 (JSON)
- 2023LLMLight: Large Language Models as Traffic Signal Control Agentscited by 73
- 2023Urban Generative Intelligence (UGI): A Foundational Platform for Agents in Embodied City Environmentcited by 37
- 2025CoLLMLight: Cooperative Large Language Model Agents for Network-Wide Traffic Signal Controlcited by 15
- 2025Large Language Model Powered Intelligent Urban Agents: Concepts, Capabilities, and Applicationscited by 4
- 2024Knowing What Not to Do: Leverage Language Model Insights for Action Space Pruning in Multi-agent Reinforcement Learningcited by 3
- 2025MAESTRO: Multi-Agent Environment Shaping through Task and Reward Optimizationcited by 1
- 2026LATS: Large Language Model Assisted Teacher-Student Framework for Multi-Agent Reinforcement Learning in Traffic Signal Controlcited by 1
- 2026LLM Agents for Time-Series: A Surveycited by 1
- 2026TrafficClaw: A Generalizable LLM Agent in the Unified Physical Environment for Urban Traffic Controlcited by 0
- 2026SimTIO: A Simulation-Grounded Multi-Agent LLM Framework for Compositional Traffic Intervention Optimizationcited by 0
- 2026SimTIO: A Simulation-Grounded Multi-Agent LLM Framework for Compositional Traffic Intervention Optimization4 Sep 2026
- 2026LLM Agents for Time-Series: A Survey26 Aug 2026
- 2026TrafficClaw: A Generalizable LLM Agent in the Unified Physical Environment for Urban Traffic Control19 Apr 2026
- 2026LATS: Large Language Model Assisted Teacher-Student Framework for Multi-Agent Reinforcement Learning in Traffic Signal Control25 Mar 2026
- 2025MAESTRO: Multi-Agent Environment Shaping through Task and Reward Optimization24 Nov 2025
- 2025Large Language Model Powered Intelligent Urban Agents: Concepts, Capabilities, and Applications1 Jul 2025
- 2025CoLLMLight: Cooperative Large Language Model Agents for Network-Wide Traffic Signal Control14 Mar 2025
- 2024Knowing What Not to Do: Leverage Language Model Insights for Action Space Pruning in Multi-agent Reinforcement Learning27 May 2024
- 2023LLMLight: Large Language Models as Traffic Signal Control Agents26 Dec 2023
- 2023Urban Generative Intelligence (UGI): A Foundational Platform for Agents in Embodied City Environment19 Dec 2023
- 2024OffLight: An Offline Multi-Agent Reinforcement Learning Framework for Traffic Signal Controlcited by 3
- 2023A Fully Data-Driven Approach for Realistic Traffic Signal Control Using Offline Reinforcement Learningcited by 1
- 2025FitLight: Federated Imitation Learning for Plug-and-Play Autonomous Traffic Signal Controlcited by 0
- 2026Emergency Preemption Without Online Exploration: A Decision Transformer Approachcited by 0
- 2026Emergency Preemption Without Online Exploration: A Decision Transformer Approach20 Mar 2026
- 2025FitLight: Federated Imitation Learning for Plug-and-Play Autonomous Traffic Signal Control17 Feb 2025
- 2024OffLight: An Offline Multi-Agent Reinforcement Learning Framework for Traffic Signal Control10 Nov 2024
- 2023A Fully Data-Driven Approach for Realistic Traffic Signal Control Using Offline Reinforcement Learning27 Nov 2023
- 2023Open-TI: Open Traffic Intelligence with Augmented Language Modelcited by 38
- 2023Prompt to Transfer: Sim-to-Real Transfer for Traffic Signal Control with Prompt Learningcited by 36
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Modelscited by 36
- 2021Expression might be enough: representing pressure and demand for reinforcement learning based traffic signal controlcited by 28
- 2021Efficient Pressure: Improving efficiency for signalized intersectionscited by 24
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Surveycited by 23
- 2021The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learningcited by 23
- 2021Intelligent Electric Vehicle Charging Recommendation Based on Multi-Agent Reinforcement Learningcited by 20
- 2022LibSignal: An Open Library for Traffic Signal Controlcited by 16
- 2021Reinforcement Learning for Mixed Autonomy Intersectionscited by 14
- 2022Unified Automatic Control of Vehicular Systems with Reinforcement Learningcited by 13
- 2023Reinforcement Learning Approaches for Traffic Signal Control under Missing Datacited by 13
12 most cited of 116 All 116 (JSON)
- 2026VLALight: A Vision-Language-Action Model for Traffic Signal Control29 Sep 2026
- 2026VLALight: Lightweight Vision-Language-Action Models for Emergency-Aware Traffic Signal Control25 Sep 2026
- 2026Is Per-Agent Policy Composition Safe? Rethinking Successor-Feature Transfer in Cooperative Multi-Agent Reinforcement Learning12 Aug 2026
- 2026Explainable Reinforcement Learning for Adaptive Traffic Signal Control4 Jul 2026
- 2026DSIP: A Dynamic Coordination Planner for Signal-Free Intersections using Diffusion-Model-Based Multi-Agent Motion Planning29 Jun 2026
- 2026Reinforcement Learning-Based Traffic Signal Control for IoT-Enabled Intersections20 Jun 2026
- 2026OverFlowLight: Real-Time Gridlock Prevention and Traffic Signal Optimization for Urban Intersections24 May 2026
- 2026DeCoR: Design and Control Co-Optimization for Urban Streets Using Reinforcement Learning20 May 2026
- 2026Core-Halo Decomposition: Decentralizing Large-Scale Fixed-Point Problems9 May 2026
- 2026OracleTSC: Oracle-Informed Reward Hurdle and Uncertainty Regularization for Traffic Signal Control8 May 2026
- 2026LLM-Augmented Traffic Signal Control with LSTM-Based Traffic State Prediction and Safety-Constrained Decision Support26 Apr 2026
- 2026C2T: Captioning-Structure and LLM-Aligned Common-Sense Reward Learning for Traffic--Vehicle Coordination10 Apr 2026
12 newest of 116 All 116 (JSON)