DataLight: Offline Data-Driven Traffic Signal Control
Not on the map. Why?
Abstract (arXiv)
Reinforcement learning (RL) has emerged as a promising solution for addressing traffic signal control (TSC) challenges. While most RL-based TSC systems typically employ an online approach, facilitating frequent active interaction with the environment, learning such strategies in the real world is impractical due to safety and risk concerns. To tackle these challenges, this study introduces an innovative offline data-driven approach, called DataLight. DataLight employs effective state representations and reward function by capturing vehicular speed information within the environment. It then segments roads to capture spatial information and further enhances the spatially segmented state representations with sequential modeling. The experimental results demonstrate the effectiveness of DataLight, showcasing superior performance compared to both state-of-the-art online and offline TSC methods. Additionally, DataLight exhibits robust learning capabilities concerning real-world deployment issues. The code is available at https://github.com/LiangZhang1996/DataLight.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 35 references that are in the map. First posted on arXiv 20 Mar 2023.
Builds on
21 of 35 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2017Graph Attention Networkscited by 8,854
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,777
- 2016Generative Adversarial Imitation Learningcited by 1,576
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
- 2018Off-Policy Deep Reinforcement Learning without Explorationcited by 1,227
- 2021A Minimalist Approach to Offline Reinforcement Learningcited by 882
- 2019Stabilizing Off-Policy Q-Learning via Bootstrapping Error Reductioncited by 833
- 2015Dueling Network Architectures for Deep Reinforcement Learningcited by 769
- 2019Behavior Regularized Offline Reinforcement Learningcited by 654
- 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 636
9 more
- 2016Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivationcited by 282
- 2019CoLight: Learning Network-level Cooperation for Traffic Signal Controlcited by 133
- 2019CityFlow: A Multi-Agent Reinforcement Learning Environment for Large Scale City Traffic Scenariocited by 114
- 2019Learning Phase Competition for Traffic Signal Controlcited by 84
- 2019A Survey on Traffic Signal Control Methodscited by 78
- 2020AttendLight: Universal Attention-Based Reinforcement Learning Model for Traffic Signal Controlcited by 60
- 2019Diagnosing Reinforcement Learning for Traffic Signal Controlcited by 33
- 2021Expression might be enough: representing pressure and demand for reinforcement learning based traffic signal controlcited by 28
- 2021Leveraging Queue Length and Attention Mechanisms for Enhanced Traffic Signal Control Optimizationcited by 7
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 0; 2026: 1.
2 papers.