An Offline Meta Black-box Optimization Framework for Adaptive Design of Urban Traffic Light Management Systems
Not on the map. Why?
Abstract (arXiv)
Complex urban road networks with high vehicle occupancy frequently face severe traffic congestion. Designing an effective strategy for managing multiple traffic lights plays a crucial role in managing congestion. However, most current traffic light management systems rely on human-crafted decisions, which may not adapt well to diverse traffic patterns. In this paper, we delve into two pivotal design components of the traffic light management system that can be dynamically adjusted to various traffic conditions: phase combination and phase time allocation. While numerous studies have sought an efficient strategy for managing traffic lights, most of these approaches consider a fixed traffic pattern and are limited to relatively small road networks. To overcome these limitations, we introduce a novel and practical framework to formulate the optimization of such design components using an offline meta black-box optimization. We then present a simple yet effective method to efficiently find a solution for the aforementioned problem. In our framework, we first collect an offline meta dataset consisting of pairs of design choices and corresponding congestion measures from various traffic patterns. After collecting the dataset, we employ the Attentive Neural Process (ANP) to predict the impact of the proposed design on congestion across various traffic patterns with well-calibrated uncertainty. Finally, Bayesian optimization, with ANP as a surrogate model, is utilized to find an optimal design for unseen traffic patterns through limited online simulations. Our experiment results show that our method outperforms state-of-the-art baselines on complex road networks in terms of the number of waiting vehicles. Surprisingly, the deployment of our method into a real-world traffic system was able to improve traffic throughput by 4.80% compared to the original strategy.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 56 references that are in the map. First posted on arXiv 14 Aug 2024.
Builds on
22 of 56 references.
References · 22
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2018Off-Policy Deep Reinforcement Learning without Explorationcited by 1,241
- 2019Stabilizing Off-Policy Q-Learning via Bootstrapping Error Reductioncited by 840
- 2018A Tutorial on Bayesian Optimizationcited by 744
- 2018Neural Processescited by 311
- 2019Attentive Neural Processescited by 283
- 2014Predictive Entropy Search for Efficient Global Optimization of Black-box Functionscited by 204
- 2019Multi-Agent Deep Reinforcement Learning for Large-scale Traffic Signal Controlcited by 164
- 2019Convolutional Conditional Neural Processescited by 142
- 2019CoLight: Learning Network-level Cooperation for Traffic Signal Controlcited by 138
10 more
- 2022Transformer Neural Processes: Uncertainty-Aware Meta Learning Via Sequence Modelingcited by 127
- 2019Influence-Based Multi-Agent Explorationcited by 75
- 2021Few-Shot Bayesian Optimization with Deep Kernel Surrogatescited by 71
- 2017Traffic Light Control Using Deep Policy-Gradient and Value-Function Based Reinforcement Learningcited by 33
- 2023Discovering Attention-Based Genetic Algorithms via Meta-Black-Box Optimizationcited by 33
- 2016Using a Deep Reinforcement Learning Agent for Traffic Signal Controlcited by 26
- 2020GeneraLight: Improving Environment Generalization of Traffic Signal Control via Meta Reinforcement Learningcited by 17
- 2022SafeLight: A Reinforcement Learning Method toward Collision-free Traffic Signal Controlcited by 15
- 2022The Real Deal: A Review of Challenges and Opportunities in Moving Reinforcement Learning-Based Traffic Signal Control Systems Towards Realitycited by 9
- 2022Safe and Psychologically Pleasant Traffic Signal Control with Reinforcement Learning using Action Maskingcited by 6
Built on by
Not cited yet.