Network-Constrained Policy Optimization for Adaptive Multi-agent Vehicle Routing
Not on the map. Why?
Abstract (arXiv)
Traffic congestion in urban road networks leads to longer trip times and higher emissions, especially during peak periods. While the Shortest Path First (SPF) algorithm is optimal for a single vehicle in a static network, it performs poorly in dynamic, multi-vehicle settings, often worsening congestion by routing all vehicles along identical paths. We address dynamic vehicle routing through a multi-agent reinforcement learning (MARL) framework for coordinated, network-aware fleet navigation. We first propose Adaptive Navigation (AN), a decentralized MARL model where each intersection agent provides routing guidance based on (i) local traffic and (ii) neighborhood state modeled using Graph Attention Networks (GAT). To improve scalability in large networks, we further propose Hierarchical Hub-based Adaptive Navigation (HHAN), an extension of AN that assigns agents only to key intersections (hubs). Vehicles are routed hub-to-hub under agent control, while SPF handles micro-routing within each hub region. For hub coordination, HHAN adopts centralized training with decentralized execution (CTDE) under the Attentive Q-Mixing (A-QMIX) framework, which aggregates asynchronous vehicle decisions via attention. Hub agents use flow-aware state features that combine local congestion and predictive dynamics for proactive routing. Experiments on synthetic grids and real urban maps (Toronto, Manhattan) show that AN reduces average travel time versus SPF and learning baselines, maintaining 100% routing success. HHAN scales to networks with hundreds of intersections, achieving up to 15.9% improvement under heavy traffic. These findings highlight the potential of network-constrained MARL for scalable, coordinated, and congestion-aware routing in intelligent transportation systems.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 17 of its 67 references that are in the map. First posted on arXiv 30 Oct 2025.
Builds on
17 of 67 references.
References · 17
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2018QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 697
- 2019Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithmscited by 555
- 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 433
- 2019A Survey on Traffic Signal Control Methodscited by 78
- 2019Learning from Multiple Cities: A Meta-Learning Approach for Spatial-Temporal Predictioncited by 64
- 2019Deep Reinforcement Learning for Multi-Driver Vehicle Dispatching and Repositioning Problemcited by 29
- 2019Forecaster: A Graph Transformer for Forecasting Spatial and Time-Dependent Datacited by 11
- 2023MAGNNETO: A Graph Neural Network-based Multi-Agent system for Traffic Engineeringcited by 10
- 2020Deep Reinforcement Learning Based Dynamic Route Planning for Minimizing Travel Timecited by 8
5 more
- 2019Hierarchical Deep Double Q-Routingcited by 6
- 2022Feudal Multi-Agent Reinforcement Learning with Adaptive Network Partition for Traffic Signal Controlcited by 3
- 2025Scalable and Reliable Multi-agent Reinforcement Learning for Traffic Assignmentcited by 2
- 2024PathletRL++: Optimizing Trajectory Pathlet Extraction and Dictionary Formation via Reinforcement Learningcited by 1
- 2024TrajLearn: Trajectory Prediction Learning using Deep Generative Modelscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.