Learning to Design City-scale Transit Routes
Not on the map. Why?
Abstract (arXiv)
Designing efficient transit route networks is an NP-hard problem with exponentially large solution spaces that traditionally relies on manual planning processes. We present an end-to-end reinforcement learning (RL) framework based on graph attention networks for sequential transit network construction. To address the long-horizon credit assignment challenge, we introduce a two-level reward structure combining incremental topological feedback with simulation-based terminal rewards. We evaluate our approach on a new real-world dataset from Bloomington, Indiana with topologically accurate road networks, census-derived demand, and existing transit routes. Our learned policies substantially outperform existing designs and traditional heuristics across two initialization schemes and two modal-split scenarios. Under high transit adoption with transit center initialization, our approach achieves 25.6% higher service rates, 30.9% shorter wait times, and 21.0% better bus utilization compared to the real-world network. Under mixed-mode conditions with random initialization, it delivers 68.8% higher route efficiency than demand coverage heuristics and 5.9% lower travel times than shortest path construction. These results demonstrate that end-to-end RL can design transit networks that substantially outperform both human-designed systems and hand-crafted heuristics on realistic city-scale benchmarks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 67 references that are in the map. First posted on arXiv 21 Dec 2025.
Builds on
24 of 67 references.
References · 24
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2017Graph Attention Networkscited by 8,854
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
- 2015Pointer Networkscited by 882
- 2021How Attentive are Graph Attention Networks?cited by 818
- 2018Attention, Learn to Solve Routing Problems!cited by 646
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 600
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 557
- 2018Reinforcement Learning for Solving the Vehicle Routing Problemcited by 327
- 2020A Closer Look at Invalid Action Masking in Policy Gradient Algorithmscited by 160
- 2021Graph Pointer Neural Networkscited by 27
- 2023Can ChatGPT Enable ITS? The Case of Mixed Traffic Control via Reinforcement Learningcited by 18
12 more
- 2023Learning to Control and Coordinate Mixed Traffic Through Robot Vehicles at Complex and Unsignalized Intersectionscited by 9
- 2023Large-scale Mixed Traffic Control Using Dynamic Vehicle Routing and Privacy-Preserving Crowdsourcingcited by 9
- 2023Mixed Traffic Control and Coordination from Pixelscited by 8
- 2023EnduRL: Enhancing Safety, Stability, and Efficiency of Mixed Traffic Under Real-World Perturbations Via Reinforcement Learningcited by 7
- 2024LASIL: Learner-Aware Supervised Imitation Learning For Long-term Microscopic Traffic Simulationcited by 7
- 2024CARL: Congestion-Aware Reinforcement Learning for Imitation-based Perturbations in Mixed Traffic Controlcited by 7
- 2024Heterogeneous Mixed Traffic Control and Coordinationcited by 7
- 2024Learning Heuristics for Transit Network Design and Improvement with Deep Reinforcement Learningcited by 3
- 2024Planning and Optimizing Transit Linescited by 2
- 2025Large-Scale Mixed-Traffic and Intersection Control using Multi-agent Reinforcement Learningcited by 2
- 2025Origin-Destination Pattern Effects on Large-Scale Mixed Traffic Control via Multi-Agent Reinforcement Learningcited by 2
- 2023A sequential transit network design algorithm with optimal learning under correlated beliefscited by 1
Built on by
Not cited yet.