mlsanityData to 14 Oct 2026

Towards Autonomous Railway Operations: A Semi-Hierarchical Deep Reinforcement Learning Approach to the Vehicle Rescheduling Problem

arXiv 2605.10257 ↗First posted 11 May 2026cs.AIcited by 0

On the map: Deep reinforcement learning methods → RL for autonomous driving and traffic

Abstract (arXiv)

Managing disruptions in railway traffic management is a major challenge. Rising traffic density and infrastructure limits increase complexity, making the Vehicle Routing and Scheduling Problem (VRSP) difficult to solve reliably and in real time. While Operational Research (OR) methods are widely used, most dispatching still relies on human expertise due to the problem's exponential combinatorial complexity. Reinforcement Learning (RL) has gained attention for its potential in multi-agent coordination, but existing RL approaches often underperform OR methods and struggle to scale in dense rail networks. This paper addresses this gap from a machine learning perspective by introducing a semi-hierarchical RL formulation tailored to operational railway constraints. The method separates dispatching from routing through dedicated action and observation spaces, enabling policies to specialise in distinct decision scopes and addressing the imbalance between rare dispatch decisions and frequent routing updates. The approach is evaluated on the Flatland-RL simulator across five difficulty levels and 50 random seeds, with 7 to 80 trains. Results show substantially improved coordination, resource utilisation, and robustness compared with heuristic baselines and monolithic RL, nearly doubling the number of trains reaching their destinations, while keeping deadlock rates below 5% and adaptively sequencing, delaying, or cancelling trains under heavy congestion.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for autonomous driving and traffic, one of 15 directions in Deep reinforcement learning methods. Builds on 5 of its 17 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

5 of 17 references.

References · 5

  1. 2019Go-Explore: a New Approach for Hard-Exploration Problemscited by 212
  2. 2016Multi-Agent Path Finding with Delay Probabilitiescited by 18
  3. 2021Flatland Competition 2020: MAPF and MARL for Efficient Train Coordination on a Grid Worldcited by 10
  4. 2020Improving Sample Efficiency and Multi-Agent Communication in RL-based Train Reschedulingcited by 2
  5. 2022Multi-Agent Path Finding via Tree LSTMcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2020Flatland-RL : Multi-Agent Reinforcement Learning on Trains
  2. 2024Reinforcement Learning for Scalable Train Timetable Rescheduling with Graph Representation
  3. 2025Dynamic Pricing in High-Speed Railways Using Multi-Agent Reinforcement Learning
  4. 2026Optimization of the Railcar Assignment Problem Using Zone-based Double Deep Reinforcement Learning
  5. 2026Smart Transportation Without Neurons -- Fair Metro Network Expansion with Tabular Reinforcement Learning
  6. 2025Single Agent Robust Deep Reinforcement Learning for Bus Fleet Control
  7. 2026Graph-Based Inference and Topology-Aware Multi-Agent Reinforcement Learning for Large-Scale Railway Network Management
  8. 2026A Novel Hybrid Heuristic-Reinforcement Learning Optimization Approach for a Class of Railcar Shunting Problems