mlsanityData to 14 Oct 2026

Self-organized free-flight arrival for urban air mobility

arXiv 2404.03710 ↗First posted 4 Apr 2024cs.LG cs.AIcited by 2

On the map: Deep reinforcement learning methods → RL for robot navigation and UAV control

Abstract (arXiv)

Urban air mobility is an innovative mode of transportation in which electric vertical takeoff and landing (eVTOL) vehicles operate between nodes called vertiports. We outline a self-organized vertiport arrival system based on deep reinforcement learning. The airspace around the vertiport is assumed to be circular, and the vehicles can freely operate inside. Each aircraft is considered an individual agent and follows a shared policy, resulting in decentralized actions that are based on local information. We investigate the development of the reinforcement learning policy during training and illustrate how the algorithm moves from suboptimal local holding patterns to a safe and efficient final policy. The latter is validated in simulation-based scenarios, including robustness analyses against sensor noise and a changing distribution of inbound traffic. Lastly, we deploy the final policy on small-scale unmanned aerial vehicles to showcase its real-world usability.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in RL for robot navigation and UAV control, one of 15 directions in Deep reinforcement learning methods. Builds on 25 of its 88 references that are in the map. First posted on arXiv 4 Apr 2024.

Builds on

25 of 88 references.

References · 25

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
  3. 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,417
  4. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,558
  5. 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 575
  6. 2019Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithmscited by 567
  7. 2017A Brief Survey of Deep Reinforcement Learningcited by 483
  8. 2020Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Surveycited by 413
  9. 2020Curriculum Learning for Reinforcement Learning Domains: A Framework and Surveycited by 373
  10. 2016Learning Multiagent Communication with Backpropagationcited by 366
  11. 2018Optimization of Molecules via Deep Reinforcement Learningcited by 200
  12. 2015Multiagent Cooperation and Competition with Deep Reinforcement Learningcited by 184
13 more
  1. 2016Decentralized Non-communicating Multiagent Collision Avoidance with Deep Reinforcement Learningcited by 118
  2. 2018Deep Neural Network Compression for Aircraft Collision Avoidance Systemscited by 58
  3. 2021Memory-based Deep Reinforcement Learning for POMDPscited by 54
  4. 2019Sim-to-(Multi)-Real: Transfer of Low-Level Robust Control Policies to Multiple Quadrotorscited by 45
  5. 2019Assessing Transferability from Simulation to Reality for Reinforcement Learningcited by 33
  6. 2022Distributed Reinforcement Learning for Robot Teams: A Reviewcited by 16
  7. 2022Zipfian environments for Reinforcement Learningcited by 13
  8. 2021Air taxi service for urban mobility: A critical review of recent developments, future challenges, and opportunitiescited by 7
  9. 2023Multi-Agent Reinforcement Learning for Cooperative Air Transportation Services in City-Wide Autonomous Urban Air Mobilitycited by 6
  10. 2020Learning-to-Fly: Learning-based Collision Avoidance for Scalable Urban Air Mobilitycited by 5
  11. 2022Enhanced method for reinforcement learning based dynamic obstacle avoidance by assessment of collision riskcited by 5
  12. 2022Spatial-temporal recurrent reinforcement learning for autonomous shipscited by 3
  13. 20232-Level Reinforcement Learning for Ships on Inland Waterways: Path Planning and Followingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

  1. 2025Integrated Noise and Safety Management in UAM via A Unified Reinforcement Learning Frameworkcited by 0
  2. 2026Conflict Resolution under Degraded Surveillance in Air Corridors Using Multi-Agent Reinforcement Learningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Heterogeneous Vertiport Selection Optimization for On-Demand Air Taxi Services: A Deep Reinforcement Learning Approach
  2. 2024A Graph-based Adversarial Imitation Learning Framework for Reliable & Realtime Fleet Scheduling in Urban Air Mobility
  3. 2025Navigation in a Three-Dimensional Urban Flow using Deep Reinforcement Learning
  4. 2026Decentralized Autonomous Traffic Management through Corridor Networks
  5. 2024DeepAir: A Multi-Agent Deep Reinforcement Learning Based Scheme for an Unknown User Location Problem
  6. 2026Joint Trajectory, RIS, and Computation Offloading Optimization via Decentralized Model-Based PPO in Urban Multi-UAV Mobile Edge Computing
  7. 2025A Reinforcement Learning Approach to Quiet and Safe UAM Traffic Management
  8. 2024Graph Learning-based Fleet Scheduling for Urban Air Mobility under Operational Constraints, Varying Demand & Uncertainties