Learning Team-Based Navigation: A Review of Deep Reinforcement Learning Techniques for Multi-Agent Pathfinding
Not on the map. Why?
Abstract (arXiv)
Multi-agent pathfinding (MAPF) is a critical field in many large-scale robotic applications, often being the fundamental step in multi-agent systems. The increasing complexity of MAPF in complex and crowded environments, however, critically diminishes the effectiveness of existing solutions. In contrast to other studies that have either presented a general overview of the recent advancements in MAPF or extensively reviewed Deep Reinforcement Learning (DRL) within multi-agent system settings independently, our work presented in this review paper focuses on highlighting the integration of DRL-based approaches in MAPF. Moreover, we aim to bridge the current gap in evaluating MAPF solutions by addressing the lack of unified evaluation metrics and providing comprehensive clarification on these metrics. Finally, our paper discusses the potential of model-based DRL as a promising future direction and provides its required foundational understanding to address current challenges in MAPF. Our objective is to assist readers in gaining insight into the current research direction, providing unified metrics for comparing different MAPF algorithms and expanding their knowledge of model-based DRL to address the existing challenges in MAPF.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 64 of its 140 references that are in the map. First posted on arXiv 11 Aug 2023.
Builds on
64 of 140 references.
References · 64
- 2017Attention Is All You Needcited by 59,932
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
- 2015Continuous control with deep reinforcement learningcited by 3,279
- 2015Trust Region Policy Optimizationcited by 2,503
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
- 2015Deep Reinforcement Learning with Double Q-learningcited by 1,704
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
- 2018World Modelscited by 1,444
38 more
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2020Mastering Atari with Discrete World Modelscited by 990
- 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 903
- 2017Rainbow: Combining Improvements in Deep Reinforcement Learningcited by 774
- 2015Dueling Network Architectures for Deep Reinforcement Learningcited by 769
- 2017Counterfactual Multi-Agent Policy Gradientscited by 733
- 2019Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithmscited by 555
- 2017Value-Decomposition Networks For Cooperative Multi-Agent Learningcited by 490
- 2020Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 475
- 2017A Brief Survey of Deep Reinforcement Learningcited by 466
- 2020Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Surveycited by 388
- 2019QTRAN: Learning to Factorize with Transformation for Cooperative Multi-Agent Reinforcement Learningcited by 372
- 2020QPLEX: Duplex Dueling Multi-Agent Q-Learningcited by 267
- 2019Multi-Agent Pathfinding: Definitions, Variants, and Benchmarkscited by 197
- 2019Search on the Replay Buffer: Bridging Planning and Reinforcement Learningcited by 188
- 2023Vision-Language Models as Success Detectorscited by 138
- 2018Motion Planning Among Dynamic, Decision-Making Agents with Deep Reinforcement Learningcited by 101
- 2017Multiagent Bidirectionally-Coordinated Nets: Emergence of Human-level Coordination in Learning to Play StarCraft Combat Gamescited by 93
- 2018PRIMAL: Pathfinding via Reinforcement and Imitation Multi-Agent Learningcited by 89
- 2017Towards Optimally Decentralized Multi-Robot Collision Avoidance via Deep Reinforcement Learningcited by 81
- 2020EECBS: A Bounded-Suboptimal Search for Multi-Agent Path Findingcited by 67
- 2022VMAS: A Vectorized Multi-Agent Simulator for Collective Robot Learningcited by 63
- 2020PRIMAL2: Pathfinding via Reinforcement and Imitation Multi-Agent Learning -- Lifelongcited by 61
- 2019Priority Inheritance with Backtracking for Iterative Multi-agent Path Findingcited by 55
- 2019Collision Avoidance in Pedestrian-Rich Environments with Deep Reinforcement Learningcited by 44
- 2021Deep Multiagent Reinforcement Learning: Challenges and Directionscited by 42
- 2018Combined Reinforcement Learning via Abstract Representationscited by 37
- 2020Mobile Robot Path Planning in Dynamic Environments through Globally Guided Reinforcement Learningcited by 36
- 2023World Models and Predictive Coding for Cognitive and Developmental Robotics: Frontiers and Challengescited by 35
- 2023SCRIMP: Scalable Communication for Reinforcement- and Imitation-Learning-Based Multi-Agent Pathfindingcited by 35
- 2021Learning Selective Communication for Multi-Agent Path Findingcited by 32
- 2021Distributed Heuristic Multi-Agent Path Finding with Communicationcited by 31
- 2020MAPPER: Multi-Agent Path Planning with Evolutionary Reinforcement Learning in Mixed Dynamic Environmentscited by 26
- 2019Deep Reinforcement Learning using Genetic Algorithm for Parameter Optimizationcited by 23
- 2020Multi-agent Motion Planning for Dense and Dynamic Environments via Deep Reinforcement Learningcited by 21
- 2020Delay-Aware Multi-Agent Reinforcement Learning for Cooperative and Competitive Environmentscited by 21
- 2021Pairwise Symmetry Reasoning for Multi-Agent Path Finding Searchcited by 21
- 2022Multi-Agent Path Finding with Prioritized Communication Learningcited by 17
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 1; 2026: 2.
5 papers.
- 2024Ensembling Prioritized Hybrid Policies for Multi-agent Pathfindingcited by 7
- 2024HiMAP: Learning Heuristics-Informed Policies for Large-Scale Multi-Agent Pathfindingcited by 4
- 2025StarCraft+: Benchmarking Multi-agent Algorithms in Adversary Paradigmcited by 0
- 2026PC2P: Multi-Agent Path Finding via Personalized-Enhanced Communication and Crowd Perceptioncited by 0
- 2026SPARC: Spatial-Aware Path Planning via Attentive Agent Communicationcited by 0
- 2026SPARC: Spatial-Aware Path Planning via Attentive Agent Communication3 Mar 2026
- 2026PC2P: Multi-Agent Path Finding via Personalized-Enhanced Communication and Crowd Perception6 Jan 2026
- 2025StarCraft+: Benchmarking Multi-agent Algorithms in Adversary Paradigm18 Dec 2025
- 2024Ensembling Prioritized Hybrid Policies for Multi-agent Pathfinding12 Mar 2024
- 2024HiMAP: Learning Heuristics-Informed Policies for Large-Scale Multi-Agent Pathfinding23 Feb 2024