mlsanityData to 7 Oct 2026

Learning Team-Based Navigation: A Review of Deep Reinforcement Learning Techniques for Multi-Agent Pathfinding

arXiv 2308.05893 ↗First posted 11 Aug 2023cs.AI cs.LG cs.MAcited by 5

Not on the map. Why?

Abstract (arXiv)

Multi-agent pathfinding (MAPF) is a critical field in many large-scale robotic applications, often being the fundamental step in multi-agent systems. The increasing complexity of MAPF in complex and crowded environments, however, critically diminishes the effectiveness of existing solutions. In contrast to other studies that have either presented a general overview of the recent advancements in MAPF or extensively reviewed Deep Reinforcement Learning (DRL) within multi-agent system settings independently, our work presented in this review paper focuses on highlighting the integration of DRL-based approaches in MAPF. Moreover, we aim to bridge the current gap in evaluating MAPF solutions by addressing the lack of unified evaluation metrics and providing comprehensive clarification on these metrics. Finally, our paper discusses the potential of model-based DRL as a promising future direction and provides its required foundational understanding to address current challenges in MAPF. Our objective is to assist readers in gaining insight into the current research direction, providing unified metrics for comparing different MAPF algorithms and expanding their knowledge of model-based DRL to address the existing challenges in MAPF.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 64 of its 140 references that are in the map. First posted on arXiv 11 Aug 2023.

Builds on

64 of 140 references.

References · 64

  1. 2017Attention Is All You Needcited by 59,932
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
  4. 2015Continuous control with deep reinforcement learningcited by 3,279
  5. 2015Trust Region Policy Optimizationcited by 2,503
  6. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  7. 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
  8. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
  9. 2015Deep Reinforcement Learning with Double Q-learningcited by 1,704
  10. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  11. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
  12. 2018World Modelscited by 1,444
38 more
  1. 2023Mastering Diverse Domains through World Modelscited by 1,193
  2. 2020Mastering Atari with Discrete World Modelscited by 990
  3. 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 903
  4. 2017Rainbow: Combining Improvements in Deep Reinforcement Learningcited by 774
  5. 2015Dueling Network Architectures for Deep Reinforcement Learningcited by 769
  6. 2017Counterfactual Multi-Agent Policy Gradientscited by 733
  7. 2019Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithmscited by 555
  8. 2017Value-Decomposition Networks For Cooperative Multi-Agent Learningcited by 490
  9. 2020Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 475
  10. 2017A Brief Survey of Deep Reinforcement Learningcited by 466
  11. 2020Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Surveycited by 388
  12. 2019QTRAN: Learning to Factorize with Transformation for Cooperative Multi-Agent Reinforcement Learningcited by 372
  13. 2020QPLEX: Duplex Dueling Multi-Agent Q-Learningcited by 267
  14. 2019Multi-Agent Pathfinding: Definitions, Variants, and Benchmarkscited by 197
  15. 2019Search on the Replay Buffer: Bridging Planning and Reinforcement Learningcited by 188
  16. 2023Vision-Language Models as Success Detectorscited by 138
  17. 2018Motion Planning Among Dynamic, Decision-Making Agents with Deep Reinforcement Learningcited by 101
  18. 2017Multiagent Bidirectionally-Coordinated Nets: Emergence of Human-level Coordination in Learning to Play StarCraft Combat Gamescited by 93
  19. 2018PRIMAL: Pathfinding via Reinforcement and Imitation Multi-Agent Learningcited by 89
  20. 2017Towards Optimally Decentralized Multi-Robot Collision Avoidance via Deep Reinforcement Learningcited by 81
  21. 2020EECBS: A Bounded-Suboptimal Search for Multi-Agent Path Findingcited by 67
  22. 2022VMAS: A Vectorized Multi-Agent Simulator for Collective Robot Learningcited by 63
  23. 2020PRIMAL2: Pathfinding via Reinforcement and Imitation Multi-Agent Learning -- Lifelongcited by 61
  24. 2019Priority Inheritance with Backtracking for Iterative Multi-agent Path Findingcited by 55
  25. 2019Collision Avoidance in Pedestrian-Rich Environments with Deep Reinforcement Learningcited by 44
  26. 2021Deep Multiagent Reinforcement Learning: Challenges and Directionscited by 42
  27. 2018Combined Reinforcement Learning via Abstract Representationscited by 37
  28. 2020Mobile Robot Path Planning in Dynamic Environments through Globally Guided Reinforcement Learningcited by 36
  29. 2023World Models and Predictive Coding for Cognitive and Developmental Robotics: Frontiers and Challengescited by 35
  30. 2023SCRIMP: Scalable Communication for Reinforcement- and Imitation-Learning-Based Multi-Agent Pathfindingcited by 35
  31. 2021Learning Selective Communication for Multi-Agent Path Findingcited by 32
  32. 2021Distributed Heuristic Multi-Agent Path Finding with Communicationcited by 31
  33. 2020MAPPER: Multi-Agent Path Planning with Evolutionary Reinforcement Learning in Mixed Dynamic Environmentscited by 26
  34. 2019Deep Reinforcement Learning using Genetic Algorithm for Parameter Optimizationcited by 23
  35. 2020Multi-agent Motion Planning for Dense and Dynamic Environments via Deep Reinforcement Learningcited by 21
  36. 2020Delay-Aware Multi-Agent Reinforcement Learning for Cooperative and Competitive Environmentscited by 21
  37. 2021Pairwise Symmetry Reasoning for Multi-Agent Path Finding Searchcited by 21
  38. 2022Multi-Agent Path Finding with Prioritized Communication Learningcited by 17

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 1; 2026: 2.

5 papers.