MAPF-GPT: Imitation Learning for Multi-Agent Pathfinding at Scale
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Multi-agent pathfinding (MAPF) is a problem that generally requires finding collision-free paths for multiple agents in a shared environment. Solving MAPF optimally, even under restrictive assumptions, is NP-hard, yet efficient solutions for this problem are critical for numerous applications, such as automated warehouses and transportation systems. Recently, learning-based approaches to MAPF have gained attention, particularly those leveraging deep reinforcement learning. Typically, such learning-based MAPF solvers are augmented with additional components like single-agent planning or communication. Orthogonally, in this work we rely solely on imitation learning that leverages a large dataset of expert MAPF solutions and transformer-based neural network to create a foundation model for MAPF called MAPF-GPT. The latter is capable of generating actions without additional heuristics or communication. MAPF-GPT demonstrates zero-shot learning abilities when solving the MAPF problems that are not present in the training dataset. We show that MAPF-GPT notably outperforms the current best-performing learnable MAPF solvers on a diverse range of problem instances and is computationally efficient during inference.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 29 of its 59 references that are in the map. First posted on arXiv 29 Aug 2024.
Builds on
29 of 59 references.
References · 29
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,873
- 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,777
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
- 2021A Minimalist Approach to Offline Reinforcement Learningcited by 882
- 2019The StarCraft Multi-Agent Challengecited by 589
- 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 338
- 2019Multi-Agent Pathfinding: Definitions, Variants, and Benchmarkscited by 197
- 2018Multi-Agent Generative Adversarial Imitation Learningcited by 99
17 more
- 2018PRIMAL: Pathfinding via Reinforcement and Imitation Multi-Agent Learningcited by 89
- 2018Searching with Consistent Prioritization for Multi-Agent Path Findingcited by 80
- 2020Lifelong Multi-Agent Path Finding in Large-Scale Warehousescited by 79
- 2017Coordinated Multi-Agent Imitation Learningcited by 70
- 2020PRIMAL2: Pathfinding via Reinforcement and Imitation Multi-Agent Learning -- Lifelongcited by 61
- 2022LaCAM: Search-Based Algorithm for Quick Multi-Agent Pathfindingcited by 50
- 2018Multi-Agent Imitation Learning for Driving Simulationcited by 49
- 2024Amortized Planning with Large-Scale Transformers: A Case Study on Chesscited by 45
- 2023SCRIMP: Scalable Communication for Reinforcement- and Imitation-Learning-Based Multi-Agent Pathfindingcited by 35
- 2021Learning Selective Communication for Multi-Agent Path Findingcited by 32
- 2021Offline Pre-trained Multi-Agent Decision Transformer: One Big Sequence Model Tackles All SMAC Taskscited by 32
- 2023Learn to Follow: Decentralized Lifelong Multi-agent Pathfinding via Planning and Learningcited by 27
- 2024POGEMA: A Benchmark Platform for Cooperative Multi-Agent Pathfindingcited by 20
- 2021Multi-Agent Imitation Learning with Copulascited by 13
- 2022Conditional Imitation Learning for Multi-Agent Gamescited by 13
- 2023Decentralized Monte Carlo Tree Search for Partially Observable Multi-agent Pathfindingcited by 11
- 2024Multi-Agent Imitation Learning: Value is Easy, Regret is Hardcited by 11
Built on by
Citing papers per year: 2024: 1; 2025: 8; 2026: 8.
17 papers.
Sort:
By area:
- 2024Work Smarter Not Harder: Simple Imitation Learning with CS-PIBT Outperforms Large Scale Imitation Learning for MAPFcited by 10
- 2025Generalizable Heuristic Generation Through LLMs with Meta-Optimizationcited by 7
- 2025RAILGUN: A Unified Convolutional Policy for Multi-Agent Path Finding Across Different Environments and Taskscited by 5
- 2025Advancing Learnable Multi-Agent Pathfinding Solvers with Active Fine-Tuningcited by 5
- 2025Graph Attention-Guided Search for Dense Multi-Agent Pathfindingcited by 5
- 2025DeepFleet: Multi-Agent Foundation Models for Mobile Robotscited by 3
- 2026Pairwise is Not Enough: Hypergraph Neural Networks for Multi-Agent Pathfindingcited by 3
- 2025CAMAR: Continuous Actions Multi-Agent Routingcited by 2
- 2025R2BC: Multi-Agent Imitation Learning from Single-Agent Demonstrationscited by 1
- 2026Learning to Communicate Locally for Large-Scale Multi-Agent Pathfindingcited by 1
- 2026Discrete Diffusion for Complex and Congested Multi-Agent Path Finding with Sparse Social Attentioncited by 1
- 2025MAPF-World: Action World Model for Multi-Agent Path Findingcited by 0
5 more
- 2026MARL-GPT: Foundation Model for Multi-Agent Reinforcement Learningcited by 0
- 2026HMACE: Heterogeneous Multi-Agent Collaborative Evolution for Combinatorial Optimizationcited by 0
- 2026Search-Aided Joint Agent-Environment Reinforcement Learning for Robust Lifelong Multi-Agent Path Finding with Rotationscited by 0
- 2026Decentralized Master-Mind: Joint Action Refinement through Iterative Intent Denoising in Multi-Agent Pathfindingcited by 0
- 2026Auditing Action Settlement in LLM Agent Environments: Order, Progress, and Replaycited by 0
- 2026Auditing Action Settlement in LLM Agent Environments: Order, Progress, and Replay1 Oct 2026
- 2026Decentralized Master-Mind: Joint Action Refinement through Iterative Intent Denoising in Multi-Agent Pathfinding25 Sep 2026
- 2026Search-Aided Joint Agent-Environment Reinforcement Learning for Robust Lifelong Multi-Agent Path Finding with Rotations6 Aug 2026
- 2026Discrete Diffusion for Complex and Congested Multi-Agent Path Finding with Sparse Social Attention13 May 2026
- 2026Learning to Communicate Locally for Large-Scale Multi-Agent Pathfinding8 May 2026
- 2026HMACE: Heterogeneous Multi-Agent Collaborative Evolution for Combinatorial Optimization8 May 2026
- 2026MARL-GPT: Foundation Model for Multi-Agent Reinforcement Learning7 Apr 2026
- 2026Pairwise is Not Enough: Hypergraph Neural Networks for Multi-Agent Pathfinding6 Feb 2026
- 2025R2BC: Multi-Agent Imitation Learning from Single-Agent Demonstrations20 Oct 2025
- 2025Graph Attention-Guided Search for Dense Multi-Agent Pathfinding20 Oct 2025
- 2025CAMAR: Continuous Actions Multi-Agent Routing18 Aug 2025
- 2025MAPF-World: Action World Model for Multi-Agent Path Finding16 Aug 2025
5 more
- 2025DeepFleet: Multi-Agent Foundation Models for Mobile Robots12 Aug 2025
- 2025Advancing Learnable Multi-Agent Pathfinding Solvers with Active Fine-Tuning30 Jun 2025
- 2025Generalizable Heuristic Generation Through LLMs with Meta-Optimization27 May 2025
- 2025RAILGUN: A Unified Convolutional Policy for Multi-Agent Path Finding Across Different Environments and Tasks4 Mar 2025
- 2024Work Smarter Not Harder: Simple Imitation Learning with CS-PIBT Outperforms Large Scale Imitation Learning for MAPF22 Sep 2024
- 2025DeepFleet: Multi-Agent Foundation Models for Mobile Robotscited by 3
- 2026MARL-GPT: Foundation Model for Multi-Agent Reinforcement Learningcited by 0
- 2026HMACE: Heterogeneous Multi-Agent Collaborative Evolution for Combinatorial Optimizationcited by 0
- 2026Auditing Action Settlement in LLM Agent Environments: Order, Progress, and Replaycited by 0
- 2026Auditing Action Settlement in LLM Agent Environments: Order, Progress, and Replay1 Oct 2026
- 2026HMACE: Heterogeneous Multi-Agent Collaborative Evolution for Combinatorial Optimization8 May 2026
- 2026MARL-GPT: Foundation Model for Multi-Agent Reinforcement Learning7 Apr 2026
- 2025DeepFleet: Multi-Agent Foundation Models for Mobile Robots12 Aug 2025
- 2025MAPF-World: Action World Model for Multi-Agent Path Finding16 Aug 2025
- 2025Generalizable Heuristic Generation Through LLMs with Meta-Optimizationcited by 7
- 2025RAILGUN: A Unified Convolutional Policy for Multi-Agent Path Finding Across Different Environments and Taskscited by 5
- 2025Advancing Learnable Multi-Agent Pathfinding Solvers with Active Fine-Tuningcited by 5
- 2025Graph Attention-Guided Search for Dense Multi-Agent Pathfindingcited by 5
- 2026Pairwise is Not Enough: Hypergraph Neural Networks for Multi-Agent Pathfindingcited by 3
- 2025CAMAR: Continuous Actions Multi-Agent Routingcited by 2
- 2026Learning to Communicate Locally for Large-Scale Multi-Agent Pathfindingcited by 1
- 2026Search-Aided Joint Agent-Environment Reinforcement Learning for Robust Lifelong Multi-Agent Path Finding with Rotationscited by 0
- 2026Decentralized Master-Mind: Joint Action Refinement through Iterative Intent Denoising in Multi-Agent Pathfindingcited by 0
- 2026Decentralized Master-Mind: Joint Action Refinement through Iterative Intent Denoising in Multi-Agent Pathfinding25 Sep 2026
- 2026Search-Aided Joint Agent-Environment Reinforcement Learning for Robust Lifelong Multi-Agent Path Finding with Rotations6 Aug 2026
- 2026Learning to Communicate Locally for Large-Scale Multi-Agent Pathfinding8 May 2026
- 2026Pairwise is Not Enough: Hypergraph Neural Networks for Multi-Agent Pathfinding6 Feb 2026
- 2025Graph Attention-Guided Search for Dense Multi-Agent Pathfinding20 Oct 2025
- 2025CAMAR: Continuous Actions Multi-Agent Routing18 Aug 2025
- 2025Advancing Learnable Multi-Agent Pathfinding Solvers with Active Fine-Tuning30 Jun 2025
- 2025Generalizable Heuristic Generation Through LLMs with Meta-Optimization27 May 2025
- 2025RAILGUN: A Unified Convolutional Policy for Multi-Agent Path Finding Across Different Environments and Tasks4 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2025Where Paths Collide: A Comprehensive Survey of Classic and Learning-Based Multi-Agent Pathfinding
- 2024HiMAP: Learning Heuristics-Informed Policies for Large-Scale Multi-Agent Pathfinding
- 2025Multi-Agent Path Finding via Offline RL and LLM Collaboration
- 2024Deploying Ten Thousand Robots: Scalable Imitation Learning for Lifelong Multi-Agent Path Finding
- 2025Sequence Pathfinder for Multi-Agent Pickup and Delivery in the Warehouse
- 2024Multi-Agent Path Finding in Continuous Spaces with Projected Diffusion Models
- 2024Why Solving Multi-agent Path Finding with Large Language Model has not Succeeded Yet
- 2025From Discrete Plans to Real-World Execution: A World-Model-Driven Framework for Execution-Aware Multi-Agent Path Finding