Lifelong Multi-Agent Path Finding for Online Pickup and Delivery Tasks
Not on the map. Why?
Abstract (arXiv)
The multi-agent path-finding (MAPF) problem has recently received a lot of attention. However, it does not capture important characteristics of many real-world domains, such as automated warehouses, where agents are constantly engaged with new tasks. In this paper, we therefore study a lifelong version of the MAPF problem, called the multi-agent pickup and delivery (MAPD) problem. In the MAPD problem, agents have to attend to a stream of delivery tasks in an online setting. One agent has to be assigned to each delivery task. This agent has to first move to a given pickup location and then to a given delivery location while avoiding collisions with other agents. We present two decoupled MAPD algorithms, Token Passing (TP) and Token Passing with Task Swaps (TPTS). Theoretically, we show that they solve all well-formed MAPD instances, a realistic subclass of MAPD instances. Experimentally, we compare them against a centralized strawman MAPD algorithm without this guarantee in a simulated warehouse system. TP can easily be extended to a fully distributed MAPD algorithm and is the best choice when real-time computation is of primary concern since it remains efficient for MAPD instances with hundreds of agents and tasks. TPTS requires limited communication among agents and balances well between TP and the centralized MAPD algorithm.
Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 11; 2023: 10; 2024: 9; 2025: 15; 2026: 11.
62 papers.
Sort:
By area:
- 2022Scalable Multi-Agent Reinforcement Learning for Warehouse Logistics with Robotic and Human Co-Workerscited by 28
- 2023Learn to Follow: Decentralized Lifelong Multi-agent Pathfinding via Planning and Learningcited by 27
- 2023Multi-Robot Coordination and Layout Design for Automated Warehousingcited by 17
- 2023Traffic Flow Optimisation for Lifelong Multi-Agent Path Findingcited by 14
- 2021Beyond Robustness: A Taxonomy of Approaches towards Resilient Multi-Robot Systemscited by 12
- 2022Multi-Goal Multi-Agent Pickup and Deliverycited by 12
- 2024Guidance Graph Optimization for Lifelong Multi-Agent Path Findingcited by 12
- 2023Arbitrarily Scalable Environment Generators via Neural Cellular Automatacited by 9
- 2021Cooperative Multi-Agent Path Finding: Beyond Path Planning and Collision Avoidancecited by 8
- 2022Graph-Based Multi-Robot Path Finding and Planningcited by 7
- 2021Coordinated Multi-Agent Pathfinding for Drones and Trucks over Road Networkscited by 6
- 2022DC-MRTA: Decentralized Multi-Robot Task Allocation and Navigation in Complex Environmentscited by 6
38 more
- 2024Deploying Ten Thousand Robots: Scalable Imitation Learning for Lifelong Multi-Agent Path Findingcited by 6
- 2022Optimal and Bounded-Suboptimal Multi-Goal Task Assignment and Path Findingcited by 5
- 2023Double-Deck Multi-Agent Pickup and Delivery: Multi-Robot Rearrangement in Large-Scale Warehousescited by 5
- 2024Large-Scale Multirobot Coverage Path Planning on Grids With Path Deconflictioncited by 5
- 2025Advancing MAPF Toward the Real World: A Scalable Multi-Agent Realistic Testbed (SMART)cited by 5
- 2021A Conflict-Based Search Framework for Multi-Objective Multi-Agent Path Findingcited by 4
- 2022Standby-Based Deadlock Avoidance Method for Multi-Agent Pickup and Delivery Taskscited by 4
- 2023Improved Anonymous Multi-Agent Path Finding Algorithmcited by 4
- 2025Solving Multi-Agent Safe Optimal Control with Distributed Epigraph Form MARLcited by 4
- 2025Lightweight and Effective Preference Construction in PIBT for Large-Scale Multi-Agent Pathfindingcited by 4
- 2022Leveraging Experience in Lifelong Multi-Agent Pathfindingcited by 3
- 2022The Multi-Agent Pickup and Delivery Problem: MAPF, MARL and Its Warehouse Applicationscited by 3
- 2024MGCBS: An Optimal and Efficient Algorithm for Solving Multi-Goal Multi-Agent Path Finding Problemcited by 3
- 2025Where Paths Collide: A Comprehensive Survey of Classic and Learning-Based Multi-Agent Pathfindingcited by 3
- 2025Destination-to-Chutes Task Mapping Optimization for Multi-Robot Coordination in Robotic Sorting Systemscited by 3
- 2026Learning-guided Prioritized Planning for Lifelong Multi-Agent Path Finding in Warehouse Automationcited by 3
- 2021A Competitive Analysis of Online Multi-Agent Path Findingcited by 2
- 2023The Study of Highway for Lifelong Multi-Agent Path Findingcited by 2
- 2024Multi-Agent Path Finding with Real Robot Dynamics and Interdependent Tasks for Automated Warehousescited by 2
- 2021Multi-Robot Routing with Time Windows: A Column Generation Approachcited by 1
- 2022Deadlock-Free Method for Multi-Agent Pickup and Delivery Problem Using Priority Inheritance with Temporary Prioritycited by 1
- 2023Robust Multi-Agent Pickup and Delivery with Delayscited by 1
- 2024Caching-Augmented Lifelong Multi-Agent Path Findingcited by 1
- 2024Robotic warehousing operations: a learn-then-optimize approach to large-scale neighborhood searchcited by 1
- 2025A Multiagent Path Search Algorithm for Large-Scale Coalition Structure Generationcited by 1
- 2025Together We Rise: Optimizing Real-Time Multi-Robot Task Allocation using Coordinated Heterogeneous Playscited by 1
- 2025Risk-Bounded Multi-Agent Visual Navigation via Iterative Risk Allocationcited by 1
- 2022Optimal Multi-Agent Path Finding for Precedence Constrained Planning Taskscited by 0
- 2022Multi-Agent Terraforming: Efficient Multi-Agent Path Finding via Environment Manipulationcited by 0
- 2023Terraforming -- Environment Manipulation during Disruptions for Multi-Agent Pickup and Deliverycited by 0
- 2023DMS*: Minimizing Makespan for Multi-Agent Combinatorial Path Findingcited by 0
- 2024Optimal Integrated Task and Path Planning and Its Application to Multi-Robot Pickup and Deliverycited by 0
- 2024Transient Multi-Agent Path Finding for Lifelong Navigation in Dense Environmentscited by 0
- 2025Enhancing Lifelong Multi-Agent Path Finding with Cache Mechanismcited by 0
- 2025Simultaneous Computation with Multiple Prioritizations in Multi-Agent Motion Planningcited by 0
- 2025Neural ATTF: A Scalable Solution to Lifelong Multi-Agent Path Planningcited by 0
- 2025PRISM: Complete Online Decentralized Multi-Agent Pathfinding with Rapid Information Sharing using Motion Constraintscited by 0
- 2025Budget Allocation Policies for Real-Time Multi-Agent Path Findingcited by 0
50 most cited of 62 All 62 (JSON)
- 2026Model-Based Reinforcement Learning for Heterogeneous Multi-Robot Task Assignment Under Distribution Shifts21 Aug 2026
- 2026A Theoretical Framework for Parallel Lifelong MAPF Using Group Decentralized Planning18 Aug 2026
- 2026Complete, Scalable, and Robust Prioritized Planning for Multi-Robot Ordered Storage and Retrieval at Maximum Capacity7 Aug 2026
- 2026Scalable Long-Horizon Planning with Staggered Updates for Lifelong MAPF7 Aug 2026
- 2026Stress-Relief Annealing: Polynomial-Time Simulation-Free Layout Optimization for Automated Warehouses2 Aug 2026
- 2026Lifelong Multi-Subsystem Pickup and Delivery with Buffer-Limited Handover Stations20 Jul 2026
- 2026CARVE-Q: Quantum-Proposed, Classically Certified Interactive Driving Repair3 Jun 2026
- 2026SOAR: Real-Time Joint Optimization of Order Allocation and Robot Scheduling in Robotic Mobile Fulfillment Systems5 May 2026
- 2026CREST: Constraint-Release Execution for Multi-Robot Warehouse Shelf Rearrangement27 Mar 2026
- 2026Learning-guided Prioritized Planning for Lifelong Multi-Agent Path Finding in Warehouse Automation25 Mar 2026
- 2026Multi UAVs Preflight Planning in a Shared and Dynamic Airspace12 Feb 2026
- 2025GRAND: Guidance, Rebalancing, and Assignment for Networked Dispatch in Multi-Agent Path Finding2 Dec 2025
38 more
- 2025Destination-to-Chutes Task Mapping Optimization for Multi-Robot Coordination in Robotic Sorting Systems3 Oct 2025
- 2025Sequence Pathfinder for Multi-Agent Pickup and Delivery in the Warehouse28 Sep 2025
- 2025Risk-Bounded Multi-Agent Visual Navigation via Iterative Risk Allocation9 Sep 2025
- 2025Budget Allocation Policies for Real-Time Multi-Agent Path Finding22 Jul 2025
- 2025Where Paths Collide: A Comprehensive Survey of Classic and Learning-Based Multi-Agent Pathfinding25 May 2025
- 2025Lightweight and Effective Preference Construction in PIBT for Large-Scale Multi-Agent Pathfinding19 May 2025
- 2025PRISM: Complete Online Decentralized Multi-Agent Pathfinding with Rapid Information Sharing using Motion Constraints12 May 2025
- 2025Solving Multi-Agent Safe Optimal Control with Distributed Epigraph Form MARL21 Apr 2025
- 2025Neural ATTF: A Scalable Solution to Lifelong Multi-Agent Path Planning21 Apr 2025
- 2025Advancing MAPF Toward the Real World: A Scalable Multi-Agent Realistic Testbed (SMART)3 Mar 2025
- 2025Together We Rise: Optimizing Real-Time Multi-Robot Task Allocation using Coordinated Heterogeneous Plays22 Feb 2025
- 2025A Multiagent Path Search Algorithm for Large-Scale Coalition Structure Generation14 Feb 2025
- 2025Simultaneous Computation with Multiple Prioritizations in Multi-Agent Motion Planning18 Jan 2025
- 2025Enhancing Lifelong Multi-Agent Path Finding with Cache Mechanism6 Jan 2025
- 2024Transient Multi-Agent Path Finding for Lifelong Navigation in Dense Environments5 Dec 2024
- 2024Large-Scale Multirobot Coverage Path Planning on Grids With Path Deconfliction3 Nov 2024
- 2024Deploying Ten Thousand Robots: Scalable Imitation Learning for Lifelong Multi-Agent Path Finding28 Oct 2024
- 2024Robotic warehousing operations: a learn-then-optimize approach to large-scale neighborhood search29 Aug 2024
- 2024Multi-Agent Path Finding with Real Robot Dynamics and Interdependent Tasks for Automated Warehouses26 Aug 2024
- 2024MGCBS: An Optimal and Efficient Algorithm for Solving Multi-Goal Multi-Agent Path Finding Problem30 Apr 2024
- 2024Caching-Augmented Lifelong Multi-Agent Path Finding20 Mar 2024
- 2024Optimal Integrated Task and Path Planning and Its Application to Multi-Robot Pickup and Delivery2 Mar 2024
- 2024Guidance Graph Optimization for Lifelong Multi-Agent Path Finding2 Feb 2024
- 2023Improved Anonymous Multi-Agent Path Finding Algorithm17 Dec 2023
- 2023DMS*: Minimizing Makespan for Multi-Agent Combinatorial Path Finding11 Dec 2023
- 2023Arbitrarily Scalable Environment Generators via Neural Cellular Automata28 Oct 2023
- 2023Learn to Follow: Decentralized Lifelong Multi-agent Pathfinding via Planning and Learning2 Oct 2023
- 2023Traffic Flow Optimisation for Lifelong Multi-Agent Path Finding22 Aug 2023
- 2023Terraforming -- Environment Manipulation during Disruptions for Multi-Agent Pickup and Delivery19 May 2023
- 2023Multi-Robot Coordination and Layout Design for Automated Warehousing10 May 2023
- 2023Double-Deck Multi-Agent Pickup and Delivery: Multi-Robot Rearrangement in Large-Scale Warehouses27 Apr 2023
- 2023The Study of Highway for Lifelong Multi-Agent Path Finding9 Apr 2023
- 2023Robust Multi-Agent Pickup and Delivery with Delays30 Mar 2023
- 2022Scalable Multi-Agent Reinforcement Learning for Warehouse Logistics with Robotic and Human Co-Workers22 Dec 2022
- 2022DC-MRTA: Decentralized Multi-Robot Task Allocation and Navigation in Complex Environments7 Sep 2022
- 2022Multi-Goal Multi-Agent Pickup and Delivery2 Aug 2022
- 2022Optimal and Bounded-Suboptimal Multi-Goal Task Assignment and Path Finding2 Aug 2022
- 2022Graph-Based Multi-Robot Path Finding and Planning22 Jun 2022
50 newest of 62 All 62 (JSON)
- 2022Scalable Multi-Agent Reinforcement Learning for Warehouse Logistics with Robotic and Human Co-Workerscited by 28
- 2023Learn to Follow: Decentralized Lifelong Multi-agent Pathfinding via Planning and Learningcited by 27
- 2023Multi-Robot Coordination and Layout Design for Automated Warehousingcited by 17
- 2023Traffic Flow Optimisation for Lifelong Multi-Agent Path Findingcited by 14
- 2021Beyond Robustness: A Taxonomy of Approaches towards Resilient Multi-Robot Systemscited by 12
- 2022Multi-Goal Multi-Agent Pickup and Deliverycited by 12
- 2024Guidance Graph Optimization for Lifelong Multi-Agent Path Findingcited by 12
- 2023Arbitrarily Scalable Environment Generators via Neural Cellular Automatacited by 9
- 2021Cooperative Multi-Agent Path Finding: Beyond Path Planning and Collision Avoidancecited by 8
- 2022Graph-Based Multi-Robot Path Finding and Planningcited by 7
- 2021Coordinated Multi-Agent Pathfinding for Drones and Trucks over Road Networkscited by 6
- 2022DC-MRTA: Decentralized Multi-Robot Task Allocation and Navigation in Complex Environmentscited by 6
12 most cited of 60 All 60 (JSON)
- 2026Model-Based Reinforcement Learning for Heterogeneous Multi-Robot Task Assignment Under Distribution Shifts21 Aug 2026
- 2026A Theoretical Framework for Parallel Lifelong MAPF Using Group Decentralized Planning18 Aug 2026
- 2026Complete, Scalable, and Robust Prioritized Planning for Multi-Robot Ordered Storage and Retrieval at Maximum Capacity7 Aug 2026
- 2026Scalable Long-Horizon Planning with Staggered Updates for Lifelong MAPF7 Aug 2026
- 2026Stress-Relief Annealing: Polynomial-Time Simulation-Free Layout Optimization for Automated Warehouses2 Aug 2026
- 2026Lifelong Multi-Subsystem Pickup and Delivery with Buffer-Limited Handover Stations20 Jul 2026
- 2026CARVE-Q: Quantum-Proposed, Classically Certified Interactive Driving Repair3 Jun 2026
- 2026SOAR: Real-Time Joint Optimization of Order Allocation and Robot Scheduling in Robotic Mobile Fulfillment Systems5 May 2026
- 2026CREST: Constraint-Release Execution for Multi-Robot Warehouse Shelf Rearrangement27 Mar 2026
- 2026Learning-guided Prioritized Planning for Lifelong Multi-Agent Path Finding in Warehouse Automation25 Mar 2026
- 2026Multi UAVs Preflight Planning in a Shared and Dynamic Airspace12 Feb 2026
- 2025GRAND: Guidance, Rebalancing, and Assignment for Networked Dispatch in Multi-Agent Path Finding2 Dec 2025
12 newest of 60 All 60 (JSON)