Decentralized Multi-Agent Pursuit using Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Pursuit-evasion is the problem of capturing mobile targets with one or more pursuers. We use deep reinforcement learning for pursuing an omni-directional target with multiple, homogeneous agents that are subject to unicycle kinematic constraints. We use shared experience to train a policy for a given number of pursuers that is executed independently by each agent at run-time. The training benefits from curriculum learning, a sweeping-angle ordering to locally represent neighboring agents and encouraging good formations with reward structure that combines individual and group rewards. Simulated experiments with a reactive evader and up to eight pursuers show that our learning-based approach, with non-holonomic agents, performs on par with classical algorithms with omni-directional agents, and outperforms their non-holonomic adaptations. The learned policy is successfully transferred to the real world in a proof-of-concept demonstration with three motion-constrained pursuer drones.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 5; 2024: 6; 2025: 6; 2026: 2.
23 papers.
Sort:
By area:
- 2022Multi-robot Cooperative Pursuit via Potential Field-Enhanced Reinforcement Learningcited by 9
- 2023Learning Multi-Pursuit Evasion for Safe Targeted Navigation of Dronescited by 9
- 2023ESP: Exploiting Symmetry Prior for Multi-Agent Reinforcement Learningcited by 9
- 2024Diffusion-Reinforcement Learning Hierarchical Motion Planning in Multi-agent Adversarial Gamescited by 7
- 2022 T3 OMVP: A Transformer-based Time and Team Reinforcement Learning Scheme for Observation-constrained Multi-Vehicle Pursuit in Urban Areacited by 5
- 2024Online Planning for Multi-UAV Pursuit-Evasion in Unknown Environments Using Deep Reinforcement Learningcited by 4
- 2025Learned Controllers for Agile Quadrotors in Pursuit-Evasion Gamescited by 3
- 2022Toward multi-target self-organizing pursuit in a partially observable Markov gamecited by 2
- 2024Hierarchical Reinforcement Learning for Swarm Confrontation with High Uncertaintycited by 2
- 2023A Dual Curriculum Learning Framework for Multi-UAV Pursuit-Evasion in Diverse Environmentscited by 1
- 2024HOLA-Drone: Hypergraphic Open-ended Learning for Zero-Shot Multi-Drone Cooperative Pursuitcited by 1
- 2025TERL: Large-Scale Multi-Target Encirclement Using Transformer-Enhanced Reinforcement Learningcited by 1
11 more
- 2025Curriculum Imitation Learning of Distributed Multi-Robot Policiescited by 1
- 2021Mixing Human Demonstrations with Self-Exploration in Experience Replay for Deep Reinforcement Learningcited by 0
- 2023Progression Cognition Reinforcement Learning with Prioritized Experience for Multi-Vehicle Pursuitcited by 0
- 2023Replication of Multi-agent Reinforcement Learning for the "Hide and Seek" Problemcited by 0
- 2024Multi-Robot Pursuit in Parameterized Formation via Imitation Learningcited by 0
- 2024TRUST-UP: Trustworthy Reinforcement learning Using Safe Techniques for UAV Pursuitcited by 0
- 2025AT-Drone: Benchmarking Adaptive Teaming in Multi-Drone Pursuitcited by 0
- 2025ARBoids: Adaptive Residual Reinforcement Learning With Boids Model for Cooperative Multi-USV Target Defensecited by 0
- 2025Strategic Communication under Threat: Learning Information Trade-offs in Pursuit-Evasion Gamescited by 0
- 2026Decentralized End-to-End Multi-AAV Pursuit Using Predictive Spatio-Temporal Observation via Deep Reinforcement Learningcited by 0
- 2026M2GRPO: Mamba-based Multi-Agent Group Relative Policy Optimization for Biomimetic Underwater Robots Pursuitcited by 0
- 2026M2GRPO: Mamba-based Multi-Agent Group Relative Policy Optimization for Biomimetic Underwater Robots Pursuit21 Apr 2026
- 2026Decentralized End-to-End Multi-AAV Pursuit Using Predictive Spatio-Temporal Observation via Deep Reinforcement Learning25 Mar 2026
- 2025Strategic Communication under Threat: Learning Information Trade-offs in Pursuit-Evasion Games9 Oct 2025
- 2025Curriculum Imitation Learning of Distributed Multi-Robot Policies29 Sep 2025
- 2025Learned Controllers for Agile Quadrotors in Pursuit-Evasion Games3 Jun 2025
- 2025TERL: Large-Scale Multi-Target Encirclement Using Transformer-Enhanced Reinforcement Learning16 Mar 2025
- 2025ARBoids: Adaptive Residual Reinforcement Learning With Boids Model for Cooperative Multi-USV Target Defense25 Feb 2025
- 2025AT-Drone: Benchmarking Adaptive Teaming in Multi-Drone Pursuit13 Feb 2025
- 2024TRUST-UP: Trustworthy Reinforcement learning Using Safe Techniques for UAV Pursuit26 Nov 2024
- 2024Multi-Robot Pursuit in Parameterized Formation via Imitation Learning31 Oct 2024
- 2024Online Planning for Multi-UAV Pursuit-Evasion in Unknown Environments Using Deep Reinforcement Learning24 Sep 2024
- 2024HOLA-Drone: Hypergraphic Open-ended Learning for Zero-Shot Multi-Drone Cooperative Pursuit13 Sep 2024
11 more
- 2024Hierarchical Reinforcement Learning for Swarm Confrontation with High Uncertainty12 Jun 2024
- 2024Diffusion-Reinforcement Learning Hierarchical Motion Planning in Multi-agent Adversarial Games16 Mar 2024
- 2023A Dual Curriculum Learning Framework for Multi-UAV Pursuit-Evasion in Diverse Environments19 Dec 2023
- 2023Replication of Multi-agent Reinforcement Learning for the "Hide and Seek" Problem9 Oct 2023
- 2023ESP: Exploiting Symmetry Prior for Multi-Agent Reinforcement Learning30 Jul 2023
- 2023Progression Cognition Reinforcement Learning with Prioritized Experience for Multi-Vehicle Pursuit8 Jun 2023
- 2023Learning Multi-Pursuit Evasion for Safe Targeted Navigation of Drones7 Apr 2023
- 2022Toward multi-target self-organizing pursuit in a partially observable Markov game24 Jun 2022
- 2022Multi-robot Cooperative Pursuit via Potential Field-Enhanced Reinforcement Learning9 Mar 2022
- 2022 T3 OMVP: A Transformer-based Time and Team Reinforcement Learning Scheme for Observation-constrained Multi-Vehicle Pursuit in Urban Area1 Mar 2022
- 2021Mixing Human Demonstrations with Self-Exploration in Experience Replay for Deep Reinforcement Learning14 Jul 2021
- 2024Online Planning for Multi-UAV Pursuit-Evasion in Unknown Environments Using Deep Reinforcement Learningcited by 4
- 2025Learned Controllers for Agile Quadrotors in Pursuit-Evasion Gamescited by 3
- 2024Hierarchical Reinforcement Learning for Swarm Confrontation with High Uncertaintycited by 2
- 2025TERL: Large-Scale Multi-Target Encirclement Using Transformer-Enhanced Reinforcement Learningcited by 1
- 2024TRUST-UP: Trustworthy Reinforcement learning Using Safe Techniques for UAV Pursuitcited by 0
- 2025ARBoids: Adaptive Residual Reinforcement Learning With Boids Model for Cooperative Multi-USV Target Defensecited by 0
- 2025Strategic Communication under Threat: Learning Information Trade-offs in Pursuit-Evasion Gamescited by 0
- 2026Decentralized End-to-End Multi-AAV Pursuit Using Predictive Spatio-Temporal Observation via Deep Reinforcement Learningcited by 0
- 2026Decentralized End-to-End Multi-AAV Pursuit Using Predictive Spatio-Temporal Observation via Deep Reinforcement Learning25 Mar 2026
- 2025Strategic Communication under Threat: Learning Information Trade-offs in Pursuit-Evasion Games9 Oct 2025
- 2025Learned Controllers for Agile Quadrotors in Pursuit-Evasion Games3 Jun 2025
- 2025TERL: Large-Scale Multi-Target Encirclement Using Transformer-Enhanced Reinforcement Learning16 Mar 2025
- 2025ARBoids: Adaptive Residual Reinforcement Learning With Boids Model for Cooperative Multi-USV Target Defense25 Feb 2025
- 2024TRUST-UP: Trustworthy Reinforcement learning Using Safe Techniques for UAV Pursuit26 Nov 2024
- 2024Online Planning for Multi-UAV Pursuit-Evasion in Unknown Environments Using Deep Reinforcement Learning24 Sep 2024
- 2024Hierarchical Reinforcement Learning for Swarm Confrontation with High Uncertainty12 Jun 2024
- 2022Multi-robot Cooperative Pursuit via Potential Field-Enhanced Reinforcement Learningcited by 9
- 2023Learning Multi-Pursuit Evasion for Safe Targeted Navigation of Dronescited by 9
- 2023ESP: Exploiting Symmetry Prior for Multi-Agent Reinforcement Learningcited by 9
- 2024Diffusion-Reinforcement Learning Hierarchical Motion Planning in Multi-agent Adversarial Gamescited by 7
- 2022 T3 OMVP: A Transformer-based Time and Team Reinforcement Learning Scheme for Observation-constrained Multi-Vehicle Pursuit in Urban Areacited by 5
- 2022Toward multi-target self-organizing pursuit in a partially observable Markov gamecited by 2
- 2023A Dual Curriculum Learning Framework for Multi-UAV Pursuit-Evasion in Diverse Environmentscited by 1
- 2024HOLA-Drone: Hypergraphic Open-ended Learning for Zero-Shot Multi-Drone Cooperative Pursuitcited by 1
- 2021Mixing Human Demonstrations with Self-Exploration in Experience Replay for Deep Reinforcement Learningcited by 0
- 2023Progression Cognition Reinforcement Learning with Prioritized Experience for Multi-Vehicle Pursuitcited by 0
- 2023Replication of Multi-agent Reinforcement Learning for the "Hide and Seek" Problemcited by 0
- 2025AT-Drone: Benchmarking Adaptive Teaming in Multi-Drone Pursuitcited by 0
12 most cited of 13 All 13 (JSON)
- 2026M2GRPO: Mamba-based Multi-Agent Group Relative Policy Optimization for Biomimetic Underwater Robots Pursuit21 Apr 2026
- 2025AT-Drone: Benchmarking Adaptive Teaming in Multi-Drone Pursuit13 Feb 2025
- 2024HOLA-Drone: Hypergraphic Open-ended Learning for Zero-Shot Multi-Drone Cooperative Pursuit13 Sep 2024
- 2024Diffusion-Reinforcement Learning Hierarchical Motion Planning in Multi-agent Adversarial Games16 Mar 2024
- 2023A Dual Curriculum Learning Framework for Multi-UAV Pursuit-Evasion in Diverse Environments19 Dec 2023
- 2023Replication of Multi-agent Reinforcement Learning for the "Hide and Seek" Problem9 Oct 2023
- 2023ESP: Exploiting Symmetry Prior for Multi-Agent Reinforcement Learning30 Jul 2023
- 2023Progression Cognition Reinforcement Learning with Prioritized Experience for Multi-Vehicle Pursuit8 Jun 2023
- 2023Learning Multi-Pursuit Evasion for Safe Targeted Navigation of Drones7 Apr 2023
- 2022Toward multi-target self-organizing pursuit in a partially observable Markov game24 Jun 2022
- 2022Multi-robot Cooperative Pursuit via Potential Field-Enhanced Reinforcement Learning9 Mar 2022
- 2022 T3 OMVP: A Transformer-based Time and Team Reinforcement Learning Scheme for Observation-constrained Multi-Vehicle Pursuit in Urban Area1 Mar 2022
12 newest of 13 All 13 (JSON)