Cooperative and Distributed Reinforcement Learning of Drones for Field Coverage
Not on the map. Why?
Abstract (arXiv)
This paper proposes a distributed Multi-Agent Reinforcement Learning (MARL) algorithm for a team of Unmanned Aerial Vehicles (UAVs). The proposed MARL algorithm allows UAVs to learn cooperatively to provide a full coverage of an unknown field of interest while minimizing the overlapping sections among their field of views. Two challenges in MARL for such a system are discussed in the paper: firstly, the complex dynamic of the joint-actions of the UAV team, that will be solved using game-theoretic correlated equilibrium, and secondly, the challenge in huge dimensional state space representation will be tackled with efficient function approximation techniques. We also provide our experimental results in detail with both simulation and physical implementation to show that the UAV team can successfully learn to accomplish the task.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 6; 2023: 2; 2024: 3; 2025: 3.
20 papers.
Sort:
By area:
- 2021On Improving Model-Free Algorithms for Decentralized Multi-Agent Reinforcement Learningcited by 35
- 2021Learning Graphon Mean Field Games and Approximate Nash Equilibriacited by 28
- 2021Context-Aware Sparse Deep Coordination Graphscited by 27
- 2022A Survey on Large-Population Systems and Scalable Multi-Agent Reinforcement Learningcited by 12
- 2022Non-Linear Coordination Graphscited by 10
- 2023Multi-Agent Reinforcement Learning: Methods, Applications, Visionary Prospects, and Challengescited by 5
- 2024On the Interplay of Artificial Intelligence and Space-Air-Ground Integrated Networks: A Surveycited by 5
- 2021Network Support for High-performance Distributed Machine Learningcited by 4
- 2023Finite-sample Guarantees for Nash Q-learning with Linear Function Approximationcited by 4
- 2022Safe Inverse Reinforcement Learning via Control Barrier Functioncited by 3
- 2022One Policy is Enough: Parallel Exploration with a Single Policy is Near-Optimal for Reward-Free Reinforcement Learningcited by 2
- 2025Multi-Agent Reinforcement Learning in Intelligent Transportation Systems: A Comprehensive Surveycited by 2
8 more
- 2022AACHER: Assorted Actor-Critic Deep Reinforcement Learning with Hindsight Experience Replaycited by 1
- 2025Belief States for Cooperative Multi-Agent Reinforcement Learning under Partial Observabilitycited by 1
- 2021Approximated Multi-Agent Fitted Q Iterationcited by 0
- 2021Responsive Regulation of Dynamic UAV Communication Networks Based on Deep Reinforcement Learningcited by 0
- 2022Efficient Domain Coverage for Vehicles with Second-Order Dynamics via Multi-Agent Reinforcement Learningcited by 0
- 2024A Survey on Applications of Reinforcement Learning in Spatial Resource Allocationcited by 0
- 2024Learning with Dynamics: Autonomous Regulation of UAV Based Communication Networks with Dynamic UAV Crewcited by 0
- 2025Conditional Diffusion Model for Multi-Agent Dynamic Task Decompositioncited by 0
- 2025Conditional Diffusion Model for Multi-Agent Dynamic Task Decomposition17 Nov 2025
- 2025Multi-Agent Reinforcement Learning in Intelligent Transportation Systems: A Comprehensive Survey27 Aug 2025
- 2025Belief States for Cooperative Multi-Agent Reinforcement Learning under Partial Observability11 Apr 2025
- 2024Learning with Dynamics: Autonomous Regulation of UAV Based Communication Networks with Dynamic UAV Crew25 Sep 2024
- 2024A Survey on Applications of Reinforcement Learning in Spatial Resource Allocation6 Mar 2024
- 2024On the Interplay of Artificial Intelligence and Space-Air-Ground Integrated Networks: A Survey20 Jan 2024
- 2023Multi-Agent Reinforcement Learning: Methods, Applications, Visionary Prospects, and Challenges17 May 2023
- 2023Finite-sample Guarantees for Nash Q-learning with Linear Function Approximation1 Mar 2023
- 2022Safe Inverse Reinforcement Learning via Control Barrier Function6 Dec 2022
- 2022Efficient Domain Coverage for Vehicles with Second-Order Dynamics via Multi-Agent Reinforcement Learning11 Nov 2022
- 2022Non-Linear Coordination Graphs26 Oct 2022
- 2022AACHER: Assorted Actor-Critic Deep Reinforcement Learning with Hindsight Experience Replay24 Oct 2022
8 more
- 2022A Survey on Large-Population Systems and Scalable Multi-Agent Reinforcement Learning8 Sep 2022
- 2022One Policy is Enough: Parallel Exploration with a Single Policy is Near-Optimal for Reward-Free Reinforcement Learning31 May 2022
- 2021Learning Graphon Mean Field Games and Approximate Nash Equilibria29 Nov 2021
- 2021On Improving Model-Free Algorithms for Decentralized Multi-Agent Reinforcement Learning12 Oct 2021
- 2021Responsive Regulation of Dynamic UAV Communication Networks Based on Deep Reinforcement Learning25 Aug 2021
- 2021Context-Aware Sparse Deep Coordination Graphs5 Jun 2021
- 2021Approximated Multi-Agent Fitted Q Iteration19 Apr 2021
- 2021Network Support for High-performance Distributed Machine Learning5 Feb 2021
- 2022Safe Inverse Reinforcement Learning via Control Barrier Functioncited by 3
- 2021Approximated Multi-Agent Fitted Q Iterationcited by 0
- 2022Safe Inverse Reinforcement Learning via Control Barrier Function6 Dec 2022
- 2021Approximated Multi-Agent Fitted Q Iteration19 Apr 2021
- 2021On Improving Model-Free Algorithms for Decentralized Multi-Agent Reinforcement Learningcited by 35
- 2021Learning Graphon Mean Field Games and Approximate Nash Equilibriacited by 28
- 2021Context-Aware Sparse Deep Coordination Graphscited by 27
- 2022A Survey on Large-Population Systems and Scalable Multi-Agent Reinforcement Learningcited by 12
- 2022Non-Linear Coordination Graphscited by 10
- 2023Multi-Agent Reinforcement Learning: Methods, Applications, Visionary Prospects, and Challengescited by 5
- 2024On the Interplay of Artificial Intelligence and Space-Air-Ground Integrated Networks: A Surveycited by 5
- 2021Network Support for High-performance Distributed Machine Learningcited by 4
- 2023Finite-sample Guarantees for Nash Q-learning with Linear Function Approximationcited by 4
- 2022One Policy is Enough: Parallel Exploration with a Single Policy is Near-Optimal for Reward-Free Reinforcement Learningcited by 2
- 2025Multi-Agent Reinforcement Learning in Intelligent Transportation Systems: A Comprehensive Surveycited by 2
- 2022AACHER: Assorted Actor-Critic Deep Reinforcement Learning with Hindsight Experience Replaycited by 1
12 most cited of 17 All 17 (JSON)
- 2025Multi-Agent Reinforcement Learning in Intelligent Transportation Systems: A Comprehensive Survey27 Aug 2025
- 2025Belief States for Cooperative Multi-Agent Reinforcement Learning under Partial Observability11 Apr 2025
- 2024Learning with Dynamics: Autonomous Regulation of UAV Based Communication Networks with Dynamic UAV Crew25 Sep 2024
- 2024A Survey on Applications of Reinforcement Learning in Spatial Resource Allocation6 Mar 2024
- 2024On the Interplay of Artificial Intelligence and Space-Air-Ground Integrated Networks: A Survey20 Jan 2024
- 2023Multi-Agent Reinforcement Learning: Methods, Applications, Visionary Prospects, and Challenges17 May 2023
- 2023Finite-sample Guarantees for Nash Q-learning with Linear Function Approximation1 Mar 2023
- 2022Efficient Domain Coverage for Vehicles with Second-Order Dynamics via Multi-Agent Reinforcement Learning11 Nov 2022
- 2022Non-Linear Coordination Graphs26 Oct 2022
- 2022AACHER: Assorted Actor-Critic Deep Reinforcement Learning with Hindsight Experience Replay24 Oct 2022
- 2022A Survey on Large-Population Systems and Scalable Multi-Agent Reinforcement Learning8 Sep 2022
- 2022One Policy is Enough: Parallel Exploration with a Single Policy is Near-Optimal for Reward-Free Reinforcement Learning31 May 2022
12 newest of 17 All 17 (JSON)