# Cooperative and Distributed Reinforcement Learning of Drones for Field Coverage

arXiv: https://arxiv.org/abs/1803.07250 · HTML: https://mlsanity.com/paper/1803.07250/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 20 Mar 2018.

## Built on by (most cited first, 20 of 20)

- [On Improving Model-Free Algorithms for Decentralized Multi-Agent Reinforcement Learning](https://mlsanity.com/paper/2110.05707/) (2021)
- [Context-Aware Sparse Deep Coordination Graphs](https://mlsanity.com/paper/2106.02886/) (2021)
- [Learning Graphon Mean Field Games and Approximate Nash Equilibria](https://mlsanity.com/paper/2112.01280/) (2021)
- [A Survey on Large-Population Systems and Scalable Multi-Agent Reinforcement Learning](https://mlsanity.com/paper/2209.03859/) (2022)
- [Non-Linear Coordination Graphs](https://mlsanity.com/paper/2211.08404/) (2022)
- [Multi-Agent Reinforcement Learning: Methods, Applications, Visionary Prospects, and Challenges](https://mlsanity.com/paper/2305.10091/) (2023)
- [On the Interplay of Artificial Intelligence and Space-Air-Ground Integrated Networks: A Survey](https://mlsanity.com/paper/2402.00881/) (2024)
- [Network Support for High-performance Distributed Machine Learning](https://mlsanity.com/paper/2102.03394/) (2021)
- [Finite-sample Guarantees for Nash Q-learning with Linear Function Approximation](https://mlsanity.com/paper/2303.00177/) (2023)
- [Safe Inverse Reinforcement Learning via Control Barrier Function](https://mlsanity.com/paper/2212.02753/) (2022)
- [One Policy is Enough: Parallel Exploration with a Single Policy is Near-Optimal for Reward-Free Reinforcement Learning](https://mlsanity.com/paper/2205.15891/) (2022)
- [Multi-Agent Reinforcement Learning in Intelligent Transportation Systems: A Comprehensive Survey](https://mlsanity.com/paper/2508.20315/) (2025)
- [AACHER: Assorted Actor-Critic Deep Reinforcement Learning with Hindsight Experience Replay](https://mlsanity.com/paper/2210.12892/) (2022)
- [Belief States for Cooperative Multi-Agent Reinforcement Learning under Partial Observability](https://mlsanity.com/paper/2504.08417/) (2025)
- [Approximated Multi-Agent Fitted Q Iteration](https://mlsanity.com/paper/2104.09343/) (2021)
- [Responsive Regulation of Dynamic UAV Communication Networks Based on Deep Reinforcement Learning](https://mlsanity.com/paper/2108.11012/) (2021)
- [Efficient Domain Coverage for Vehicles with Second-Order Dynamics via Multi-Agent Reinforcement Learning](https://mlsanity.com/paper/2211.05952/) (2022)
- [A Survey on Applications of Reinforcement Learning in Spatial Resource Allocation](https://mlsanity.com/paper/2403.03643/) (2024)
- [Learning with Dynamics: Autonomous Regulation of UAV Based Communication Networks with Dynamic UAV Crew](https://mlsanity.com/paper/2409.17139/) (2024)
- [Conditional Diffusion Model for Multi-Agent Dynamic Task Decomposition](https://mlsanity.com/paper/2511.13137/) (2025)

## Abstract (arXiv)

This paper proposes a distributed Multi-Agent Reinforcement Learning (MARL) algorithm for a team of Unmanned Aerial Vehicles (UAVs). The proposed MARL algorithm allows UAVs to learn cooperatively to provide a full coverage of an unknown field of interest while minimizing the overlapping sections among their field of views. Two challenges in MARL for such a system are discussed in the paper: firstly, the complex dynamic of the joint-actions of the UAV team, that will be solved using game-theoretic correlated equilibrium, and secondly, the challenge in huge dimensional state space representation will be tackled with efficient function approximation techniques. We also provide our experimental results in detail with both simulation and physical implementation to show that the UAV team can successfully learn to accomplish the task.
