# Distributed multi-agent target search and tracking with Gaussian process and reinforcement learning

arXiv: https://arxiv.org/abs/2308.14971 · HTML: https://mlsanity.com/paper/2308.14971/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 10 of its 44 references that are in the map.
- First posted on arXiv 29 Aug 2023.

## Builds on (most cited first, 10 of 10)

- [Continuous control with deep reinforcement learning](https://mlsanity.com/paper/1509.02971/) (2015)
- [Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments](https://mlsanity.com/paper/1706.02275/) (2017)
- [End-to-End Training of Deep Visuomotor Policies](https://mlsanity.com/paper/1504.00702/) (2015)
- [Learning Dexterous In-Hand Manipulation](https://mlsanity.com/paper/1808.00177/) (2018)
- [Deep Reinforcement Learning for Robotic Manipulation with Asynchronous Off-Policy Updates](https://mlsanity.com/paper/1610.00633/) (2016)
- [Emergence of Grounded Compositional Language in Multi-Agent Populations](https://mlsanity.com/paper/1703.04908/) (2017)
- [Deep Decentralized Multi-task Multi-Agent Reinforcement Learning under Partial Observability](https://mlsanity.com/paper/1703.06182/) (2017)
- [Conversational Recommender System](https://mlsanity.com/paper/1806.03277/) (2018)
- [Multi-agent Reinforcement Learning with Sparse Interactions by Negotiation and Knowledge Transfer](https://mlsanity.com/paper/1508.05328/) (2015)
- [Fully Distributed Informative Planning for Environmental Learning with Multi-Robot Systems](https://mlsanity.com/paper/2112.14433/) (2021)

## Built on by (most cited first, 1 of 1)

- [Long-Term Mapping of the Douro River Plume with Multi-Agent Reinforcement Learning](https://mlsanity.com/paper/2510.03534/) (2025)

## Abstract (arXiv)

Deploying multiple robots for target search and tracking has many practical applications, yet the challenge of planning over unknown or partially known targets remains difficult to address. With recent advances in deep learning, intelligent control techniques such as reinforcement learning have enabled agents to learn autonomously from environment interactions with little to no prior knowledge. Such methods can address the exploration-exploitation tradeoff of planning over unknown targets in a data-driven manner, eliminating the reliance on heuristics typical of traditional approaches and streamlining the decision-making pipeline with end-to-end training. In this paper, we propose a multi-agent reinforcement learning technique with target map building based on distributed Gaussian process. We leverage the distributed Gaussian process to encode belief over the target locations and efficiently plan over unknown targets. We evaluate the performance and transferability of the trained policy in simulation and demonstrate the method on a swarm of micro unmanned aerial vehicles with hardware experiments.
