Near-Optimal Multi-Agent Learning for Safe Coverage Control
Not on the map. Why?
Abstract (arXiv)
In multi-agent coverage control problems, agents navigate their environment to reach locations that maximize the coverage of some density. In practice, the density is rarely known textita priori, further complicating the original NP-hard problem. Moreover, in many applications, agents cannot visit arbitrary locations due to textita priori unknown safety constraints. In this paper, we aim to efficiently learn the density to approximately solve the coverage problem while preserving the agents' safety. We first propose a conditionally linear submodular coverage function that facilitates theoretical analysis. Utilizing this structure, we develop MacOpt, a novel algorithm that efficiently trades off the exploration-exploitation dilemma due to partial observability, and show that it achieves sublinear regret. Next, we extend results on single-agent safe exploration to our multi-agent setting and propose SafeMac for safe coverage and exploration. We analyze SafeMac and give first of its kind results: near optimal coverage in finite time while provably guaranteeing safety. We extensively evaluate our algorithms on synthetic and real problems, including a bio-diversity monitoring task under safety constraints, where SafeMac outperforms competing methods.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 29 of its 75 references that are in the map. First posted on arXiv 12 Oct 2022.
Builds on
29 of 75 references.
References · 29
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,558
- 2017Constrained Policy Optimizationcited by 983
- 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 609
- 2021Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learningcited by 371
- 2017Safe Model-based Reinforcement Learning with Stability Guaranteescited by 366
- 2017On Kernelized Multi-armed Banditscited by 352
- 2018A Lyapunov-based Approach to Safe Reinforcement Learningcited by 297
- 2017A General Safety Framework for Learning-Based Control in Uncertain Robotic Systemscited by 163
- 2020On Information Gain and Regret Bounds in Gaussian Process Banditscited by 158
- 2020Safe Reinforcement Learning in Constrained Markov Decision Processescited by 115
- 2017AI Safety Gridworldscited by 110
17 more
- 2018Stagewise Safe Bayesian Optimization with Gaussian Processescited by 79
- 2016Safe Exploration in Finite Markov Decision Processes with Gaussian Processescited by 75
- 2020Safe Reinforcement Learning via Curriculum Inductioncited by 74
- 2021Cooperative Exploration for Multi-Agent Deep Reinforcement Learningcited by 57
- 2019Safe Exploration for Interactive Machine Learningcited by 51
- 2019An Information-Theoretic Approach to Minimax Regret in Partial Monitoringcited by 42
- 2020Information Directed Sampling for Linear Partial Monitoringcited by 40
- 2022Submodularity In Machine Learning and Artificial Intelligencecited by 38
- 2014Online Submodular Maximization under a Matroid Constraint with Application to Learning Assignmentscited by 17
- 2020Distributionally Robust Chance Constrained Data-enabled Predictive Controlcited by 16
- 2020Multi-Agent Safe Planning with Gaussian Processescited by 13
- 2021Coverage Control in Multi-Robot Systems via Graph Neural Networkscited by 13
- 2015Noisy Submodular Maximization via Adaptive Sampling with Applications to Crowdsourced Image Collection Summarizationcited by 11
- 2022Experimental Design for Linear Functionals in Reproducing Kernel Hilbert Spacescited by 9
- 2020Competitive Policy Optimizationcited by 6
- 2014Multi-agents adaptive estimation and coverage control using Gaussian regressioncited by 4
- 2021Sensing Cox Processes via Posterior Sampling and Positive Basescited by 4
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 5; 2026: 1.
11 papers.
- 2023Submodular Reinforcement Learningcited by 23
- 2024Global Reinforcement Learning: Beyond Linear and Convex Rewards via Submodular Semi-gradient Methodscited by 15
- 2024Safe Guaranteed Exploration for Non-linear Systemscited by 8
- 2025Performance-driven Constrained Optimal Auto-Tuner for MPCcited by 6
- 2026Safe Exploration via Policy Priorscited by 6
- 2025Finite-Sample-Based Reachability for Safe Control with Gaussian Process Dynamicscited by 5
- 2024Cooperative Multi-Agent Graph Bandits: UCB Algorithm and Regret Analysiscited by 1
- 2025Safe and Near-Optimal Control with Online Dynamics Learningcited by 1
- 2024Information-Theoretic Safe Bayesian Optimizationcited by 0
- 2025Scalable Submodular Policy Optimization via Pruned Submodularity Graphcited by 0
- 2025Towards safe control parameter tuning in distributed multi-agent systemscited by 0
- 2026Safe Exploration via Policy Priors27 Jan 2026
- 2025Safe and Near-Optimal Control with Online Dynamics Learning20 Sep 2025
- 2025Towards safe control parameter tuning in distributed multi-agent systems19 Aug 2025
- 2025Scalable Submodular Policy Optimization via Pruned Submodularity Graph18 Jul 2025
- 2025Finite-Sample-Based Reachability for Safe Control with Gaussian Process Dynamics12 May 2025
- 2025Performance-driven Constrained Optimal Auto-Tuner for MPC10 Mar 2025
- 2024Global Reinforcement Learning: Beyond Linear and Convex Rewards via Submodular Semi-gradient Methods13 Jul 2024
- 2024Information-Theoretic Safe Bayesian Optimization23 Feb 2024
- 2024Safe Guaranteed Exploration for Non-linear Systems9 Feb 2024
- 2024Cooperative Multi-Agent Graph Bandits: UCB Algorithm and Regret Analysis18 Jan 2024
- 2023Submodular Reinforcement Learning25 Jul 2023