MAMPS: Safe Multi-Agent Reinforcement Learning via Model Predictive Shielding
Not on the map. Why?
Abstract (arXiv)
Reinforcement learning is a promising approach to learning control policies for performing complex multi-agent robotics tasks. However, a policy learned in simulation often fails to guarantee even simple safety properties such as obstacle avoidance. To ensure safety, we propose multi-agent model predictive shielding (MAMPS), an algorithm that provably guarantees safety for an arbitrary learned policy. In particular, it operates by using the learned policy as often as possible, but instead uses a backup policy in cases where it cannot guarantee the safety of the learned policy. Using a multi-agent simulation environment, we show how MAMPS can achieve good performance while ensuring safety.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). First posted on arXiv 25 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 3; 2023: 1; 2024: 6; 2025: 3; 2026: 1.
20 papers.
Sort:
By area:
- 2021Learning Safe Multi-Agent Control with Decentralized Neural Barrier Certificatescited by 74
- 2021Multi-Agent Constrained Policy Optimisationcited by 35
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Surveycited by 32
- 2022Online Shielding for Reinforcement Learningcited by 22
- 2022Distributed Reinforcement Learning for Robot Teams: A Reviewcited by 16
- 2024Dynamic Model Predictive Shielding for Provably Safe Reinforcement Learningcited by 15
- 2021Shielding Atari Games with Bounded Presciencecited by 14
- 2022Spatial-Temporal-Aware Safe Multi-Agent Reinforcement Learning of Connected Autonomous Vehicles in Challenging Scenarioscited by 13
- 2024Compositional Shielding and Reinforcement Learning for Multi-Agent Systemscited by 8
- 2025Solving Multi-Agent Safe Optimal Control with Distributed Epigraph Form MARLcited by 6
- 2021Safe Deep Reinforcement Learning for Multi-Agent Systems with Continuous Action Spacescited by 5
- 2024A Dynamic Safety Shield for Safe and Efficient Reinforcement Learning of Navigation Taskscited by 5
8 more
- 2021Reinforcement Learning with Formal Performance Metrics for Quadcopter Attitude Control under Non-nominal Contextscited by 3
- 2024Safe Reinforcement Learning for Power System Control: A Reviewcited by 3
- 2024Think Smart, Act SMARL! Analyzing Probabilistic Logic Shields for Multi-Agent Reinforcement Learningcited by 1
- 2025Tackling Uncertainties in Multi-Agent Reinforcement Learning through Integration of Agent Termination Dynamicscited by 1
- 2025Toward Adaptable Multi-Agent Reinforcement Learning: An Assumption-Aware Reviewcited by 1
- 2021Safe Learning of Uncertain Environmentscited by 0
- 2023Shared Information-Based Safe And Efficient Behavior Planning For Connected Autonomous Vehiclescited by 0
- 2026Shield-Loco: Shielding Locomotion Policies with Predictive Safety Filteringcited by 0
- 2026Shield-Loco: Shielding Locomotion Policies with Predictive Safety Filtering5 Jun 2026
- 2025Toward Adaptable Multi-Agent Reinforcement Learning: An Assumption-Aware Review14 Jul 2025
- 2025Solving Multi-Agent Safe Optimal Control with Distributed Epigraph Form MARL21 Apr 2025
- 2025Tackling Uncertainties in Multi-Agent Reinforcement Learning through Integration of Agent Termination Dynamics21 Jan 2025
- 2024A Dynamic Safety Shield for Safe and Efficient Reinforcement Learning of Navigation Tasks5 Dec 2024
- 2024Think Smart, Act SMARL! Analyzing Probabilistic Logic Shields for Multi-Agent Reinforcement Learning7 Nov 2024
- 2024Compositional Shielding and Reinforcement Learning for Multi-Agent Systems14 Oct 2024
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey19 Aug 2024
- 2024Safe Reinforcement Learning for Power System Control: A Review30 Jun 2024
- 2024Dynamic Model Predictive Shielding for Provably Safe Reinforcement Learning22 May 2024
- 2023Shared Information-Based Safe And Efficient Behavior Planning For Connected Autonomous Vehicles8 Feb 2023
- 2022Online Shielding for Reinforcement Learning4 Dec 2022
8 more
- 2022Spatial-Temporal-Aware Safe Multi-Agent Reinforcement Learning of Connected Autonomous Vehicles in Challenging Scenarios5 Oct 2022
- 2022Distributed Reinforcement Learning for Robot Teams: A Review7 Apr 2022
- 2021Multi-Agent Constrained Policy Optimisation6 Oct 2021
- 2021Safe Deep Reinforcement Learning for Multi-Agent Systems with Continuous Action Spaces9 Aug 2021
- 2021Reinforcement Learning with Formal Performance Metrics for Quadcopter Attitude Control under Non-nominal Contexts27 Jul 2021
- 2021Safe Learning of Uncertain Environments2 Mar 2021
- 2021Shielding Atari Games with Bounded Prescience20 Jan 2021
- 2021Learning Safe Multi-Agent Control with Decentralized Neural Barrier Certificates14 Jan 2021
- 2024Dynamic Model Predictive Shielding for Provably Safe Reinforcement Learningcited by 15
- 2024A Dynamic Safety Shield for Safe and Efficient Reinforcement Learning of Navigation Taskscited by 5
- 2024Safe Reinforcement Learning for Power System Control: A Reviewcited by 3
- 2026Shield-Loco: Shielding Locomotion Policies with Predictive Safety Filteringcited by 0
- 2026Shield-Loco: Shielding Locomotion Policies with Predictive Safety Filtering5 Jun 2026
- 2024A Dynamic Safety Shield for Safe and Efficient Reinforcement Learning of Navigation Tasks5 Dec 2024
- 2024Safe Reinforcement Learning for Power System Control: A Review30 Jun 2024
- 2024Dynamic Model Predictive Shielding for Provably Safe Reinforcement Learning22 May 2024
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Surveycited by 32
- 2022Spatial-Temporal-Aware Safe Multi-Agent Reinforcement Learning of Connected Autonomous Vehicles in Challenging Scenarioscited by 13
- 2023Shared Information-Based Safe And Efficient Behavior Planning For Connected Autonomous Vehiclescited by 0
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey19 Aug 2024
- 2023Shared Information-Based Safe And Efficient Behavior Planning For Connected Autonomous Vehicles8 Feb 2023
- 2022Spatial-Temporal-Aware Safe Multi-Agent Reinforcement Learning of Connected Autonomous Vehicles in Challenging Scenarios5 Oct 2022
- 2021Learning Safe Multi-Agent Control with Decentralized Neural Barrier Certificatescited by 74
- 2021Multi-Agent Constrained Policy Optimisationcited by 35
- 2022Online Shielding for Reinforcement Learningcited by 22
- 2022Distributed Reinforcement Learning for Robot Teams: A Reviewcited by 16
- 2021Shielding Atari Games with Bounded Presciencecited by 14
- 2024Compositional Shielding and Reinforcement Learning for Multi-Agent Systemscited by 8
- 2025Solving Multi-Agent Safe Optimal Control with Distributed Epigraph Form MARLcited by 6
- 2021Safe Deep Reinforcement Learning for Multi-Agent Systems with Continuous Action Spacescited by 5
- 2021Reinforcement Learning with Formal Performance Metrics for Quadcopter Attitude Control under Non-nominal Contextscited by 3
- 2024Think Smart, Act SMARL! Analyzing Probabilistic Logic Shields for Multi-Agent Reinforcement Learningcited by 1
- 2025Tackling Uncertainties in Multi-Agent Reinforcement Learning through Integration of Agent Termination Dynamicscited by 1
- 2025Toward Adaptable Multi-Agent Reinforcement Learning: An Assumption-Aware Reviewcited by 1
12 most cited of 13 All 13 (JSON)
- 2025Toward Adaptable Multi-Agent Reinforcement Learning: An Assumption-Aware Review14 Jul 2025
- 2025Solving Multi-Agent Safe Optimal Control with Distributed Epigraph Form MARL21 Apr 2025
- 2025Tackling Uncertainties in Multi-Agent Reinforcement Learning through Integration of Agent Termination Dynamics21 Jan 2025
- 2024Think Smart, Act SMARL! Analyzing Probabilistic Logic Shields for Multi-Agent Reinforcement Learning7 Nov 2024
- 2024Compositional Shielding and Reinforcement Learning for Multi-Agent Systems14 Oct 2024
- 2022Online Shielding for Reinforcement Learning4 Dec 2022
- 2022Distributed Reinforcement Learning for Robot Teams: A Review7 Apr 2022
- 2021Multi-Agent Constrained Policy Optimisation6 Oct 2021
- 2021Safe Deep Reinforcement Learning for Multi-Agent Systems with Continuous Action Spaces9 Aug 2021
- 2021Reinforcement Learning with Formal Performance Metrics for Quadcopter Attitude Control under Non-nominal Contexts27 Jul 2021
- 2021Safe Learning of Uncertain Environments2 Mar 2021
- 2021Shielding Atari Games with Bounded Prescience20 Jan 2021
12 newest of 13 All 13 (JSON)