SAMBA: Safe Model-Based & Active Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose SAMBA, a novel framework for safe reinforcement learning that combines aspects from probabilistic modelling, information theory, and statistics. Our method builds upon PILCO to enable active exploration using novel(semi-)metrics for out-of-sample Gaussian process evaluation optimised through a multi-objective problem that supports conditional-value-at-risk constraints. We evaluate our algorithm on a variety of safe dynamical system benchmarks involving both low and high-dimensional state representations. Our results show orders of magnitude reductions in samples and violations compared to state-of-the-art methods. Lastly, we provide intuition as to the effectiveness of the framework by a detailed analysis of our active metrics and safety constraints.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 8; 2023: 5; 2024: 5; 2025: 2.
28 papers.
Sort:
By area:
- 2022A Review of Safe Reinforcement Learning: Methods, Theory and Applicationscited by 169
- 2022Saute RL: Almost Surely Safe Reinforcement Learning Using State Augmentationcited by 63
- 2021Revisiting Design Choices in Offline Model-Based Reinforcement Learningcited by 50
- 2021Safe Reinforcement Learning Using Robust Control Barrier Functionscited by 44
- 2022Model-based Safe Deep Reinforcement Learning via a Constrained Proximal Policy Optimization Algorithmcited by 27
- 2022Safe Reinforcement Learning of Dynamic High-Dimensional Robotic Tasks: Navigation, Manipulation, Interactioncited by 15
- 2024Safe Reinforcement Learning on the Constraint Manifold: Theory and Applicationscited by 12
- 2022Provable Safe Reinforcement Learning with Binary Feedbackcited by 7
- 2021Look Before You Leap: Safe Model-Based Reinforcement Learning with Human Interventioncited by 5
- 2022Effects of Safety State Augmentation on Safe Explorationcited by 5
- 2023Diminishing Return of Value Expansion Methods in Model-Based Reinforcement Learningcited by 5
- 2021DESTA: A Framework for Safe Reinforcement Learning with Markov Games of Interventioncited by 4
16 more
- 2021Risk Sensitive Model-Based Reinforcement Learning using Uncertainty Guided Planningcited by 3
- 2021Model-Based Safe Reinforcement Learning with Time-Varying State and Control Constraints: An Application to Intelligent Vehiclescited by 3
- 2021Learning Collision-free and Torque-limited Robot Trajectories based on Alternative Safe Behaviorscited by 2
- 2022Demystifying Reinforcement Learning in Time-Varying Systemscited by 2
- 2024Handling Long-Term Safety and Uncertainty in Safe Reinforcement Learningcited by 2
- 2025Improving Controller Generalization with Dimensionless Markov Decision Processescited by 2
- 2021Learning Robust Controllers Via Probabilistic Model-Based Policy Searchcited by 1
- 2022Guided Safe Shooting: model based reinforcement learning with safety constraintscited by 1
- 2023Recent Trends in Artificial Intelligence Technology: A Scoping Reviewcited by 1
- 2023Modeling Risk in Reinforcement Learning: A Literature Mappingcited by 1
- 2024Future Aware Safe Active Learning of Time Varying Systems using Gaussian Processescited by 1
- 2025Scaling CrossQ with Weight Normalizationcited by 1
- 2023Adaptive Aggregation for Safety-Critical Controlcited by 0
- 2023Diverse Priors for Deep Reinforcement Learningcited by 0
- 2024GenSafe: A Generalizable Safety Enhancer for Safe Reinforcement Learning Algorithms Based on Reduced Order Markov Decision Process Modelcited by 0
- 2024Diminishing Return of Value Expansion Methodscited by 0
- 2025Scaling CrossQ with Weight Normalization4 Jun 2025
- 2025Improving Controller Generalization with Dimensionless Markov Decision Processes14 Apr 2025
- 2024Diminishing Return of Value Expansion Methods29 Dec 2024
- 2024Handling Long-Term Safety and Uncertainty in Safe Reinforcement Learning18 Sep 2024
- 2024GenSafe: A Generalizable Safety Enhancer for Safe Reinforcement Learning Algorithms Based on Reduced Order Markov Decision Process Model6 Jun 2024
- 2024Future Aware Safe Active Learning of Time Varying Systems using Gaussian Processes17 May 2024
- 2024Safe Reinforcement Learning on the Constraint Manifold: Theory and Applications13 Apr 2024
- 2023Modeling Risk in Reinforcement Learning: A Literature Mapping8 Dec 2023
- 2023Diverse Priors for Deep Reinforcement Learning23 Oct 2023
- 2023Recent Trends in Artificial Intelligence Technology: A Scoping Review8 May 2023
- 2023Diminishing Return of Value Expansion Methods in Model-Based Reinforcement Learning7 Mar 2023
- 2023Adaptive Aggregation for Safety-Critical Control7 Feb 2023
16 more
- 2022Provable Safe Reinforcement Learning with Binary Feedback26 Oct 2022
- 2022Model-based Safe Deep Reinforcement Learning via a Constrained Proximal Policy Optimization Algorithm14 Oct 2022
- 2022Safe Reinforcement Learning of Dynamic High-Dimensional Robotic Tasks: Navigation, Manipulation, Interaction27 Sep 2022
- 2022Guided Safe Shooting: model based reinforcement learning with safety constraints20 Jun 2022
- 2022Effects of Safety State Augmentation on Safe Exploration6 Jun 2022
- 2022A Review of Safe Reinforcement Learning: Methods, Theory and Applications20 May 2022
- 2022Saute RL: Almost Surely Safe Reinforcement Learning Using State Augmentation14 Feb 2022
- 2022Demystifying Reinforcement Learning in Time-Varying Systems14 Jan 2022
- 2021Model-Based Safe Reinforcement Learning with Time-Varying State and Control Constraints: An Application to Intelligent Vehicles18 Dec 2021
- 2021Look Before You Leap: Safe Model-Based Reinforcement Learning with Human Intervention10 Nov 2021
- 2021Risk Sensitive Model-Based Reinforcement Learning using Uncertainty Guided Planning9 Nov 2021
- 2021DESTA: A Framework for Safe Reinforcement Learning with Markov Games of Intervention27 Oct 2021
- 2021Learning Robust Controllers Via Probabilistic Model-Based Policy Search26 Oct 2021
- 2021Safe Reinforcement Learning Using Robust Control Barrier Functions11 Oct 2021
- 2021Revisiting Design Choices in Offline Model-Based Reinforcement Learning8 Oct 2021
- 2021Learning Collision-free and Torque-limited Robot Trajectories based on Alternative Safe Behaviors5 Mar 2021
- 2022A Review of Safe Reinforcement Learning: Methods, Theory and Applicationscited by 169
- 2022Saute RL: Almost Surely Safe Reinforcement Learning Using State Augmentationcited by 63
- 2021Safe Reinforcement Learning Using Robust Control Barrier Functionscited by 44
- 2022Model-based Safe Deep Reinforcement Learning via a Constrained Proximal Policy Optimization Algorithmcited by 27
- 2022Safe Reinforcement Learning of Dynamic High-Dimensional Robotic Tasks: Navigation, Manipulation, Interactioncited by 15
- 2024Safe Reinforcement Learning on the Constraint Manifold: Theory and Applicationscited by 12
- 2022Provable Safe Reinforcement Learning with Binary Feedbackcited by 7
- 2021Look Before You Leap: Safe Model-Based Reinforcement Learning with Human Interventioncited by 5
- 2022Effects of Safety State Augmentation on Safe Explorationcited by 5
- 2023Diminishing Return of Value Expansion Methods in Model-Based Reinforcement Learningcited by 5
- 2021DESTA: A Framework for Safe Reinforcement Learning with Markov Games of Interventioncited by 4
- 2021Risk Sensitive Model-Based Reinforcement Learning using Uncertainty Guided Planningcited by 3
12 most cited of 26 All 26 (JSON)
- 2025Scaling CrossQ with Weight Normalization4 Jun 2025
- 2025Improving Controller Generalization with Dimensionless Markov Decision Processes14 Apr 2025
- 2024Diminishing Return of Value Expansion Methods29 Dec 2024
- 2024Handling Long-Term Safety and Uncertainty in Safe Reinforcement Learning18 Sep 2024
- 2024GenSafe: A Generalizable Safety Enhancer for Safe Reinforcement Learning Algorithms Based on Reduced Order Markov Decision Process Model6 Jun 2024
- 2024Future Aware Safe Active Learning of Time Varying Systems using Gaussian Processes17 May 2024
- 2024Safe Reinforcement Learning on the Constraint Manifold: Theory and Applications13 Apr 2024
- 2023Modeling Risk in Reinforcement Learning: A Literature Mapping8 Dec 2023
- 2023Diverse Priors for Deep Reinforcement Learning23 Oct 2023
- 2023Recent Trends in Artificial Intelligence Technology: A Scoping Review8 May 2023
- 2023Diminishing Return of Value Expansion Methods in Model-Based Reinforcement Learning7 Mar 2023
- 2023Adaptive Aggregation for Safety-Critical Control7 Feb 2023
12 newest of 26 All 26 (JSON)