Safe Learning of Regions of Attraction for Uncertain, Nonlinear Systems with Gaussian Processes
Not on the map. Why?
Abstract (arXiv)
Control theory can provide useful insights into the properties of controlled, dynamic systems. One important property of nonlinear systems is the region of attraction (ROA), a safe subset of the state space in which a given controller renders an equilibrium point asymptotically stable. The ROA is typically estimated based on a model of the system. However, since models are only an approximation of the real world, the resulting estimated safe region can contain states outside the ROA of the real system. This is not acceptable in safety-critical applications. In this paper, we consider an approach that learns the ROA from experiments on a real system, without ever leaving the true ROA and, thus, without risking safety-critical failures. Based on regularity assumptions on the model errors in terms of a Gaussian process prior, we use an underlying Lyapunov function in order to determine a region in which an equilibrium point is asymptotically stable with high probability. Moreover, we provide an algorithm to actively and safely explore the state space in order to expand the ROA estimate. We demonstrate the effectiveness of this method in simulation.
Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Mar 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 13; 2022: 9; 2023: 3; 2024: 7; 2025: 1; 2026: 5.
39 papers.
Sort:
By area:
- 2018EnsembleDAgger: A Bayesian Approach to Safe Imitation Learningcited by 100
- 2021Practical and Rigorous Uncertainty Bounds for Gaussian Process Regressioncited by 49
- 2022Neural Lyapunov Control of Unknown Nonlinear Systems with Stability Guaranteescited by 40
- 2023Physics-Informed Machine Learning for Modeling and Control of Dynamical Systemscited by 28
- 2021GoSafe: Globally Optimal Safe Robot Learningcited by 27
- 2021There Is No Turning Back: A Self-Supervised Approach for Reversibility-Aware Reinforcement Learningcited by 18
- 2022Safe Model-Based Reinforcement Learning with an Uncertainty-Aware Reachability Certificatecited by 18
- 2023A Human-Centered Safe Robot Reinforcement Learning Framework with Interactive Behaviorscited by 15
- 2021Model Error Propagation via Learned Contraction Metrics for Safe Feedback Motion Planning of Unknown Systemscited by 13
- 2021Pointwise Feasibility of Gaussian Process-based Safety-Critical Control under Model Uncertaintycited by 13
- 2022Statistical Safety and Robustness Guarantees for Feedback Motion Planning of Unknown Underactuated Stochastic Systemscited by 11
- 2021Learning the Koopman Eigendecomposition: A Diffeomorphic Approachcited by 9
27 more
- 2024Stability-informed Bayesian Optimization for MPC Cost Function Learningcited by 8
- 2024Learning Control Barrier Functions and their application in Reinforcement Learning: A Surveycited by 8
- 2021Uniform Error and Posterior Variance Bounds for Gaussian Process Regression with Application to Safe Controlcited by 7
- 2024Safe and Stable Closed-Loop Learning for Neural-Network-Supported Model Predictive Controlcited by 7
- 2026Safety Beyond the Training Data: Robust Out-of-Distribution MPC via Conformalized System Level Synthesiscited by 7
- 2022SAAC: Safe Reinforcement Learning as an Adversarial Game of Actor-Criticscited by 6
- 2022Effects of Safety State Augmentation on Safe Explorationcited by 6
- 2021Inverse Reinforcement Learning: A Control Lyapunov Approachcited by 5
- 2021Formal Verification of Unknown Dynamical Systems via Gaussian Process Regressioncited by 5
- 2022Physically Consistent Learning of Conservative Lagrangian Systems with Gaussian Processescited by 5
- 2023System-level Safety Guard: Safe Tracking Control through Uncertain Neural Network Dynamics Modelscited by 5
- 2021Lyapunov-based uncertainty-aware safe reinforcement learningcited by 3
- 2022Gaussian Control Barrier Functions : A Non-Parametric Paradigm to Safetycited by 2
- 2022Recursively Feasible Probabilistic Safe Online Learning with Control Barrier Functionscited by 2
- 2024Stochastic Reinforcement Learning with Stability Guarantees for Control of Unknown Nonlinear Systemscited by 2
- 2021OpReg-Boost: Learning to Accelerate Online Algorithms with Operator Regressioncited by 1
- 2021Learning To Estimate Regions Of Attraction Of Autonomous Dynamical Systems Using Physics-Informed Neural Networkscited by 1
- 2022Model-free Learning of Regions of Attraction via Recurrent Setscited by 1
- 2021Data Generation Method for Learning a Low-dimensional Safe Region in Safe Reinforcement Learningcited by 0
- 2024GenSafe: A Generalizable Safety Enhancer for Safe Reinforcement Learning Algorithms Based on Reduced Order Markov Decision Process Modelcited by 0
- 2024Improving the Region of Attraction of a Multi-rotor UAV by Estimating Unknown Disturbancescited by 0
- 2024Theoretical Analysis of Heteroscedastic Gaussian Processes with Posterior Distributionscited by 0
- 2025Lyapunov Stability Learning with Nonlinear Control via Inductive Biasescited by 0
- 2026On the Equilibrium between Feasible Zone and Uncertain Model in Safe Explorationcited by 0
- 2026Learning over Forward-Invariant Policy Classes: Reinforcement Learning without Safety Concernscited by 0
- 2026Hierarchical Causal Abduction: A Foundation Framework for Explainable Model Predictive Controlcited by 0
- 2026Proactive Context-Forecasted Safety Constraints for Nonstationary Reinforcement Learningcited by 0
- 2026Proactive Context-Forecasted Safety Constraints for Nonstationary Reinforcement Learning8 Sep 2026
- 2026Hierarchical Causal Abduction: A Foundation Framework for Explainable Model Predictive Control11 May 2026
- 2026Learning over Forward-Invariant Policy Classes: Reinforcement Learning without Safety Concerns9 Apr 2026
- 2026Safety Beyond the Training Data: Robust Out-of-Distribution MPC via Conformalized System Level Synthesis12 Feb 2026
- 2026On the Equilibrium between Feasible Zone and Uncertain Model in Safe Exploration31 Jan 2026
- 2025Lyapunov Stability Learning with Nonlinear Control via Inductive Biases3 Nov 2025
- 2024Theoretical Analysis of Heteroscedastic Gaussian Processes with Posterior Distributions19 Sep 2024
- 2024Safe and Stable Closed-Loop Learning for Neural-Network-Supported Model Predictive Control16 Sep 2024
- 2024Stochastic Reinforcement Learning with Stability Guarantees for Control of Unknown Nonlinear Systems12 Sep 2024
- 2024Improving the Region of Attraction of a Multi-rotor UAV by Estimating Unknown Disturbances30 Aug 2024
- 2024GenSafe: A Generalizable Safety Enhancer for Safe Reinforcement Learning Algorithms Based on Reduced Order Markov Decision Process Model6 Jun 2024
- 2024Learning Control Barrier Functions and their application in Reinforcement Learning: A Survey22 Apr 2024
27 more
- 2024Stability-informed Bayesian Optimization for MPC Cost Function Learning18 Apr 2024
- 2023System-level Safety Guard: Safe Tracking Control through Uncertain Neural Network Dynamics Models11 Dec 2023
- 2023Physics-Informed Machine Learning for Modeling and Control of Dynamical Systems24 Jun 2023
- 2023A Human-Centered Safe Robot Reinforcement Learning Framework with Interactive Behaviors25 Feb 2023
- 2022Statistical Safety and Robustness Guarantees for Feedback Motion Planning of Unknown Underactuated Stochastic Systems13 Dec 2022
- 2022Safe Model-Based Reinforcement Learning with an Uncertainty-Aware Reachability Certificate14 Oct 2022
- 2022Recursively Feasible Probabilistic Safe Online Learning with Control Barrier Functions23 Aug 2022
- 2022Physically Consistent Learning of Conservative Lagrangian Systems with Gaussian Processes24 Jun 2022
- 2022Effects of Safety State Augmentation on Safe Exploration6 Jun 2022
- 2022Neural Lyapunov Control of Unknown Nonlinear Systems with Stability Guarantees4 Jun 2022
- 2022Model-free Learning of Regions of Attraction via Recurrent Sets21 Apr 2022
- 2022SAAC: Safe Reinforcement Learning as an Adversarial Game of Actor-Critics20 Apr 2022
- 2022Gaussian Control Barrier Functions : A Non-Parametric Paradigm to Safety29 Mar 2022
- 2021Formal Verification of Unknown Dynamical Systems via Gaussian Process Regression31 Dec 2021
- 2021Learning To Estimate Regions Of Attraction Of Autonomous Dynamical Systems Using Physics-Informed Neural Networks18 Nov 2021
- 2021Learning the Koopman Eigendecomposition: A Diffeomorphic Approach15 Oct 2021
- 2021Data Generation Method for Learning a Low-dimensional Safe Region in Safe Reinforcement Learning10 Sep 2021
- 2021Lyapunov-based uncertainty-aware safe reinforcement learning29 Jul 2021
- 2021Pointwise Feasibility of Gaussian Process-based Safety-Critical Control under Model Uncertainty13 Jun 2021
- 2021There Is No Turning Back: A Self-Supervised Approach for Reversibility-Aware Reinforcement Learning8 Jun 2021
- 2021GoSafe: Globally Optimal Safe Robot Learning27 May 2021
- 2021OpReg-Boost: Learning to Accelerate Online Algorithms with Operator Regression27 May 2021
- 2021Practical and Rigorous Uncertainty Bounds for Gaussian Process Regression6 May 2021
- 2021Model Error Propagation via Learned Contraction Metrics for Safe Feedback Motion Planning of Unknown Systems18 Apr 2021
- 2021Inverse Reinforcement Learning: A Control Lyapunov Approach9 Apr 2021
- 2021Uniform Error and Posterior Variance Bounds for Gaussian Process Regression with Application to Safe Control13 Jan 2021
- 2018EnsembleDAgger: A Bayesian Approach to Safe Imitation Learning22 Jul 2018
- 2024Learning Control Barrier Functions and their application in Reinforcement Learning: A Surveycited by 8
- 2024Safe and Stable Closed-Loop Learning for Neural-Network-Supported Model Predictive Controlcited by 7
- 2024Stochastic Reinforcement Learning with Stability Guarantees for Control of Unknown Nonlinear Systemscited by 2
- 2024GenSafe: A Generalizable Safety Enhancer for Safe Reinforcement Learning Algorithms Based on Reduced Order Markov Decision Process Modelcited by 0
- 2026On the Equilibrium between Feasible Zone and Uncertain Model in Safe Explorationcited by 0
- 2026Learning over Forward-Invariant Policy Classes: Reinforcement Learning without Safety Concernscited by 0
- 2026Proactive Context-Forecasted Safety Constraints for Nonstationary Reinforcement Learningcited by 0
- 2026Proactive Context-Forecasted Safety Constraints for Nonstationary Reinforcement Learning8 Sep 2026
- 2026Learning over Forward-Invariant Policy Classes: Reinforcement Learning without Safety Concerns9 Apr 2026
- 2026On the Equilibrium between Feasible Zone and Uncertain Model in Safe Exploration31 Jan 2026
- 2024Safe and Stable Closed-Loop Learning for Neural-Network-Supported Model Predictive Control16 Sep 2024
- 2024Stochastic Reinforcement Learning with Stability Guarantees for Control of Unknown Nonlinear Systems12 Sep 2024
- 2024GenSafe: A Generalizable Safety Enhancer for Safe Reinforcement Learning Algorithms Based on Reduced Order Markov Decision Process Model6 Jun 2024
- 2024Learning Control Barrier Functions and their application in Reinforcement Learning: A Survey22 Apr 2024
- 2021Practical and Rigorous Uncertainty Bounds for Gaussian Process Regressioncited by 49
- 2022Neural Lyapunov Control of Unknown Nonlinear Systems with Stability Guaranteescited by 40
- 2023Physics-Informed Machine Learning for Modeling and Control of Dynamical Systemscited by 28
- 2021GoSafe: Globally Optimal Safe Robot Learningcited by 27
- 2021There Is No Turning Back: A Self-Supervised Approach for Reversibility-Aware Reinforcement Learningcited by 18
- 2022Safe Model-Based Reinforcement Learning with an Uncertainty-Aware Reachability Certificatecited by 18
- 2023A Human-Centered Safe Robot Reinforcement Learning Framework with Interactive Behaviorscited by 15
- 2021Model Error Propagation via Learned Contraction Metrics for Safe Feedback Motion Planning of Unknown Systemscited by 13
- 2021Pointwise Feasibility of Gaussian Process-based Safety-Critical Control under Model Uncertaintycited by 13
- 2022Statistical Safety and Robustness Guarantees for Feedback Motion Planning of Unknown Underactuated Stochastic Systemscited by 11
- 2021Learning the Koopman Eigendecomposition: A Diffeomorphic Approachcited by 9
- 2024Stability-informed Bayesian Optimization for MPC Cost Function Learningcited by 8
12 most cited of 30 All 30 (JSON)
- 2026Hierarchical Causal Abduction: A Foundation Framework for Explainable Model Predictive Control11 May 2026
- 2026Safety Beyond the Training Data: Robust Out-of-Distribution MPC via Conformalized System Level Synthesis12 Feb 2026
- 2025Lyapunov Stability Learning with Nonlinear Control via Inductive Biases3 Nov 2025
- 2024Theoretical Analysis of Heteroscedastic Gaussian Processes with Posterior Distributions19 Sep 2024
- 2024Improving the Region of Attraction of a Multi-rotor UAV by Estimating Unknown Disturbances30 Aug 2024
- 2024Stability-informed Bayesian Optimization for MPC Cost Function Learning18 Apr 2024
- 2023System-level Safety Guard: Safe Tracking Control through Uncertain Neural Network Dynamics Models11 Dec 2023
- 2023Physics-Informed Machine Learning for Modeling and Control of Dynamical Systems24 Jun 2023
- 2023A Human-Centered Safe Robot Reinforcement Learning Framework with Interactive Behaviors25 Feb 2023
- 2022Statistical Safety and Robustness Guarantees for Feedback Motion Planning of Unknown Underactuated Stochastic Systems13 Dec 2022
- 2022Safe Model-Based Reinforcement Learning with an Uncertainty-Aware Reachability Certificate14 Oct 2022
- 2022Recursively Feasible Probabilistic Safe Online Learning with Control Barrier Functions23 Aug 2022
12 newest of 30 All 30 (JSON)