Learning-based Model Predictive Control for Safe Exploration
Not on the map. Why?
Abstract (arXiv)
Learning-based methods have been successful in solving complex control tasks without significant prior knowledge about the system. However, these methods typically do not provide any safety guarantees, which prevents their use in safety-critical, real-world applications. In this paper, we present a learning-based model predictive control scheme that can provide provable high-probability safety guarantees. To this end, we exploit regularity assumptions on the dynamics in terms of a Gaussian process prior to construct provably accurate confidence intervals on predicted trajectories. Unlike previous approaches, we do not assume that model uncertainties are independent. Based on these predictions, we guarantee that trajectories satisfy safety constraints. Moreover, we use a terminal set constraint to recursively guarantee the existence of safe control actions at every iteration. In our experiments, we show that the resulting algorithm can be used to safely and efficiently explore and learn about dynamic systems.
Key facts. Cited by 116 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 31; 2022: 27; 2023: 18; 2024: 18; 2025: 10; 2026: 12.
116 papers.
Sort:
By area:
- 2022A Review of Safe Reinforcement Learning: Methods, Theory and Applicationscited by 169
- 2021Learning Policies with Zero or Bounded Constraint Violation for Constrained MDPscited by 78
- 2025SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learningcited by 69
- 2022Saute RL: Almost Surely Safe Reinforcement Learning Using State Augmentationcited by 63
- 2022Constrained Policy Optimization via Bayesian World Modelscited by 55
- 2023SafeDreamer: Safe Reinforcement Learning with World Modelscited by 50
- 2021Practical and Rigorous Uncertainty Bounds for Gaussian Process Regressioncited by 49
- 2022Investigating Compounding Prediction Errors in Learned Dynamics Modelscited by 47
- 2021Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challengescited by 40
- 2021Context-Aware Safe Reinforcement Learning for Non-Stationary Environmentscited by 33
- 2022Trustworthy Reinforcement Learning Against Intrinsic Vulnerabilities: Robustness, Safety, and Generalizabilitycited by 32
- 2021Model-based Constrained Reinforcement Learning using Generalized Control Barrier Functioncited by 30
38 more
- 2022Safe Reinforcement Learning for Legged Locomotioncited by 29
- 2022Sustainable Online Reinforcement Learning for Auto-biddingcited by 28
- 2021Stability Verification in Stochastic Control Systems via Neural Network Supermartingalescited by 24
- 2022Sim-to-Lab-to-Real: Safe Reinforcement Learning with Shielding and Generalization Guaranteescited by 24
- 2022Safe Reinforcement Learning Using Black-Box Reachability Analysiscited by 22
- 2024ActSafe: Active Exploration with Safety Constraints for Reinforcement Learningcited by 22
- 2022Learning Control Policies for Stochastic Systems with Reach-avoid Guaranteescited by 21
- 2024Balance Reward and Safety Optimization for Safe Reinforcement Learning: A Perspective of Gradient Manipulationcited by 21
- 2021Safe Reinforcement Learning with Chance-constrained Model Predictive Controlcited by 18
- 2021Safe Continuous Control with Constrained Model-Based Policy Optimizationcited by 17
- 2022CUP: A Conservative Update Policy Algorithm for Safe Reinforcement Learningcited by 16
- 2023Robust Control for Dynamical Systems With Non-Gaussian Noise via Formal Abstractionscited by 16
- 2022Safe Reinforcement Learning of Dynamic High-Dimensional Robotic Tasks: Navigation, Manipulation, Interactioncited by 15
- 2024On Safety in Safe Bayesian Optimizationcited by 15
- 2021Robust Uncertainty Bounds in Reproducing Kernel Hilbert Spaces: A Convex Optimization Approachcited by 14
- 2021Model Error Propagation via Learned Contraction Metrics for Safe Feedback Motion Planning of Unknown Systemscited by 13
- 2021Sampling-Based Robust Control of Autonomous Systems with Non-Gaussian Noisecited by 13
- 2022Online Weak-form Sparse Identification of Partial Differential Equationscited by 13
- 2023A Human-Centered Safe Robot Reinforcement Learning Framework with Interactive Behaviorscited by 13
- 2025On Almost Surely Safe Alignment of Large Language Models at Inference-Timecited by 13
- 2021Distributed neural network control with dependability guarantees: a compositional port-Hamiltonian approachcited by 12
- 2023Compositional Policy Learning in Stochastic Control Systems with Formal Guaranteescited by 12
- 2024Safe Reinforcement Learning on the Constraint Manifold: Theory and Applicationscited by 12
- 2022Log Barriers for Safe Black-box Optimization with Application to Safe Reinforcement Learningcited by 11
- 2022Statistical Safety and Robustness Guarantees for Feedback Motion Planning of Unknown Underactuated Stochastic Systemscited by 11
- 2023Stable and Safe Reinforcement Learning via a Barrier-Lyapunov Actor-Critic Approachcited by 11
- 2024Safe and Balanced: A Framework for Constrained Multi-Objective Reinforcement Learningcited by 9
- 2023Can Learning Deteriorate Control? Analyzing Computational Delays in Gaussian Process-Based Event-Triggered Online Learningcited by 8
- 2021Uniform Error and Posterior Variance Bounds for Gaussian Process Regression with Application to Safe Controlcited by 7
- 2021MPC-based Reinforcement Learning for Economic Problems with Application to Battery Storagecited by 7
- 2021Adaptive Robust Model Predictive Control with Matched and Unmatched Uncertaintycited by 7
- 2021Improving Safety in Deep Reinforcement Learning using Unsupervised Action Planningcited by 7
- 2022VINet: Visual and Inertial-based Terrain Classification and Adaptive Navigation over Unknown Terraincited by 7
- 2025Safe LLM-Controlled Robots with Formal Guarantees via Reachability Analysiscited by 7
- 2022SAAC: Safe Reinforcement Learning as an Adversarial Game of Actor-Criticscited by 6
- 2024Towards safe and tractable Gaussian process-based MPC: Efficient sampling within a sequential quadratic programming frameworkcited by 6
- 2026Safe Exploration via Policy Priorscited by 6
- 2021Provably Correct Training of Neural Network Controllers Using Reachability Analysiscited by 5
50 most cited of 116 All 116 (JSON)
- 2026Provably Safe Sim-to-Real Transfer1 Sep 2026
- 2026Topological Feasibility Guarantees for Differentiable Predictive Control11 Aug 2026
- 2026Active Flow Expansion for Out-of-Distribution Discovery: from Theory to Molecules7 Jun 2026
- 2026All Models are Wrong, Knowing Where is Useful: On Model Uncertainty in Reinforcement Learning31 May 2026
- 2026Sampling-Based Safe Reinforcement Learning19 May 2026
- 2026Uncertainty-Aware Predictive Safety Filters for Probabilistic Neural Network Dynamics29 Apr 2026
- 2026MVAdapt: Zero-Shot Multi-Vehicle Adaptation for End-to-End Autonomous Driving13 Apr 2026
- 2026Statistical Contraction for Chance-Constrained Trajectory Optimization of Non-Gaussian Stochastic Systems7 Mar 2026
- 2026Gradient-Enhanced Partitioned Gaussian Processes for Real-Time Quadrotor Dynamics Modeling13 Feb 2026
- 2026Safe Reinforcement Learning via Recovery-based Shielding with Gaussian Process Dynamics Models12 Feb 2026
- 2026Constrained Meta Reinforcement Learning with Provable Test-Time Safety29 Jan 2026
- 2026Safe Exploration via Policy Priors27 Jan 2026
38 more
- 2025A Review of Learning-Based Motion Planning: Toward a Data-Driven Optimal Control Approach12 Dec 2025
- 2025Zero-Shot Function Encoder-Based Differentiable Predictive Control7 Nov 2025
- 2025Safe and Near-Optimal Control with Online Dynamics Learning20 Sep 2025
- 2025Multi-residual Mixture of Experts Learning for Cooperative Control in Multi-vehicle Systems14 Jul 2025
- 2025A robust and adaptive MPC formulation for Gaussian process models2 Jul 2025
- 2025Safely Learning Controlled Stochastic Dynamics3 Jun 2025
- 2025Finite-Sample-Based Reachability for Safe Control with Gaussian Process Dynamics12 May 2025
- 2025Safe LLM-Controlled Robots with Formal Guarantees via Reachability Analysis5 Mar 2025
- 2025SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learning5 Mar 2025
- 2025On Almost Surely Safe Alignment of Large Language Models at Inference-Time3 Feb 2025
- 2024First, Learn What You Don't Know: Active Information Gathering for Driving at the Limits of Handling31 Oct 2024
- 2024ActSafe: Active Exploration with Safety Constraints for Reinforcement Learning12 Oct 2024
- 2024Critic as Lyapunov function (CALF): a model-free, stability-ensuring agent15 Sep 2024
- 2024Towards safe and tractable Gaussian process-based MPC: Efficient sampling within a sequential quadratic programming framework13 Sep 2024
- 2024Learning Long-Horizon Predictions for Quadrotor Dynamics17 Jul 2024
- 2024Enhanced Safety in Autonomous Driving: Integrating Latent State Diffusion Model for End-to-End Navigation8 Jul 2024
- 2024Learning Autonomous Race Driving with Action Mapping Reinforcement Learning21 Jun 2024
- 2024Optimal Transport-Assisted Risk-Sensitive Q-Learning17 Jun 2024
- 2024Random Features Approximation for Control-Affine Systems10 Jun 2024
- 2024Safe and Balanced: A Framework for Constrained Multi-Objective Reinforcement Learning26 May 2024
- 2024Balance Reward and Safety Optimization for Safe Reinforcement Learning: A Perspective of Gradient Manipulation2 May 2024
- 2024Safe Reinforcement Learning on the Constraint Manifold: Theory and Applications13 Apr 2024
- 2024A Tutorial on Gaussian Process Learning-based Model Predictive Control2 Apr 2024
- 2024Robust Model Based Reinforcement Learning Using L1 Adaptive Control21 Mar 2024
- 2024On Safety in Safe Bayesian Optimization19 Mar 2024
- 2024Generalizing Cooperative Eco-driving via Multi-residual Task Learning7 Mar 2024
- 2024Safety Optimized Reinforcement Learning via Multi-Objective Policy Optimization23 Feb 2024
- 2024Long-term Safe Reinforcement Learning with Binary Feedback8 Jan 2024
- 2023Compositional Policy Learning in Stochastic Control Systems with Formal Guarantees3 Dec 2023
- 2023Learning Predictive Safety Filter via Decomposition of Robust Invariant Set12 Nov 2023
- 2023Out-of-Distribution-Aware Electric Vehicle Charging10 Nov 2023
- 2023Safe Online Dynamics Learning with Initially Unknown Models and Infeasible Safety Certificates3 Nov 2023
- 2023Reinforcement Learning in a Safety-Embedded MDP with Trajectory Optimization10 Oct 2023
- 2023Multi-Step Model Predictive Safety Filters: Reducing Chattering by Increasing the Prediction Horizon20 Sep 2023
- 2023SafeDreamer: Safe Reinforcement Learning with World Models14 Jul 2023
- 2023Model-Assisted Probabilistic Safe Adaptive Control With Meta-Bayesian Learning3 Jul 2023
- 2023Learning to Stabilize Online Reinforcement Learning in Unbounded State Spaces2 Jun 2023
- 2023Can Learning Deteriorate Control? Analyzing Computational Delays in Gaussian Process-Based Event-Triggered Online Learning14 May 2023
50 newest of 116 All 116 (JSON)
- 2024Generalizing Cooperative Eco-driving via Multi-residual Task Learningcited by 5
- 2024Learning Autonomous Race Driving with Action Mapping Reinforcement Learningcited by 1
- 2024Enhanced Safety in Autonomous Driving: Integrating Latent State Diffusion Model for End-to-End Navigationcited by 1
- 2026MVAdapt: Zero-Shot Multi-Vehicle Adaptation for End-to-End Autonomous Drivingcited by 1
- 2026MVAdapt: Zero-Shot Multi-Vehicle Adaptation for End-to-End Autonomous Driving13 Apr 2026
- 2024Enhanced Safety in Autonomous Driving: Integrating Latent State Diffusion Model for End-to-End Navigation8 Jul 2024
- 2024Learning Autonomous Race Driving with Action Mapping Reinforcement Learning21 Jun 2024
- 2024Generalizing Cooperative Eco-driving via Multi-residual Task Learning7 Mar 2024
- 2022Constrained Policy Optimization via Bayesian World Modelscited by 55
- 2023SafeDreamer: Safe Reinforcement Learning with World Modelscited by 50
- 2023SafeDreamer: Safe Reinforcement Learning with World Models14 Jul 2023
- 2022Constrained Policy Optimization via Bayesian World Models24 Jan 2022
- 2022A Review of Safe Reinforcement Learning: Methods, Theory and Applicationscited by 169
- 2021Learning Policies with Zero or Bounded Constraint Violation for Constrained MDPscited by 78
- 2022Saute RL: Almost Surely Safe Reinforcement Learning Using State Augmentationcited by 63
- 2021Practical and Rigorous Uncertainty Bounds for Gaussian Process Regressioncited by 49
- 2022Investigating Compounding Prediction Errors in Learned Dynamics Modelscited by 47
- 2021Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challengescited by 40
- 2021Context-Aware Safe Reinforcement Learning for Non-Stationary Environmentscited by 33
- 2022Trustworthy Reinforcement Learning Against Intrinsic Vulnerabilities: Robustness, Safety, and Generalizabilitycited by 32
- 2021Model-based Constrained Reinforcement Learning using Generalized Control Barrier Functioncited by 30
- 2022Safe Reinforcement Learning for Legged Locomotioncited by 29
- 2022Sustainable Online Reinforcement Learning for Auto-biddingcited by 28
- 2021Stability Verification in Stochastic Control Systems via Neural Network Supermartingalescited by 24
12 most cited of 107 All 107 (JSON)
- 2026Provably Safe Sim-to-Real Transfer1 Sep 2026
- 2026Topological Feasibility Guarantees for Differentiable Predictive Control11 Aug 2026
- 2026Active Flow Expansion for Out-of-Distribution Discovery: from Theory to Molecules7 Jun 2026
- 2026All Models are Wrong, Knowing Where is Useful: On Model Uncertainty in Reinforcement Learning31 May 2026
- 2026Sampling-Based Safe Reinforcement Learning19 May 2026
- 2026Uncertainty-Aware Predictive Safety Filters for Probabilistic Neural Network Dynamics29 Apr 2026
- 2026Statistical Contraction for Chance-Constrained Trajectory Optimization of Non-Gaussian Stochastic Systems7 Mar 2026
- 2026Gradient-Enhanced Partitioned Gaussian Processes for Real-Time Quadrotor Dynamics Modeling13 Feb 2026
- 2026Safe Reinforcement Learning via Recovery-based Shielding with Gaussian Process Dynamics Models12 Feb 2026
- 2026Constrained Meta Reinforcement Learning with Provable Test-Time Safety29 Jan 2026
- 2026Safe Exploration via Policy Priors27 Jan 2026
- 2025A Review of Learning-Based Motion Planning: Toward a Data-Driven Optimal Control Approach12 Dec 2025
12 newest of 107 All 107 (JSON)