Safe Guaranteed Exploration for Non-linear Systems
Not on the map. Why?
Abstract (arXiv)
Safely exploring environments with a-priori unknown constraints is a fundamental challenge that restricts the autonomy of robots. While safety is paramount, guarantees on sufficient exploration are also crucial for ensuring autonomous task completion. To address these challenges, we propose a novel safe guaranteed exploration framework using optimal control, which achieves first-of-its-kind results: guaranteed exploration for non-linear systems with finite time sample complexity bounds, while being provably safe with arbitrarily high probability. The framework is general and applicable to many real-world scenarios with complex non-linear dynamics and unknown domains. We improve the efficiency of this general framework by proposing an algorithm, SageMPC, SAfe Guaranteed Exploration using Model Predictive Control. SageMPC leverages three key techniques: i) exploiting a Lipschitz bound, ii) goal-directed exploration, and iii) receding horizon style re-planning, all while maintaining the desired sample complexity, safety and exploration guarantees of the framework. Lastly, we demonstrate safe efficient exploration in challenging unknown environments using SageMPC with a car model.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 21 of its 45 references that are in the map. First posted on arXiv 9 Feb 2024.
Builds on
21 of 45 references.
References · 21
- 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 603
- 2017On Kernelized Multi-armed Banditscited by 348
- 2016Control Barrier Function Based Quadratic Programs for Safety Critical Systemscited by 261
- 2017Hamilton-Jacobi Reachability: A Brief Overview and Recent Advancescited by 186
- 2020On Information Gain and Regret Bounds in Gaussian Process Banditscited by 156
- 2016Bayesian Optimization with Safety Constraints: Safe and Automatic Parameter Tuning in Roboticscited by 134
- 2017Cautious Model Predictive Control using Gaussian Process Regressioncited by 91
- 2018A predictive safety filter for learning-based control of constrained nonlinear dynamical systemscited by 91
- 2018Stagewise Safe Bayesian Optimization with Gaussian Processescited by 79
- 2019Adaptive and Safe Bayesian Optimization in High Dimensions via One-Dimensional Subspacescited by 73
- 2016Safe Exploration in Finite Markov Decision Processes with Gaussian Processescited by 72
- 2019acados: a modular open-source framework for fast embedded optimal controlcited by 61
9 more
- 2019Safe Exploration for Interactive Machine Learningcited by 51
- 2023Submodular Reinforcement Learningcited by 23
- 2020FASTER: Fast and Safe Trajectory Planner for Navigation in Unknown Environmentscited by 13
- 2022Near-Optimal Multi-Agent Learning for Safe Coverage Controlcited by 11
- 2021Autonomous Teamed Exploration of Subterranean Environments using Legged and Aerial Robotscited by 5
- 2022Zero-Order Optimization for Gaussian Process-based Model Predictive Controlcited by 4
- 2023Analysis and design of model predictive control frameworks for dynamic operation -- An overviewcited by 4
- 2020Safe Trajectory Tracking in Uncertain Environmentscited by 3
- 2022Safe Exploration and Escape Local Minima with Model Predictive Control under Partially Unknown Constraintscited by 2
Built on by
Citing papers per year: 2025: 5; 2026: 3.
8 papers.
- 2025Performance-driven Constrained Optimal Auto-Tuner for MPCcited by 6
- 2026Safe Exploration via Policy Priorscited by 6
- 2025Finite-Sample-Based Reachability for Safe Control with Gaussian Process Dynamicscited by 5
- 2025Safe and Near-Optimal Control with Online Dynamics Learningcited by 1
- 2025Safely Learning Controlled Stochastic Dynamicscited by 0
- 2025A robust and adaptive MPC formulation for Gaussian process modelscited by 0
- 2026Sampling-Based Safe Reinforcement Learningcited by 0
- 2026Directional Constraints for Efficient Exploration in Safe Reinforcement Learningcited by 0
- 2026Directional Constraints for Efficient Exploration in Safe Reinforcement Learning14 Jul 2026
- 2026Sampling-Based Safe Reinforcement Learning19 May 2026
- 2026Safe Exploration via Policy Priors27 Jan 2026
- 2025Safe and Near-Optimal Control with Online Dynamics Learning20 Sep 2025
- 2025A robust and adaptive MPC formulation for Gaussian process models2 Jul 2025
- 2025Safely Learning Controlled Stochastic Dynamics3 Jun 2025
- 2025Finite-Sample-Based Reachability for Safe Control with Gaussian Process Dynamics12 May 2025
- 2025Performance-driven Constrained Optimal Auto-Tuner for MPC10 Mar 2025