mlsanityData to 7 Oct 2026

A computationally lightweight safe learning algorithm

arXiv 2309.03672 ↗First posted 7 Sep 2023eess.SY cs.LG cs.SYcited by 3

Not on the map. Why?

Abstract (arXiv)

Safety is an essential asset when learning control policies for physical systems, as violating safety constraints during training can lead to expensive hardware damage. In response to this need, the field of safe learning has emerged with algorithms that can provide probabilistic safety guarantees without knowledge of the underlying system dynamics. Those algorithms often rely on Gaussian process inference. Unfortunately, Gaussian process inference scales cubically with the number of data points, limiting applicability to high-dimensional and embedded systems. In this paper, we propose a safe learning algorithm that provides probabilistic safety guarantees but leverages the Nadaraya-Watson estimator instead of Gaussian processes. For the Nadaraya-Watson estimator, we can reach logarithmic scaling with the number of data points. We provide theoretical guarantees for the estimates, embed them into a safe learning algorithm, and show numerical experiments on a simulated seven-degrees-of-freedom robot manipulator.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 10 of its 23 references that are in the map. First posted on arXiv 7 Sep 2023.

Builds on

10 of 23 references.

References · 10

  1. 2015Continuous control with deep reinforcement learningcited by 3,279
  2. 2016Benchmarking Deep Reinforcement Learning for Continuous Controlcited by 361
  3. 2021Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learningcited by 337
  4. 2016Bayesian Optimization with Safety Constraints: Safe and Automatic Parameter Tuning in Roboticscited by 134
  5. 2018Stagewise Safe Bayesian Optimization with Gaussian Processescited by 79
  6. 2021GoSafe: Globally Optimal Safe Robot Learningcited by 27
  7. 2022GoSafeOpt: Scalable Safe Exploration for Global Optimization of Dynamical Systemscited by 17
  8. 2020Certainty Equivalent Perception-Based Controlcited by 11
  9. 2021Safe and Efficient Model-free Adaptive Control via Bayesian Optimizationcited by 10
  10. 2023Decentralized diffusion-based learning under non-parametric limited prior knowledgecited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.