mlsanityData to 7 Oct 2026

Global Safe Sequential Learning via Efficient Knowledge Transfer

arXiv 2402.14402 ↗First posted 22 Feb 2024cs.LG stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

Sequential learning methods, such as active learning and Bayesian optimization, aim to select the most informative data for task learning. In many applications, however, data selection is constrained by unknown safety conditions, motivating the development of safe learning approaches. A promising line of safe learning methods uses Gaussian processes to model safety conditions, restricting data selection to areas with high safety confidence. However, these methods are limited to local exploration around an initial seed dataset, as safety confidence centers around observed data points. As a consequence, task exploration is slowed down and safe regions disconnected from the initial seed dataset remain unexplored. In this paper, we propose safe transfer sequential learning to accelerate task learning and to expand the explorable safe region. By leveraging abundant offline data from a related source task, our approach guides exploration in the target task more effectively. We also provide a theoretical analysis to explain why single-task method cannot cope with disconnected regions. Finally, we introduce a computationally efficient approximation of our method that reduces runtime through pre-computations. Our experiments demonstrate that this approach, compared to state-of-the-art methods, learns tasks with lower data consumption and enhances global exploration across multiple disjoint safe regions, while maintaining comparable computational efficiency.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 44 references that are in the map. First posted on arXiv 22 Feb 2024.

Builds on

24 of 44 references.

References · 24

  1. 2014Scalable Variational Gaussian Process Classificationcited by 226
  2. 2018Gaussian Processes and Kernel Methods: A Review on Connections and Equivalencescited by 188
  3. 2016Bayesian Optimization with Safety Constraints: Safe and Automatic Parameter Tuning in Roboticscited by 134
  4. 2014Bayesian Optimization with Unknown Constraintscited by 109
  5. 2016Multi-Information Source Optimizationcited by 83
  6. 2018Stagewise Safe Bayesian Optimization with Gaussian Processescited by 79
  7. 2015Safe Controller Optimization for Quadrotors with Gaussian Processescited by 77
  8. 2015Predictive Entropy Search for Bayesian Optimization with Unknown Constraintscited by 51
  9. 2019Safe Exploration for Interactive Machine Learningcited by 51
  10. 2015A General Framework for Constrained Bayesian Optimization using Information-based Searchcited by 50
  11. 2020Multi-Fidelity Bayesian Optimization via Deep Neural Networkscited by 46
  12. 2017Virtual vs. Real: Trading Off Simulations and Physical Experiments in Reinforcement Learning with Bayesian Optimizationcited by 33
12 more
  1. 2023Inducing Point Allocation for Sparse Gaussian Processes in High-Throughput Bayesian Optimisationcited by 32
  2. 2021GoSafe: Globally Optimal Safe Robot Learningcited by 27
  3. 2021Transfer Learning with Gaussian Processes for Bayesian Optimizationcited by 26
  4. 2022Bayesian Active Learning with Fully Bayesian Gaussian Processescited by 26
  5. 2022Meta-Learning Priors for Safe Bayesian Optimizationcited by 14
  6. 2022Safe Active Learning for Multi-Output Gaussian Processescited by 13
  7. 2019Posterior Variance Analysis of Gaussian Processes with Application to Average Learning Curvescited by 12
  8. 2024Safe Active Learning for Time-Series Modeling with Gaussian Processescited by 12
  9. 2015Near-Optimal Active Learning of Multi-Output Gaussian Processescited by 10
  10. 2018Non-linear process convolutions for multi-output Gaussian processescited by 10
  11. 2022Structural Kernel Search via Bayesian Optimization and Symbolical Optimal Transportcited by 8
  12. 2019Safe global optimization of expensive noisy black-box functions in the δ-Lipschitz frameworkcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.