Robust Bayesian Target Value Optimization
Not on the map. Why?
Abstract (arXiv)
We consider the problem of finding an input to a stochastic black box function such that the scalar output of the black box function is as close as possible to a target value in the sense of the expected squared error. While the optimization of stochastic black boxes is classic in (robust) Bayesian optimization, the current approaches based on Gaussian processes predominantly focus either on i) maximization/minimization rather than target value optimization or ii) on the expectation, but not the variance of the output, ignoring output variations due to stochasticity in uncontrollable environmental variables. In this work, we fill this gap and derive acquisition functions for common criteria such as the expected improvement, the probability of improvement, and the lower confidence bound, assuming that aleatoric effects are Gaussian with known variance. Our experiments illustrate that this setting is compatible with certain extensions of Gaussian processes, and show that the thus derived acquisition functions can outperform classical Bayesian optimization even if the latter assumptions are violated. An industrial use case in billet forging is presented.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 26 of its 54 references that are in the map. First posted on arXiv 11 Jan 2023.
Builds on
26 of 54 references.
References · 26
- 2018A Tutorial on Bayesian Optimizationcited by 744
- 2013Gaussian Processes for Big Datacited by 383
- 2019Scalable Global Optimization via Local Bayesian Optimizationcited by 374
- 2015Scalable Bayesian Optimization Using Deep Neural Networkscited by 284
- 2018When Gaussian Process Meets Big Data: A Review of Scalable GPscited by 206
- 2013Bayesian Optimization in a Billion Dimensions via Random Embeddingscited by 182
- 2015High Dimensional Bayesian Optimisation and Bandits via Additive Modelscited by 139
- 2017Constrained Bayesian Optimization with Noisy Experimentscited by 104
- 2021Multi-Objective Bayesian Optimization over High-Dimensional Search Spacescited by 87
- 2018Adversarially Robust Optimization with Gaussian Processescited by 62
- 2020Distributionally Robust Bayesian Optimizationcited by 61
- 2018A General Framework for Multi-fidelity Bayesian Optimization with Gaussian Processescited by 52
14 more
- 2019Bayesian Optimization of Composite Functionscited by 46
- 2022Robust Multi-Objective Bayesian Optimization Under Input Noisecited by 37
- 2022Thinking inside the box: A tutorial on grey-box Bayesian optimizationcited by 26
- 2018Bayesian Optimization with Expensive Integrandscited by 24
- 2020Noisy-Input Entropy Search for Efficient Robust Bayesian Optimizationcited by 24
- 2016Unscented Bayesian Optimization for Safe Robot Graspingcited by 18
- 2019Bayesian optimisation under uncertain inputscited by 18
- 2020Mean-Variance Analysis in Bayesian Optimization under Uncertaintycited by 18
- 2014Bayesian Multi-Scale Optimistic Optimizationcited by 11
- 2021Bayesian Surrogate Analysis and Uncertainty Propagationcited by 10
- 2021JUMBO: Scalable Multi-task Bayesian Optimization using Offline Datacited by 8
- 2021Many Objective Bayesian Optimizationcited by 4
- 2016Extending Expected Improvement for High-dimensional Stochastic Optimization of Expensive Black-Box Functionscited by 3
- 2022A connection between probability, physics and neural networkscited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 2.
3 papers.