Bayesian Optimization of Expensive Nested Grey-Box Functions
Not on the map. Why?
Abstract (arXiv)
We consider the problem of optimizing a grey-box objective function, i.e., nested function composed of both black-box and white-box functions. A general formulation for such grey-box problems is given, which covers the existing grey-box optimization formulations as special cases. We then design an optimism-driven algorithm to solve it. Under certain regularity assumptions, our algorithm achieves similar regret bound as that for the standard black-box Bayesian optimization algorithm, up to a constant multiplicative term depending on the Lipschitz constants of the functions considered. We further extend our method to the constrained case and discuss special cases. For the commonly used kernel functions, the regret bounds allow us to derive a convergence rate to the optimal solution. Experimental results show that our grey-box optimization method empirically improves the speed of finding the global optimal solution significantly, as compared to the standard black-box optimization algorithm.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 29 references that are in the map. First posted on arXiv 8 Jun 2023.
Builds on
21 of 29 references.
References · 21
- 2018A Tutorial on Bayesian Optimizationcited by 744
- 2017On Kernelized Multi-armed Banditscited by 352
- 2020On Information Gain and Regret Bounds in Gaussian Process Banditscited by 158
- 2017Multi-fidelity Bayesian Optimisation with Continuous Approximationscited by 121
- 2014Bayesian Optimization with Unknown Constraintscited by 109
- 2019Practical Multi-fidelity Bayesian Optimization for Hyperparameter Tuningcited by 93
- 2018What Doubling Tricks Can and Can't Do for Multi-Armed Banditscited by 71
- 2022Constrained Efficient Global Optimization of Expensive Black-box Functionscited by 49
- 2019Bayesian Optimization of Composite Functionscited by 46
- 2020Causal Bayesian Optimizationcited by 39
- 2020Bayesian Optimization of Risk Measurescited by 36
- 2021Bayesian Optimization of Function Networkscited by 33
9 more
- 2022Model-based Causal Bayesian Optimizationcited by 26
- 2018Bayesian Optimization with Expensive Integrandscited by 24
- 2021Dynamic Causal Bayesian Optimizationcited by 17
- 2021VABO: Violation-Aware Bayesian Optimization for Closed-Loop Control Performance Optimization with Unmodeled Constraintscited by 10
- 2022Lower Bounds on the Worst-Case Complexity of Efficient Global Optimizationcited by 7
- 2023Violation-Aware Contextual Bayesian Optimization for Controller Performance Optimization with Unmodeled Constraintscited by 6
- 2023No-Regret Constrained Bayesian Optimization of Noisy and Expensive Hybrid Models using Differentiable Quantile Function Approximationscited by 6
- 2023Constrained Causal Bayesian Optimizationcited by 6
- 2022CONFIG: Constrained Efficient Global Optimization for Closed-Loop Control System Optimization with Unmodeled Constraintscited by 3
Built on by
Citing papers per year: 2023: 1.
1 paper.