On the Suboptimality of GP-UCB under Polynomial Effective Optimism
Not on the map. Why?
Abstract (arXiv)
Gaussian process upper confidence bound (GP-UCB) is widely used for sequential optimization of expensive black-box functions. Although many upper bounds on its cumulative regret have been established in the literature, whether GP-UCB is minimax optimal remains open. We study this question through the effective optimism level, defined as the product of the exploration coefficient and the regularization parameter in kernel ridge regression. Under a uniform confidence assumption, we prove a new regret lower bound for GP-UCB with Mat'ern kernels. The bound shows that polynomial growth of the effective optimism level, up to logarithmic factors, rules out the minimax-optimal regret rate. Since this is the regime covered by most existing analyses, our result identifies a concrete obstacle to proving minimax optimality for standard GP-UCB. More broadly, it suggests that the gap between current upper bounds and minimax lower bounds may reflect a real limitation of the algorithm, not only of the analysis.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 8 of its 16 references that are in the map. First posted on arXiv 3 Dec 2023.
Builds on
8 of 16 references.
References · 8
- 2017On Kernelized Multi-armed Banditscited by 352
- 2020On Information Gain and Regret Bounds in Gaussian Process Banditscited by 158
- 2017Lower Bounds on Regret for Noisy Gaussian Process Bandit Optimizationcited by 78
- 2020Bandit optimisation of functions in the Mat'ern kernel RKHScited by 40
- 2023On the Sublinear Regret of GP-UCBcited by 26
- 2019Bayesian Optimization for Policy Search via Online-Offline Experimentationcited by 20
- 2021Open Problem: Tight Online Confidence Intervals for RKHS Elementscited by 13
- 2019Bayesian Optimization Allowing for Common Random Numberscited by 9
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 1.
4 papers.
- 2025BARK: A Fully Bayesian Tree Kernel for Black-box Optimizationcited by 3
- 2025TextBO: Bayesian Optimization in Language Space for Eval-Efficient Self-Improving AIcited by 3
- 2024On Improved Regret Bounds In Bayesian Optimization with Gaussian Noisecited by 1
- 2026Bellman-sufficient Information Complexitycited by 1
- 2026Bellman-sufficient Information Complexity9 Jun 2026
- 2025TextBO: Bayesian Optimization in Language Space for Eval-Efficient Self-Improving AI15 Nov 2025
- 2025BARK: A Fully Bayesian Tree Kernel for Black-box Optimization7 Mar 2025
- 2024On Improved Regret Bounds In Bayesian Optimization with Gaussian Noise25 Dec 2024