mlsanityData to 14 Oct 2026

On the Suboptimality of GP-UCB under Polynomial Effective Optimism

arXiv 2312.01386 ↗First posted 3 Dec 2023cs.LG stat.MLcited by 4

Not on the map. Why?

Abstract (arXiv)

Gaussian process upper confidence bound (GP-UCB) is widely used for sequential optimization of expensive black-box functions. Although many upper bounds on its cumulative regret have been established in the literature, whether GP-UCB is minimax optimal remains open. We study this question through the effective optimism level, defined as the product of the exploration coefficient and the regularization parameter in kernel ridge regression. Under a uniform confidence assumption, we prove a new regret lower bound for GP-UCB with Mat'ern kernels. The bound shows that polynomial growth of the effective optimism level, up to logarithmic factors, rules out the minimax-optimal regret rate. Since this is the regime covered by most existing analyses, our result identifies a concrete obstacle to proving minimax optimality for standard GP-UCB. More broadly, it suggests that the gap between current upper bounds and minimax lower bounds may reflect a real limitation of the algorithm, not only of the analysis.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 8 of its 16 references that are in the map. First posted on arXiv 3 Dec 2023.

Builds on

8 of 16 references.

References · 8

  1. 2017On Kernelized Multi-armed Banditscited by 352
  2. 2020On Information Gain and Regret Bounds in Gaussian Process Banditscited by 158
  3. 2017Lower Bounds on Regret for Noisy Gaussian Process Bandit Optimizationcited by 78
  4. 2020Bandit optimisation of functions in the Mat'ern kernel RKHScited by 40
  5. 2023On the Sublinear Regret of GP-UCBcited by 26
  6. 2019Bayesian Optimization for Policy Search via Online-Offline Experimentationcited by 20
  7. 2021Open Problem: Tight Online Confidence Intervals for RKHS Elementscited by 13
  8. 2019Bayesian Optimization Allowing for Common Random Numberscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.