mlsanityData to 14 Oct 2026

Efficient Minimax Optimal Global Optimization of Lipschitz Continuous Multivariate Functions

arXiv 2206.02383 ↗First posted 6 Jun 2022cs.LG cs.CC math.OCcited by 2

Not on the map. Why?

Abstract (arXiv)

In this work, we propose an efficient minimax optimal global optimization algorithm for multivariate Lipschitz continuous functions. To evaluate the performance of our approach, we utilize the average regret instead of the traditional simple regret, which, as we show, is not suitable for use in the multivariate non-convex optimization because of the inherent hardness of the problem itself. Since we study the average regret of the algorithm, our results directly imply a bound for the simple regret as well. Instead of constructing lower bounding proxy functions, our method utilizes a predetermined query creation rule, which makes it computationally superior to the Piyavskii-Shubert variants. We show that our algorithm achieves an average regret bound of O(L√nT^-frac1n) for the optimization of an n-dimensional L-Lipschitz continuous objective in a time horizon T, which we show to be minimax optimal.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 9 of its 52 references that are in the map. First posted on arXiv 6 Jun 2022.

Builds on

9 of 52 references.

References · 9

  1. 2021Convex optimizationcited by 2,515
  2. 2014Convex Optimization: Algorithms and Complexitycited by 575
  3. 2017Non-convex Optimization for Machine Learningcited by 133
  4. 2017Global optimization of Lipschitz functionscited by 39
  5. 2018A simple parameter-free and adaptive approach to optimization under a minimal local smoothness assumptioncited by 23
  6. 2018Sequential Outlier Detection based on Incremental Decision Treescited by 21
  7. 2020Regret analysis of the Piyavskii-Shubert algorithm for global Lipschitz optimizationcited by 11
  8. 2022Low Regret Binary Sampling Method for Efficient Global Optimization of Univariate Functionscited by 11
  9. 2021Cumulative Regret Analysis of the Piyavskii--Shubert Algorithm and Its Variants for Global Optimizationcited by 9

Built on by

Cited by year

Citing papers per year: 2023: 2.

2 papers.