mlsanityData to 7 Oct 2026

Tight Lower Bounds under Asymmetric High-Order H"older Smoothness and Uniform Convexity

arXiv 2409.10773 ↗First posted 16 Sep 2024math.OC stat.MLcited by 3

Not on the map. Why?

Abstract (arXiv)

In this paper, we provide tight lower bounds for the oracle complexity of minimizing high-order H"older smooth and uniformly convex functions. Specifically, for a function whose pth-order derivatives are H"older continuous with degree nu and parameter H, and that is uniformly convex with degree q and parameter σ, we focus on two asymmetric cases: (1) q > p + nu, and (2) q < p+nu. Given up to pth-order oracle access, we establish worst-case oracle complexities of Omegaleft( left( fracHσright)^frac23(p+nu)-2left( fracσεright)^frac2(q-p-nu)q(3(p+nu)-2)right) in the first case with an ℓ_∞-ball-truncated-Gaussian smoothed hard function and Omegaleft(left(fracHσright)^frac23(p+nu)-2+ loglogleft(left(fracσp+nuHqright)^frac1p+nu-qfrac1εright)right) in the second case, for reaching an ε-approximate solution in terms of the optimality gap. Our analysis generalizes previous lower bounds for functions under first- and second-order smoothness as well as those for uniformly convex functions, and furthermore our results match the corresponding upper bounds in this general setting.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 14 of its 33 references that are in the map. First posted on arXiv 16 Sep 2024.

Builds on

14 of 33 references.

References · 14

  1. 2021Convex optimizationcited by 2,479
  2. 2013On Lower Complexity Bounds for Large-Scale Smooth Convex Optimizationcited by 24
  3. 2017Oracle Complexity of Second-Order Methods for Smooth Convex Optimizationcited by 23
  4. 2022The First Optimal Acceleration of High-Order Methods in Smooth Convex Optimizationcited by 19
  5. 2018Near-optimal method for highly smooth convex optimizationcited by 16
  6. 2017Lower Bounds for Higher-Order Convex Optimizationcited by 12
  7. 2018An Optimal High-Order Tensor Method for Convex Optimizationcited by 12
  8. 2019Minimizing Uniformly Convex Functions by Cubic Regularization of Newton Methodcited by 12
  9. 2014Primal-dual subgradient methods for minimizing uniformly convex functionscited by 11
  10. 2018The global rate of convergence for optimal tensor methods in smooth convex optimizationcited by 10
  11. 2021Near-Optimal Lower Bounds For Convex Optimization For All Orders of Smoothnesscited by 6
  12. 2020High-Order Oracle Complexity of Smooth and Strongly Convex Optimizationcited by 4
2 more
  1. 2022Lower Complexity Bounds for Minimizing Regularized Functionscited by 2
  2. 2024Complexity of Minimizing Regularized Convex Quadratic Functionscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.