mlsanityData to 7 Oct 2026

A Tight Lower Bound for Smooth Nonconvex Stochastic Optimization with Bounded Gradient Noise

arXiv 2608.09004 ↗First posted 10 Aug 2026math.OC cs.CC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We prove a sharp lower bound for smooth nonconvex stochastic optimization with uniformly bounded gradient noise. In the (K=1) fresh-sample model, every randomized adaptive algorithm requires Omegaleft( fracDelta Lε2 + fracDelta Lσ2ε4 right) queries to find a point with expected gradient norm at most (ε). This matches the standard upper bound and, to the best of our knowledge, resolves the question raised by [Arjevani et al. 2023] of whether almost-surely bounded oracle error permits a better rate than bounded variance. The proof was independently generated with GPT-5.6 Sol in Codex's Ultra mode during a two-hour session. The human author supplied the prompt and was responsible only forchecking the proof and revising and polishing the manuscript.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 7 references that are in the map. First posted on arXiv 10 Aug 2026.

Builds on

6 of 7 references.

References · 6

  1. 2013Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programmingcited by 716
  2. 2019Lower Bounds for Non-Convex Stochastic Optimizationcited by 303
  3. 2018SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path Integrated Differential Estimatorcited by 283
  4. 2017Lower Bounds for Finding Stationary Points Icited by 125
  5. 2024Provable Complexity Improvement of AdaGrad over SGD: Upper and Lower Bounds in Stochastic Non-Convex Optimizationcited by 16
  6. 2025Tight Lower Bounds and Optimal Algorithms for Stochastic Nonconvex Optimization with Heavy-Tailed Noisecited by 3

Built on by

Not cited yet.