mlsanityData to 14 Oct 2026

Tight Stochastic Condition-Number Dependence in Nonconvex-Strongly-Concave Minimax Optimization

arXiv 2609.30877 ↗First posted 25 Sep 2026math.OC cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

We study whether the linear condition-number dependence in the stochastic complexity of SAPD+ is necessary for nonconvex-strongly-concave minimax optimization. For jointly L-smooth objectives with dual strong-concavity parameter μ, we prove a lower bound that matches the SAPD+ upper bound under the same Moreau-envelope stationarity criterion and the same primal-dual initialization gap. Specifically, when σ≥varepsilon, the worst-case complexity of zero-respecting algorithms is Theta(kappa LGσ2varepsilon-4) in the stated accuracy regime, where kappa=L/μ, G bounds the initial primal-dual gap, and σ2 bounds the variance of a general unbiased first-order oracle. The lower bound is realized on a smooth problem class with a bounded dual box. Our construction routes each link of a nonconvex zero-chain through a dual gradient of magnitude proportional to varepsilon/√kappa, while an undiscovered primal coordinate prevents stationarity. It also yields the primal-gradient lower bound Omega(LDelta(√kappavarepsilon-2+kappaσ2varepsilon-4)) after combination with the known deterministic bound, where Delta bounds the initial primal function gap.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 13 references that are in the map. First posted on arXiv 25 Sep 2026.

Builds on

12 of 13 references.

References · 12

  1. 2019Lower Bounds for Non-Convex Stochastic Optimizationcited by 307
  2. 2019On Gradient Descent Ascent for Nonconvex-Concave Minimax Problemscited by 270
  3. 2017Lower Bounds for Finding Stationary Points Icited by 126
  4. 2020Near-Optimal Algorithms for Minimax Optimizationcited by 119
  5. 2020Stochastic Recursive Gradient Descent Ascent for Stochastic Nonconvex-Strongly-Concave Minimax Problemscited by 77
  6. 2021The Complexity of Nonconvex-Strongly-Concave Minimax Optimizationcited by 45
  7. 2021Complexity Lower Bounds for Nonconvex-Strongly-Concave Min-Max Optimizationcited by 36
  8. 2022SAPD+: An Accelerated Stochastic Method for Nonconvex-Concave Minimax Problemscited by 23
  9. 2025Lower Complexity Bounds for Nonconvex-Strongly-Convex Bilevel Optimization with First-Order Oraclescited by 3
  10. 2025On the Condition Number Dependency in Bilevel Optimizationcited by 3
  11. 2026Lower Bounds for Nonconvex-Concave Minimax Optimizationcited by 3
  12. 2026Lower Bounds for Nonconvex-PL Minimax Optimizationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.