mlsanityData to 14 Oct 2026

Near-Optimal Complexity of Finite-Sum Nonconvex-Strongly-Concave Minimax Optimization

arXiv 2610.04944 ↗First posted 4 Oct 2026math.OC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We characterize, up to logarithmic factors, the minimax expected query complexity of finite-sum nonconvex-strongly-concave optimization under mean-squared averaged smoothness. For randomized zero-respecting incremental first-order algorithms, the complexity is tildeTheta(n+min√n,kappa,n3/4√kappa,LDeltavarepsilon-2) throughout kappa=L/μ≥1, under exact dual initialization and for 0<varepsilon2≤ c0LDelta, where c0>0 is universal. This characterization is our main result. A dual-chain construction provides the lower bound and matches the existing Catalyst upper bound for kappa≥√n. For 1≤kappa≤√n, we introduce recursive proximal descent-ascent (RPDA), which retains a recursive gradient estimator across proximal subproblems and attains tildeO(n+√n,kappa LDeltavarepsilon-2) with a fixed query budget. Both upper bounds guarantee an expected squared primal gradient at most varepsilon2. Under individual smoothness, we also prove Omega(n+minkappa,√nkappa,LDeltavarepsilon-2) for every kappa≥1. It matches the polynomial upper rate for a bilinear subclass when kappa≥ n; the intermediate-condition-number gap remains open.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 16 references that are in the map. First posted on arXiv 4 Oct 2026.

Builds on

13 of 16 references.

References · 13

  1. 2018SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path Integrated Differential Estimatorcited by 287
  2. 2020Stochastic Recursive Gradient Descent Ascent for Stochastic Nonconvex-Strongly-Concave Minimax Problemscited by 77
  3. 2017Lower Bounds for Finding Stationary Points II: First-Order Methodscited by 58
  4. 2021Faster Single-loop Algorithms for Minimax Optimization without Strong Concavitycited by 49
  5. 2021The Complexity of Nonconvex-Strongly-Concave Minimax Optimizationcited by 45
  6. 2021Complexity Lower Bounds for Nonconvex-Strongly-Concave Min-Max Optimizationcited by 36
  7. 2021Lower Complexity Bounds of Finite-Sum Optimization Problems: The Results and Constructioncited by 24
  8. 2019Lower Bounds for Smooth Nonconvex Finite-Sum Optimizationcited by 20
  9. 2021Near Optimal Stochastic Algorithms for Finite-Sum Unbalanced Convex-Concave Minimax Optimizationcited by 16
  10. 2022Sharper Rates for Separable Minimax and Finite Sum Optimization via Primal-Dual Extragradient Methodscited by 15
  11. 2026Lower Bounds for Nonconvex-Concave Minimax Optimizationcited by 3
  12. 2026Dense Weak Hiding: Closing Complexity Gaps in Nonconvex and PL Finite-Sum Optimization under Individual Smoothnesscited by 1
1 more
  1. 2026Tight Stochastic Condition-Number Dependence in Nonconvex-Strongly-Concave Minimax Optimizationcited by 1

Built on by

Not cited yet.