mlsanityData to 7 Oct 2026

Single-Loop Stochastic Projected Damped Extragradient Methods for Stochastic Nonconvex--(Strongly) Concave Minimax Optimization

arXiv 2609.21747 ↗First posted 18 Sep 2026math.OC cs.LG stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

We develop single-loop stochastic projected damped extragradient methods for stochastic nonconvex--(strongly) concave minimax optimization, with complexity guarantees for both game stationarity (GS) and optimization stationarity (OS). Our approach combines a stochastic projected damped extragradient (SPDE) method with a recursive variance-reduced variant, VR-SPDE, both of which retain a single-loop structure. Under an unbiased stochastic gradient oracle with uniformly bounded variance, SPDE finds an varepsilon-game-stationary point with stochastic first-order oracle (SFO) complexities of O(kappavarepsilon-4) and O(varepsilon-5) in the nonconvex--strongly concave and nonconvex--concave settings, respectively, where kappa=L/μ. Under an additional mean-square Lipschitz condition on the stochastic gradients, VR-SPDE improves these GS complexities to O(kappa3/2varepsilon-3) and O(varepsilon-9/2), respectively. For an varepsilon-optimization-stationary point, SPDE achieves SFO complexities of O(kappavarepsilon-4) and O(varepsilon-6), while VR-SPDE achieves O(kappa3/2varepsilon-3) and O(varepsilon-6), in the two settings, respectively. These OS guarantees match the best-known bounds achieved by multi-loop methods while preserving a single-loop implementation. To the best of our knowledge, our results provide the best-known SFO complexity guarantees among single-loop stochastic first-order methods for the respective stationarity criteria and problem classes.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 15 references that are in the map. First posted on arXiv 18 Sep 2026.

Builds on

14 of 15 references.

References · 14

  1. 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,232
  2. 2018SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path Integrated Differential Estimatorcited by 283
  3. 2019On Gradient Descent Ascent for Nonconvex-Concave Minimax Problemscited by 266
  4. 2017SARAH: A Novel Method for Machine Learning Problems Using Stochastic Recursive Gradientcited by 218
  5. 2015Distributionally Robust Logistic Regressioncited by 124
  6. 2020Stochastic Recursive Gradient Descent Ascent for Stochastic Nonconvex-Strongly-Concave Minimax Problemscited by 75
  7. 2018Weakly-Convex Concave Min-Max Optimization: Provable Algorithms and Applications in Machine Learningcited by 62
  8. 2017Learning with Average Top-k Losscited by 52
  9. 2021Faster Single-loop Algorithms for Minimax Optimization without Strong Concavitycited by 47
  10. 2020Accelerated Zeroth-Order and First-Order Momentum Methods from Mini to Minimax Optimizationcited by 39
  11. 2022SAPD+: An Accelerated Stochastic Method for Nonconvex-Concave Minimax Problemscited by 23
  12. 2015Decentralized learning for wireless communications and networkingcited by 9
2 more
  1. 2023An accelerated first-order regularized momentum descent ascent algorithm for stochastic nonconvex-concave minimax problemscited by 1
  2. 2025Efficient Single-Loop Stochastic Algorithms for Nonconvex-Concave Minimax Optimizationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.