Single-Loop Stochastic Projected Damped Extragradient Methods for Stochastic Nonconvex--(Strongly) Concave Minimax Optimization
Not on the map. Why?
Abstract (arXiv)
We develop single-loop stochastic projected damped extragradient methods for stochastic nonconvex--(strongly) concave minimax optimization, with complexity guarantees for both game stationarity (GS) and optimization stationarity (OS). Our approach combines a stochastic projected damped extragradient (SPDE) method with a recursive variance-reduced variant, VR-SPDE, both of which retain a single-loop structure. Under an unbiased stochastic gradient oracle with uniformly bounded variance, SPDE finds an varepsilon-game-stationary point with stochastic first-order oracle (SFO) complexities of O(kappavarepsilon-4) and O(varepsilon-5) in the nonconvex--strongly concave and nonconvex--concave settings, respectively, where kappa=L/μ. Under an additional mean-square Lipschitz condition on the stochastic gradients, VR-SPDE improves these GS complexities to O(kappa3/2varepsilon-3) and O(varepsilon-9/2), respectively. For an varepsilon-optimization-stationary point, SPDE achieves SFO complexities of O(kappavarepsilon-4) and O(varepsilon-6), while VR-SPDE achieves O(kappa3/2varepsilon-3) and O(varepsilon-6), in the two settings, respectively. These OS guarantees match the best-known bounds achieved by multi-loop methods while preserving a single-loop implementation. To the best of our knowledge, our results provide the best-known SFO complexity guarantees among single-loop stochastic first-order methods for the respective stationarity criteria and problem classes.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 15 references that are in the map. First posted on arXiv 18 Sep 2026.
Builds on
14 of 15 references.
References · 14
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,232
- 2018SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path Integrated Differential Estimatorcited by 283
- 2019On Gradient Descent Ascent for Nonconvex-Concave Minimax Problemscited by 266
- 2017SARAH: A Novel Method for Machine Learning Problems Using Stochastic Recursive Gradientcited by 218
- 2015Distributionally Robust Logistic Regressioncited by 124
- 2020Stochastic Recursive Gradient Descent Ascent for Stochastic Nonconvex-Strongly-Concave Minimax Problemscited by 75
- 2018Weakly-Convex Concave Min-Max Optimization: Provable Algorithms and Applications in Machine Learningcited by 62
- 2017Learning with Average Top-k Losscited by 52
- 2021Faster Single-loop Algorithms for Minimax Optimization without Strong Concavitycited by 47
- 2020Accelerated Zeroth-Order and First-Order Momentum Methods from Mini to Minimax Optimizationcited by 39
- 2022SAPD+: An Accelerated Stochastic Method for Nonconvex-Concave Minimax Problemscited by 23
- 2015Decentralized learning for wireless communications and networkingcited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.