mlsanityData to 14 Oct 2026

Accelerated and Stable Convergence with Anchored Generalized Optimistic Method

arXiv 2606.21528 ↗First posted 19 Jun 2026math.OC cs.GT cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We study first-order methods for solving monotone variational inequalities arising in min-max optimization. Classical approaches such as the extragradient method rely on two gradient queries per iteration, which limits their analysis and applicability in the online and stochastic settings. We propose a family of Generalized Optimistic Methods with Anchoring (GOMA), which combine two-time-scale optimistic updates with an anchoring term inspired by Halpern iteration. In the deterministic setting, GOMA achieves the optimal accelerated last-iterate rate O(1/k2) on the squared gradient norm for monotone Lipschitz operators. In the stochastic setting with unbounded variance, a simplified single-call variant of GOMA achieves a last-iterate convergence rate of O(1/√k) on the squared gradient norm. To the best of our knowledge, this is the first such guarantee for stochastic monotone Lipschitz variational inequalities in the unconstrained setting without variance reduction or growing batches.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 51 references that are in the map. First posted on arXiv 19 Jun 2026.

Builds on

35 of 51 references.

References · 35

  1. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  2. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  3. 2020Responsive Safety in Reinforcement Learning by PID Lagrangian Methodscited by 316
  4. 2018A Variational Inequality Perspective on Generative Adversarial Networkscited by 144
  5. 2019A Unified Analysis of Extra-gradient and Optimistic Gradient Methods for Saddle Point Problems: Proximal Point Approachcited by 143
  6. 2018Optimistic mirror descent in saddle-point problems: Going the extra (gradient) milecited by 136
  7. 2019On the convergence of single-call stochastic extra-gradient methodscited by 89
  8. 2021Accelerated Algorithms for Smooth Convex-Concave Minimax Problems with O(1/k2) Rate on Squared Gradient Normcited by 73
  9. 2022A Unified Approach to Reinforcement Learning, Quantal Response Equilibria, and Two-Player Zero-Sum Gamescited by 66
  10. 2021Fast Extra Gradient Methods for Smooth Structured Nonconvex-Nonconcave Minimax Problemscited by 62
  11. 2020Halpern Iteration for Near-Optimal and Parameter-Free Monotone Inclusion and Strong Solutions to Variational Inequalitiescited by 61
  12. 2023High-Probability Bounds for Stochastic Optimization and Variational Inequalities: the Case of Unbounded Variancecited by 61
23 more
  1. 2018Negative Momentum for Improved Game Dynamicscited by 60
  2. 2020Explore Aggressively, Update Conservatively: Stochastic Extragradient Methods with Variable Stepsize Scalingcited by 49
  3. 2020Tight last-iterate convergence rates for no-regret learning in multi-player gamescited by 49
  4. 2018On the Ineffectiveness of Variance Reduced Optimization for Deep Learningcited by 48
  5. 2021Stochastic Variance Reduction for Variational Inequality Methodscited by 47
  6. 2021Extragradient Method: O(1/K) Last-Iterate Convergence for Monotone Variational Inequalities and Connections With Cocoercivitycited by 39
  7. 2022Last-Iterate Convergence of Optimistic Gradient Method for Monotone Variational Inequalitiescited by 33
  8. 2022Accelerated Single-Call Methods for Constrained Min-Max Optimizationcited by 32
  9. 2019Finite Regret and Cycles with Fixed Step-Size via Alternating Gradient Descent-Ascentcited by 29
  10. 2023High-Probability Convergence for Composite and Distributed Stochastic Minimization and Variational Inequalities with Heavy-Tailed Noisecited by 24
  11. 2021Halpern-Type Accelerated and Splitting Algorithms For Monotone Inclusionscited by 21
  12. 2022Near-Optimal Algorithms for Making the Gradient Small in Stochastic Minimax Optimizationcited by 20
  13. 2022Stochastic Halpern Iteration with Variance Reduction for Stochastic Monotone Inclusionscited by 19
  14. 2022Tight Last-Iterate Convergence of the Extragradient and the Optimistic Gradient Descent-Ascent Algorithm for Constrained Monotone Variational Inequalitiescited by 19
  15. 2024On PI Controllers for Updating Lagrange Multipliers in Constrained Optimizationcited by 12
  16. 2023Accelerating Value Iteration with Anchoringcited by 11
  17. 2022Smooth Monotone Stochastic Variational Inequalities and Saddle Point Problems: A Surveycited by 10
  18. 2024Optimal Acceleration for Minimax and Fixed-Point Problems is Not Uniquecited by 7
  19. 2024Boosting Perturbed Gradient Ascent for Last-Iterate Convergence in Gamescited by 5
  20. 2026Solving Stochastic Variational Inequalities without the Bounded Variance Assumptioncited by 5
  21. 2023A Fast Optimistic Method for Monotone Variational Inequalitiescited by 3
  22. 2026An Improved Last-Iterate Convergence Rate for Anchored Gradient Descent Ascentcited by 3
  23. 2024Addressing Rotational Learning Dynamics in Multi-Agent Reinforcement Learningcited by 2

Built on by

Not cited yet.