mlsanityData to 7 Oct 2026

Extragradient-Type Methods with O (1/k) Last-Iterate Convergence Rates for Co-Hypomonotone Inclusions

arXiv 2302.04099 ↗First posted 8 Feb 2023math.OC stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

We develop two "Nesterov's accelerated" variants of the well-known extragradient method to approximate a solution of a co-hypomonotone inclusion constituted by the sum of two operators, where one is Lipschitz continuous and the other is possibly multivalued. The first scheme can be viewed as an accelerated variant of Tseng's forward-backward-forward splitting (FBFS) method, while the second one is a Nesterov's accelerated variant of the "past" FBFS scheme, which requires only one evaluation of the Lipschitz operator and one resolvent of the multivalued mapping. Under appropriate conditions on the parameters, we theoretically prove that both algorithms achieve O(1/k) last-iterate convergence rates on the residual norm, where k is the iteration counter. Our results can be viewed as alternatives of a recent class of Halpern-type methods for root-finding problems. For comparison, we also provide a new convergence analysis of the two recent extra-anchored gradient-type methods for solving co-hypomonotone inclusions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 81 references that are in the map. First posted on arXiv 8 Feb 2023.

Builds on

34 of 81 references.

References · 34

  1. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  2. 2016Optimization Methods for Large-Scale Machine Learningcited by 1,140
  3. 2017Minimax Regret Bounds for Reinforcement Learningcited by 500
  4. 2020Large-Scale Methods for Distributionally Robust Optimizationcited by 179
  5. 2018A Variational Inequality Perspective on Generative Adversarial Networkscited by 144
  6. 2018The Limit Points of (Optimistic) Gradient Descent in Min-Max Optimizationcited by 98
  7. 2020A Survey on Generative Adversarial Networks: Variants, Applications, and Trainingcited by 97
  8. 2020Efficient Methods for Structured Nonconvex-Nonconcave Min-Max Optimizationcited by 94
  9. 2021Accelerated Algorithms for Smooth Convex-Concave Minimax Problems with O(1/k2) Rate on Squared Gradient Normcited by 71
  10. 2017A First Order Method for Solving Convex Bi-Level Optimization Problemscited by 67
  11. 2021Fast Extra Gradient Methods for Smooth Structured Nonconvex-Nonconcave Minimax Problemscited by 61
  12. 2020Halpern Iteration for Near-Optimal and Parameter-Free Monotone Inclusion and Strong Solutions to Variational Inequalitiescited by 60
22 more
  1. 2021Extragradient Method: O(1/K) Last-Iterate Convergence for Monotone Variational Inequalities and Connections With Cocoercivitycited by 39
  2. 2018Golden Ratio Algorithms for Variational Inequalitiescited by 38
  3. 2020Global Convergence and Variance-Reduced Optimization for a Class of Nonconvex-Nonconcave Minimax Problemscited by 37
  4. 2018A Forward-Backward Splitting Method for Monotone Inclusions Without Cocoercivitycited by 35
  5. 2015A Three-Operator Splitting Scheme and its Optimization Applicationscited by 34
  6. 2022Last-Iterate Convergence of Optimistic Gradient Method for Monotone Variational Inequalitiescited by 33
  7. 2022Accelerated Single-Call Methods for Constrained Min-Max Optimizationcited by 31
  8. 2014Accelerated Schemes For A Class of Variational Inequalitiescited by 30
  9. 2013On the Convergence Properties of Non-Euclidean Extragradient Methods for Variational Inequalities with Generalized Monotone Operatorscited by 29
  10. 2015Projected Reflected Gradient Methods for Monotone Variational Inequalitiescited by 27
  11. 2019Generalized monotone operators and their averaged resolventscited by 27
  12. 2022Solving Nonconvex-Nonconcave Min-Max Problems exhibiting Weak Minty Solutionscited by 27
  13. 2022Exact Optimal Accelerated Complexity for Fixed-Point Iterationscited by 23
  14. 2021Halpern-Type Accelerated and Splitting Algorithms For Monotone Inclusionscited by 20
  15. 2022From Halpern's Fixed-Point Iterations to Nesterov's Accelerated Interpretations for Root-Finding Problemscited by 18
  16. 2022Fast Optimistic Gradient Descent Ascent (OGDA) method in continuous and discrete timecited by 10
  17. 2023Randomized Block-Coordinate Optimistic Gradient Algorithms for Root-Finding Problemscited by 9
  18. 2020Online learning with dynamics: A minimax perspectivecited by 8
  19. 2021Fast convergence of generalized forward-backward algorithms for structured monotone inclusionscited by 6
  20. 2017Convergence of inertial dynamics and proximal algorithms governed by maximally monotone operatorscited by 4
  21. 2019A reflected forward-backward splitting method for monotone inclusions involving Lipschitzian operatorscited by 3
  22. 2017Strong Metric Subregularity of Mappings in Variational Analysis and Optimizationcited by 1

Built on by

Not cited yet.