On Finding Local Nash Equilibria (and Only Local Nash Equilibria) in Zero-Sum Games
Not on the map. Why?
Abstract (arXiv)
We propose local symplectic surgery, a two-timescale procedure for finding local Nash equilibria in two-player zero-sum games. We first show that previous gradient-based algorithms cannot guarantee convergence to local Nash equilibria due to the existence of non-Nash stationary points. By taking advantage of the differential structure of the game, we construct an algorithm for which the local Nash equilibria are the only attracting fixed points. We also show that the algorithm exhibits no oscillatory behaviors in neighborhoods of equilibria and show that it has the same per-iteration complexity as other recently proposed algorithms. We conclude by validating the algorithm on two numerical examples: a toy example with multiple Nash equilibria and a non-Nash equilibrium, and the training of a small generative adversarial network (GAN).
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 12; 2023: 7; 2024: 1; 2025: 4; 2026: 2.
35 papers.
Sort:
By area:
- 2022COLA: Consistent Learning with Opponent-Learning Awarenesscited by 38
- 2022Modeling Content Creator Incentives on Algorithm-Curated Platformscited by 35
- 2022Environment Generation for Zero-Shot Compositional Reinforcement Learningcited by 32
- 2022Accelerated Single-Call Methods for Constrained Min-Max Optimizationcited by 31
- 2023Escaping limit cycles: Global convergence for constrained nonconvex-nonconcave minimax problemscited by 21
- 2022General Intelligence Requires Rethinking Explorationcited by 20
- 2021Fast Distributionally Robust Learning with Variance Reduced Min-Max Optimizationcited by 19
- 2022Efficiently Escaping Saddle Points in Bilevel Optimizationcited by 19
- 2021On the Convergence of Stochastic Extragradient for Bilinear Games using Restarted Iteration Averagingcited by 18
- 2021Discretization Drift in Two-Player Gamescited by 14
- 2021Adversarial Environment Generation for Learning to Navigate the Webcited by 13
- 2022Riemannian Hamiltonian methods for min-max optimization on manifoldscited by 12
23 more
- 2022Sion's Minimax Theorem in Geodesic Metric Spaces and a Riemannian Extragradient Algorithmcited by 9
- 2021Minimax Optimization with Smooth Algorithmic Adversariescited by 8
- 2021Nonconvex-Nonconcave Min-Max Optimization with a Small Maximization Domaincited by 8
- 2023Stability and Generalization of the Decentralized Stochastic Gradient Descent Ascent Algorithmcited by 8
- 2021A Game-Theoretic Approach to Multi-Agent Trust Region Optimizationcited by 7
- 2021On Characterizing GAN Convergence Through Proximal Duality Gapcited by 3
- 2023Adaptive Consensus Optimization Method for GANscited by 3
- 2022Simultaneous Transport Evolution for Minimax Equilibria on Measurescited by 2
- 2022Robust Forecasting for Robotic Control: A Game-Theoretic Approachcited by 2
- 2023Last-Iterate Convergence of Adaptive Riemannian Gradient Descent for Equilibrium Computationcited by 2
- 2024Exploring the Precise Dynamics of Single-Layer GAN Models: Leveraging Multi-Feature Discriminators for High-Dimensional Subspace Learningcited by 2
- 2025Policy Design for Two-sided Platforms with Participation Dynamicscited by 2
- 2025A Framework for Finding Local Saddle Points in Two-Player Zero-Sum Black-Box Gamescited by 1
- 2025Efficient compression of neural networks and datasetscited by 1
- 2025Two-Player Zero-Sum Games with Bandit Feedbackcited by 1
- 2021GDA-AM: On the effectiveness of solving minimax optimization via Anderson Accelerationcited by 0
- 2022On the Nash equilibrium of moment-matching GANs for stationary Gaussian processescited by 0
- 2022Finding mixed-strategy equilibria of continuous-action games without gradients using randomized policy networkscited by 0
- 2023ApproxED: Approximate exploitability descent via learned best responsescited by 0
- 2023Uncoupled Learning of Differential Stackelberg Equilibria with Commitmentscited by 0
- 2023A Gentle Introduction to Gradient-Based Optimization and Variational Inequalities for Machine Learningcited by 0
- 2026Local exponential stability of mean-field Langevin descent-ascent and associated particle systemcited by 0
- 2026LLM Active Alignment: A Nash Equilibrium Perspectivecited by 0
- 2026LLM Active Alignment: A Nash Equilibrium Perspective6 Feb 2026
- 2026Local exponential stability of mean-field Langevin descent-ascent and associated particle system2 Feb 2026
- 2025Two-Player Zero-Sum Games with Bandit Feedback17 Jun 2025
- 2025Efficient compression of neural networks and datasets23 May 2025
- 2025A Framework for Finding Local Saddle Points in Two-Player Zero-Sum Black-Box Games23 Mar 2025
- 2025Policy Design for Two-sided Platforms with Participation Dynamics3 Feb 2025
- 2024Exploring the Precise Dynamics of Single-Layer GAN Models: Leveraging Multi-Feature Discriminators for High-Dimensional Subspace Learning1 Nov 2024
- 2023Stability and Generalization of the Decentralized Stochastic Gradient Descent Ascent Algorithm31 Oct 2023
- 2023A Gentle Introduction to Gradient-Based Optimization and Variational Inequalities for Machine Learning9 Sep 2023
- 2023Last-Iterate Convergence of Adaptive Riemannian Gradient Descent for Equilibrium Computation29 Jun 2023
- 2023Adaptive Consensus Optimization Method for GANs20 Apr 2023
- 2023Escaping limit cycles: Global convergence for constrained nonconvex-nonconcave minimax problems20 Feb 2023
23 more
- 2023Uncoupled Learning of Differential Stackelberg Equilibria with Commitments7 Feb 2023
- 2023ApproxED: Approximate exploitability descent via learned best responses20 Jan 2023
- 2022Finding mixed-strategy equilibria of continuous-action games without gradients using randomized policy networks29 Nov 2022
- 2022General Intelligence Requires Rethinking Exploration15 Nov 2022
- 2022Accelerated Single-Call Methods for Constrained Min-Max Optimization6 Oct 2022
- 2022Robust Forecasting for Robotic Control: A Game-Theoretic Approach22 Sep 2022
- 2022Modeling Content Creator Incentives on Algorithm-Curated Platforms27 Jun 2022
- 2022Riemannian Hamiltonian methods for min-max optimization on manifolds25 Apr 2022
- 2022On the Nash equilibrium of moment-matching GANs for stationary Gaussian processes14 Mar 2022
- 2022COLA: Consistent Learning with Opponent-Learning Awareness8 Mar 2022
- 2022Simultaneous Transport Evolution for Minimax Equilibria on Measures14 Feb 2022
- 2022Sion's Minimax Theorem in Geodesic Metric Spaces and a Riemannian Extragradient Algorithm13 Feb 2022
- 2022Efficiently Escaping Saddle Points in Bilevel Optimization8 Feb 2022
- 2022Environment Generation for Zero-Shot Compositional Reinforcement Learning21 Jan 2022
- 2021Nonconvex-Nonconcave Min-Max Optimization with a Small Maximization Domain8 Oct 2021
- 2021GDA-AM: On the effectiveness of solving minimax optimization via Anderson Acceleration6 Oct 2021
- 2021On the Convergence of Stochastic Extragradient for Bilinear Games using Restarted Iteration Averaging30 Jun 2021
- 2021A Game-Theoretic Approach to Multi-Agent Trust Region Optimization12 Jun 2021
- 2021Minimax Optimization with Smooth Algorithmic Adversaries2 Jun 2021
- 2021Discretization Drift in Two-Player Games28 May 2021
- 2021On Characterizing GAN Convergence Through Proximal Duality Gap11 May 2021
- 2021Fast Distributionally Robust Learning with Variance Reduced Min-Max Optimization27 Apr 2021
- 2021Adversarial Environment Generation for Learning to Navigate the Web2 Mar 2021
- 2026LLM Active Alignment: A Nash Equilibrium Perspectivecited by 0
- 2026LLM Active Alignment: A Nash Equilibrium Perspective6 Feb 2026
- 2022COLA: Consistent Learning with Opponent-Learning Awarenesscited by 38
- 2022Modeling Content Creator Incentives on Algorithm-Curated Platformscited by 35
- 2022Environment Generation for Zero-Shot Compositional Reinforcement Learningcited by 32
- 2022Accelerated Single-Call Methods for Constrained Min-Max Optimizationcited by 31
- 2023Escaping limit cycles: Global convergence for constrained nonconvex-nonconcave minimax problemscited by 21
- 2022General Intelligence Requires Rethinking Explorationcited by 20
- 2021Fast Distributionally Robust Learning with Variance Reduced Min-Max Optimizationcited by 19
- 2022Efficiently Escaping Saddle Points in Bilevel Optimizationcited by 19
- 2021On the Convergence of Stochastic Extragradient for Bilinear Games using Restarted Iteration Averagingcited by 18
- 2021Discretization Drift in Two-Player Gamescited by 14
- 2021Adversarial Environment Generation for Learning to Navigate the Webcited by 13
- 2022Riemannian Hamiltonian methods for min-max optimization on manifoldscited by 12
12 most cited of 34 All 34 (JSON)
- 2026Local exponential stability of mean-field Langevin descent-ascent and associated particle system2 Feb 2026
- 2025Two-Player Zero-Sum Games with Bandit Feedback17 Jun 2025
- 2025Efficient compression of neural networks and datasets23 May 2025
- 2025A Framework for Finding Local Saddle Points in Two-Player Zero-Sum Black-Box Games23 Mar 2025
- 2025Policy Design for Two-sided Platforms with Participation Dynamics3 Feb 2025
- 2024Exploring the Precise Dynamics of Single-Layer GAN Models: Leveraging Multi-Feature Discriminators for High-Dimensional Subspace Learning1 Nov 2024
- 2023Stability and Generalization of the Decentralized Stochastic Gradient Descent Ascent Algorithm31 Oct 2023
- 2023A Gentle Introduction to Gradient-Based Optimization and Variational Inequalities for Machine Learning9 Sep 2023
- 2023Last-Iterate Convergence of Adaptive Riemannian Gradient Descent for Equilibrium Computation29 Jun 2023
- 2023Adaptive Consensus Optimization Method for GANs20 Apr 2023
- 2023Escaping limit cycles: Global convergence for constrained nonconvex-nonconcave minimax problems20 Feb 2023
- 2023Uncoupled Learning of Differential Stackelberg Equilibria with Commitments7 Feb 2023
12 newest of 34 All 34 (JSON)