Small-Gain Nash: Certified Contraction to Nash Equilibria in Differentiable Games
Not on the map. Why?
Abstract (arXiv)
Classical convergence guarantees for gradient-based learning in games require the pseudo-gradient to be (strongly) monotone in Euclidean geometry as shown by rosen(1965), a condition that often fails even in simple games with strong cross-player couplings. We introduce Small-Gain Nash (SGN), a block small-gain condition in a custom block-weighted geometry. SGN converts local curvature and cross-player Lipschitz coupling bounds into a tractable certificate of contraction. It constructs a weighted block metric in which the pseudo-gradient becomes strongly monotone on any region where these bounds hold, even when it is non-monotone in the Euclidean sense. The continuous flow is exponentially contracting in this designed geometry, and projected Euler and RK4 discretizations converge under explicit step-size bounds derived from the SGN margin and a local Lipschitz constant. Our analysis reveals a certified "timescale band", a non-asymptotic, metric-based certificate that plays a TTUR-like role: rather than forcing asymptotic timescale separation via vanishing, unequal step sizes, SGN identifies a finite band of relative metric weights for which a single-step-size dynamics is provably contractive. We validate the framework on quadratic games where Euclidean monotonicity analysis fails to predict convergence, but SGN successfully certifies it, and extend the construction to mirror/Fisher geometries for entropy-regularized policy gradient in Markov games. The result is an offline certification pipeline that estimates curvature, coupling, and Lipschitz parameters on compact regions, optimizes block weights to enlarge the SGN margin, and returns a structural, computable convergence certificate consisting of a metric, contraction rate, and safe step-sizes for non-monotone games.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 29 references that are in the map. First posted on arXiv 7 Dec 2025.
Builds on
6 of 29 references.
References · 6
- 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,621
- 2018Optimistic mirror descent in saddle-point problems: Going the extra (gradient) milecited by 136
- 2014Analysis and Design of Optimization Algorithms via Integral Quadratic Constraintscited by 105
- 2023Time-Varying Convex Optimization: A Contraction and Equilibrium Tracking Approachcited by 6
- 2024Proximal Gradient Dynamics: Monotonicity, Exponential Convergence, and Applicationscited by 4
- 2021From Contraction Theory to Fixed Point Algorithms on Riemannian and Non-Euclidean Spacescited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025NashPG: A Policy Gradient Method with Iteratively Refined Regularization for Finding Nash Equilibria
- 2026Pessimism-Free Offline Learning in General-Sum Games via KL Regularization
- 2025Proximal Point Nash Learning from Human Feedback
- 2025Can Reinforcement Learning Solve Asymmetric Combinatorial-Continuous Zero-Sum Games?
- 2026High-Probability Nash Regret for Decentralized Learning in Markov α-Potential Games: Episodic and Fully Online Asynchronous Algorithms with Applications to Markov Congestion Games
- 2025Solving Zero-Sum Convex Markov Games
- 2026Equilibrium Selection in Multi-Agent Policy Gradients via Opponent-Aware Basin Entry
- 2026DiffNash: Finding Nash Equilibrium in High-Dimensional Continuous Action Spaces with Diffusion Policies