Frequency-Based Hyperparameter Selection in Games
Not on the map. Why?
Abstract (arXiv)
Learning in smooth games fundamentally differs from standard minimization due to rotational dynamics, which invalidate classical hyperparameter tuning strategies. Despite their practical importance, effective methods for tuning in games remain underexplored. A notable example is LookAhead (LA), which achieves strong empirical performance but introduces additional parameters that critically influence performance. We propose a principled approach to hyperparameter selection in games by leveraging frequency estimation of oscillatory dynamics. Specifically, we analyze oscillations both in continuous-time trajectories and through the spectrum of the discrete dynamics in the associated frequency-based space. Building on this analysis, we introduce Modal LookAhead (MoLA), an extension of LA that selects the hyperparameters adaptively to a given problem. We provide convergence guarantees and demonstrate in experiments that MoLA accelerates training in both purely rotational games and mixed regimes, all with minimal computational overhead.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 35 references that are in the map. First posted on arXiv 26 Jan 2026.
Builds on
10 of 35 references.
References · 10
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2022Generative Adversarial Networkscited by 5,627
- 2019Lookahead Optimizer: k steps forward, 1 step backcited by 336
- 2018The Mechanics of n-Player Differentiable Gamescited by 118
- 2020Halpern Iteration for Near-Optimal and Parameter-Free Monotone Inclusion and Strong Solutions to Variational Inequalitiescited by 61
- 2019ODE Analysis of Stochastic Gradient Methods with Optimism and Anchoring for Minimax Problemscited by 18
- 2020Taming GANs with Lookahead-Minmaxcited by 16
- 2021Last-Iterate Convergence of Saddle-Point Optimizers via High-Resolution Differential Equationscited by 8
- 2021Frequency-Domain Representation of First-Order Methods: A Simple and Robust Framework of Analysiscited by 3
Built on by
Not cited yet.