mlsanityData to 14 Oct 2026

Understanding Lookahead Dynamics Through Laplace Transform

arXiv 2506.13712 ↗First posted 16 Jun 2025math.OC cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce a frequency-domain framework for convergence analysis of hyperparameters in game optimization, leveraging High-Resolution Differential Equations (HRDEs) and Laplace transforms. Focusing on the Lookahead algorithm--characterized by gradient steps k and averaging coefficient α--we transform the discrete-time oscillatory dynamics of bilinear games into the frequency domain to derive precise convergence criteria. Our higher-precision O(γ2)-HRDE models yield tighter criteria, while our first-order O(γ)-HRDE models offer practical guidance by prioritizing actionable hyperparameter tuning over complex closed-form solutions. Empirical validation in discrete-time settings demonstrates the effectiveness of our approach, which may further extend to locally linear operators, offering a scalable framework for selecting hyperparameters for learning in games.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 16 references that are in the map. First posted on arXiv 16 Jun 2025.

Builds on

7 of 16 references.

References · 7

  1. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  2. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  3. 2022Generative Adversarial Networkscited by 5,627
  4. 2018The Mechanics of n-Player Differentiable Gamescited by 118
  5. 2020Taming GANs with Lookahead-Minmaxcited by 16
  6. 2021Last-Iterate Convergence of Saddle-Point Optimizers via High-Resolution Differential Equationscited by 8
  7. 2021Frequency-Domain Representation of First-Order Methods: A Simple and Robust Framework of Analysiscited by 3

Built on by

Not cited yet.