mlsanityData to 14 Oct 2026

The Phase Is the Gradient: Equilibrium Propagation for Frequency Learning in Kuramoto Networks

arXiv 2604.10272 ↗First posted 11 Apr 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We prove that in a coupled Kuramoto oscillator network at stable equilibrium, the physical phase displacement under weak output nudging is the gradient of the loss with respect to natural frequencies, with equality as the nudging strength beta tends to zero. Prior oscillator equilibrium propagation work explicitly set aside natural frequency as a learnable parameter; we show that on sparse layered architectures, frequency learning outperforms coupling-weight learning among converged seeds (96.0% vs. 83.3% at matched parameter counts, p = 1.8e-12). The approximately 50% convergence failure rate under random initialization is a loss-landscape property, not a gradient error; topology-aware spectral seeding eliminates it in all settings tested (46/100 to 100/100 seeds on the primary task; 50/50 on a second task, K-only training, and a larger architecture).

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 29 references that are in the map. First posted on arXiv 11 Apr 2026.

Builds on

18 of 29 references.

References · 18

  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  2. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  3. 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,135
  4. 2021Carbon Emissions and Large Neural Network Trainingcited by 567
  5. 2024The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bitscited by 308
  6. 2022Reducing Activation Recomputation in Large Transformer Modelscited by 302
  7. 2016Equilibrium Propagation: Bridging the Gap Between Energy-Based Models and Backpropagationcited by 259
  8. 2020Training End-to-End Analog Neural Networks with Equilibrium Propagationcited by 63
  9. 2024Training of Physical Neural Networkscited by 49
  10. 2024Artificial Kuramoto Oscillatory Neuronscited by 38
  11. 2019Updates of Equilibrium Prop Match Gradients of Backprop Through Time in an RNN with Static Inputcited by 33
  12. 2025Energy-Based Transformers are Scalable Learners and Thinkerscited by 31
6 more
  1. 2022Beyond backpropagation: bilevel optimization through implicit differentiation and equilibrium propagationcited by 26
  2. 2018Generalization of Equilibrium Propagation to Vector Field Dynamicscited by 23
  3. 2023Machine Learning Without a Processor: Emergent Learning in a Nonlinear Electronic Metamaterialcited by 20
  4. 2024Training Coupled Phase Oscillators as a Neuromorphic Platform using Equilibrium Propagationcited by 16
  5. 2024Quantum Equilibrium Propagation for efficient training of quantum systems based on Onsager reciprocitycited by 9
  6. 2025Learning at the Speed of Physics: Equilibrium Propagation on Oscillator Ising Machinescited by 3

Built on by

Not cited yet.