Hybridizing Equilibrium Propagation with Ising Machines for Efficient Energy-Based Learning
Not on the map. Why?
Abstract (arXiv)
The rapid evolution of artificial intelligence has led to substantial advances in deep neural networks. Nonetheless, conventional GPU-based training remains highly energy-demanding, motivating the exploration of physical dynamics and compatible energy-based learning schemes, such as equilibrium propagation (EP). EP-based training, however, frequently suffers from convergence to local minima due to phase-space contraction. Here we introduce an Ising-dynamics-inspired equilibrium-propagation framework in which dissipative Hopfield relaxation is replaced by an extended phase-space dynamics with conjugate variables. The resulting training paradigm keeps the local two-phase learning rule of EP while changing the physical route by which neural states reach equilibrium. We show that this dynamics lowers effective energy barriers, accelerates convergence, improves noise robustness, and trains deep convolutional Hopfield networks on MNIST, FashionMNIST, and CIFAR-10 with performance comparable to backpropagation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 47 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
18 of 47 references.
References · 18
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Equilibrium Propagation: Bridging the Gap Between Energy-Based Models and Backpropagationcited by 251
- 2018All-Optical Machine Learning Using Diffractive Deep Neural Networkscited by 175
- 2015Training Very Deep Networkscited by 172
- 2021Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systemscited by 125
- 2020Photonics for artificial intelligence and neuromorphic computingcited by 111
- 2020Scaling Equilibrium Propagation to Deep ConvNets by Drastically Reducing its Gradient Estimator Biascited by 60
- 2019Latent Weights Do Not Exist: Rethinking Binarized Neural Network Optimizationcited by 58
- 2022Experimentally realized in situ backpropagation for deep learning in nanophotonic neural networkscited by 43
- 2022Holomorphic Equilibrium Propagation Computes Exact Gradients Through Finite Size Oscillationscited by 40
- 2023Energy-based learning algorithms for analog computing: a comparative studycited by 36
6 more
- 2019Updates of Equilibrium Prop Match Gradients of Backprop Through Time in an RNN with Static Inputcited by 32
- 2017Equivalence of Equilibrium Propagation and Recurrent Backpropagationcited by 31
- 2023Training an Ising Machine with Equilibrium Propagationcited by 29
- 2024Training Coupled Phase Oscillators as a Neuromorphic Platform using Equilibrium Propagationcited by 16
- 2021Training Dynamical Binary Neural Networks with Equilibrium Propagationcited by 13
- 2025Learning at the Speed of Physics: Equilibrium Propagation on Oscillator Ising Machinescited by 3
Built on by
Not cited yet.