mlsanityData to 14 Oct 2026

Finite-Nudge Equilibrium Propagation in Thermal Ensembles

arXiv 2511.22024 ↗First posted 27 Nov 2025cs.LG cs.NEcited by 0

Not on the map. Why?

Abstract (arXiv)

We liberate Equilibrium Propagation (EP) from the limit of infinitesimal perturbations by establishing a finite-nudge foundation for local credit assignment. By modeling network states as Gibbs-Boltzmann distributions rather than deterministic points, we prove that the gradient of the difference in Helmholtz free energy between a nudged and free phase is exactly the difference in expected local energy derivatives. This validates the classic Contrastive Hebbian Learning update as an exact gradient estimator for arbitrary finite nudging, requiring neither infinitesimal approximations nor convexity. In the zero-temperature limit, we prove that the same identity reduces to the deterministic contrastive rule around any local energy basin without assuming a unique global minimum, and a subsequent small-nudge limit recovers traditional EP. Finally, we derive an equivalent representation of the same gradient as an integral of the loss--energy covariance over nudging strength, which generalizes infinitesimal EP to strong error signals that its small-nudge approximation cannot support. Numerical experiments corroborate that finite nudging provides a practical signal-to-noise advantage over infinitesimal methods during training.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 43 references that are in the map. First posted on arXiv 27 Nov 2025.

Builds on

12 of 43 references.

References · 12

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2016Variational Inference: A Review for Statisticianscited by 1,472
  3. 2016Deep Variational Information Bottleneckcited by 930
  4. 2016Equilibrium Propagation: Bridging the Gap Between Energy-Based Models and Backpropagationcited by 259
  5. 2016Direct Feedback Alignment Provides Learning in Deep Neural Networkscited by 240
  6. 2014Difference Target Propagationcited by 148
  7. 2020Predictive Coding Approximates Backprop along Arbitrary Computation Graphscited by 90
  8. 2015Towards Biologically Plausible Deep Learningcited by 66
  9. 2020Scaling Equilibrium Propagation to Deep ConvNets by Drastically Reducing its Gradient Estimator Biascited by 64
  10. 2022Holomorphic Equilibrium Propagation Computes Exact Gradients Through Finite Size Oscillationscited by 42
  11. 2018Generalization of Equilibrium Propagation to Vector Field Dynamicscited by 23
  12. 2024Equilibrium Propagation: the Quantum and the Thermal Casescited by 10

Built on by

Not cited yet.