mlsanityData to 14 Oct 2026

Symmetric Equilibrium Propagation for Thermodynamic Diffusion Training

arXiv 2604.23806 ↗First posted 26 Apr 2026cs.LG cs.AIcited by 0

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

The reverse process in score-based diffusion models is formally equivalent to overdamped Langevin dynamics in a time-dependent energy landscape. In our prior work we showed that a bilinearly-coupled analog substrate can physically realize this dynamics at a projected three-to-four orders of magnitude energy advantage over digital inference by replacing dense skip connections with low-rank inter-module couplings. Whether the training loop can be closed on the same substrate -- without routing gradients through an external digital accelerator -- has remained open. We resolve this affirmatively: Equilibrium Propagation applied directly to the bilinear energy yields an unbiased estimator of the denoising score-matching gradient in the zero-nudge limit. For finite nudging we derive a sharp bias bound controlled solely by substrate stiffness, local curvature, and the norm of the loss-gradient signal, with a bilinear-specific corollary showing that one dominant bias term vanishes identically for coupling-parameter updates. Symmetric nudging further upgrades the leading bias from O(β) to O(β2) at negligible extra cost. Under realistic finite-relaxation budgets this upgrade is essential, as one-sided EqProp produces anti-correlated gradients while symmetric EqProp yields well-aligned updates. Bias-variance analysis determines the optimal operating point, and end-to-end physical-unit accounting projects a 103-104× energy advantage per training step over a matched GPU baseline. Symmetric bilinear EqProp is the first local, readout-only training rule that preserves the low-rank coupling enabling scalable thermodynamic diffusion models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 11 of its 22 references that are in the map. First posted on arXiv 26 Apr 2026.

Builds on

11 of 22 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026Thermodynamic Diffusion Inference with Minimal Digital Conditioning15 Apr
  2. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis4 Jul
  3. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  6. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 5

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  3. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  4. 2016Equilibrium Propagation: Bridging the Gap Between Energy-Based Models and Backpropagationcited by 259
  5. 2025An efficient probabilistic hardware architecture for diffusion-like modelscited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Diffusion Models are Molecular Dynamics Simulators
  2. 2026Diversify Diffusion with Temperature Sampling and Variance-Corrective Time Shifting
  3. 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusion
  4. 2026Data Free Training of Diffusion Models for Lattice Field Theories
  5. 2024Speed-accuracy relations for diffusion models: Wisdom from nonequilibrium thermodynamics and optimal transport
  6. 2025Thermodynamic Performance Limits for Score-Based Diffusion Models
  7. 2025RNE: plug-and-play diffusion inference-time control and energy-based training
  8. 2026Rethinking the Diffusion Model from a Langevin Perspective