mlsanityData to 14 Oct 2026

Thermodynamic Diffusion Inference with Minimal Digital Conditioning

arXiv 2604.14332 ↗First posted 15 Apr 2026cs.LG cs.AIcited by 1

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Diffusion-model inference and overdamped Langevin dynamics are formally identical. A physical substrate that encodes the score function therefore equilibrates to the correct output by thermodynamics alone, requiring no digital arithmetic during inference and potentially achieving a 10,000× reduction in energy relative to a GPU. Two fundamental barriers have until now prevented this equivalence from being realized at production scale: non-local skip connections, which locally coupled analog substrates cannot represent, and input conditioning, in which the coupling constants carry roughly 2,600× too little signal to anchor the system to a specific input. We resolve both obstacles. Hierarchical bilinear coupling encodes U-Net skip connections as rank-k inter-module interactions derived directly from the singular structure of the encoder and decoder Gram matrices, requiring only O(Dk) physical connections instead of O(D2). A minimal digital interface -- a 4-dimensional bottleneck encoder together with a 16-unit transfer network, totalling 2,560 parameters -- overcomes the conditioning barrier. When evaluated on activations drawn from a trained denoising U-Net, the complete system attains a decoder cosine similarity of 0.9906 against an oracle upper bound of 1.0000, while preserving theoretical net energy savings of approximately 107× over GPU inference. These results constitute the first demonstration of trained-weight, production-scale thermodynamic diffusion inference.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 9 of its 14 references that are in the map. First posted on arXiv 15 Apr 2026.

Builds on

9 of 14 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
  2. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis4 Jul
  3. 2022Scalable Diffusion Models with Transformers19 Dec
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  6. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 3

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  3. 2025An efficient probabilistic hardware architecture for diffusion-like modelscited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Diffusion Models are Molecular Dynamics Simulators
  2. 2025DiffPro: Joint Timestep and Layer-Wise Precision Optimization for Efficient Diffusion Inference
  3. 2025Generative thermodynamic computing
  4. 2024Speed-accuracy relations for diffusion models: Wisdom from nonequilibrium thermodynamics and optimal transport
  5. 2026Bridging Control, Inference, Transport, and Thermodynamics: From Theory to Applications in Learning
  6. 2025Thermodynamic Performance Limits for Score-Based Diffusion Models
  7. 2026A Plug-in Interpretation of Conditioning in Score-Based Diffusion Models
  8. 2026Chameleon: Dynamic Format Adapter for Efficient Diffusion