mlsanityData to 7 Oct 2026

Non-equilibrium active noise enhances generative memory in diffusion models

arXiv 2411.07233 ↗First posted 11 Nov 2024cs.LG cond-mat.dis-nncited by 1

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Generative diffusion models have emerged as powerful tools for sampling high-dimensional distributions, yet they typically rely on white gaussian noise and noise schedules to destroy and reconstruct information. Here, we demonstrate that driving the generative process out of equilibrium using active, temporally correlated noise sources fundamentally alters the information thermodynamics of the system. We show that coupling the data to an active non-Markovian bath creates a `memory effect' where high-level semantic information (such as class identity or molecular metastability) is stored in the temporal correlations of auxiliary degrees of freedom. Using Fisher information analysis, we prove that this active mechanism significantly retards the rate of information decay compared to passive Brownian motion. Crucially, this memory effect facilitates an earlier and more robust symmetry breaking (speciation) during the reverse generative process, allowing the system to resolve multi-scale structures, reminiscent of metastable states in molecular configurations that are washed out in the typical noising processes. Our results suggest that non-equilibrium protocols, inspired by active matter physics, offer a thermodynamically distinct and potentially advantageous pathway for recovering high-dimensional energy landscapes using generative diffusion.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 19 of its 42 references that are in the map. First posted on arXiv 11 Nov 2024.

Builds on

19 of 42 references.

Closest ancestors · 13

Same direction, newest first

  1. 2024Dynamical Regimes of Diffusion Models28 Feb
  2. 2024A Phase Transition in Diffusion Models Reveals the Hierarchical Nature of Data26 Feb
  3. 2023Exploring the Optimal Choice for Generative Processes in Diffusion Models: Ordinary vs Stochastic Differential Equations3 Jun
  4. 2023Speed Is All You Need: On-Device Acceleration of Large Diffusion Models via GPU-Aware Optimizations21 Apr
  5. 2023Discovering Interpretable Directions in the Semantic Latent Space of Diffusion Models20 Mar
  6. 2022Wavelet Diffusion Models are fast and scalable Image Generators29 Nov
  7. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  8. 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusion14 Dec
  9. 2021Variational Diffusion Models1 Jul
  10. 2021Score-based Generative Modeling in Latent Space10 Jun
  11. 2021Gotta Go Fast When Generating Data with Score-Based Models28 May
  12. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
1 more
  1. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 6

  1. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  2. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  3. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  4. 2019Theoretical guarantees for sampling and inference in generative models with latent diffusionscited by 97
  5. 2019Non-normal Recurrent Neural Network (nnRNN): learning long time dependencies while improving expressivity with transient dynamicscited by 28
  6. 2023Turbulence Scaling from Deep Learning Diffusion Generative Modelscited by 8

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025The Information Dynamics of Generative Diffusion
  2. 2025Measuring Semantic Information Production in Generative Diffusion Models
  3. 2025Generative thermodynamic computing
  4. 2024Nonequilbrium physics of generative diffusion models
  5. 2026Steering Dynamical Regimes of Diffusion Models by Breaking Detailed Balance
  6. 2026Generative Modeling of Stochastic Dynamics for Long-Time Evolution
  7. 2025Thermodynamic Performance Limits for Score-Based Diffusion Models
  8. 2023The statistical thermodynamics of generative diffusion models: Phase transitions, symmetry breaking and critical instability