mlsanityData to 7 Oct 2026

Accelerated Image-Aware Generative Diffusion Modeling

arXiv 2408.08306 ↗First posted 15 Aug 2024eess.IVcited by 0

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

We propose in this paper an analytically new construct of a diffusion model whose drift and diffusion parameters yield an exponentially time-decaying Signal to Noise Ratio in the forward process. In reverse, the construct cleverly carries out the learning of the diffusion coefficients on the structure of clean images using an autoencoder. The proposed methodology significantly accelerates the diffusion process, reducing the required diffusion time steps from around 1000 seen in conventional models to 200-500 without compromising image quality in the reverse-time diffusion. In a departure from conventional models which typically use time-consuming multiple runs, we introduce a parallel data-driven model to generate a reverse-time diffusion trajectory in a single run of the model. The resulting collective block-sequential generative model eliminates the need for MCMC-based sub-sampling correction for safeguarding and improving image quality, to further improve the acceleration of image generation. Collectively, these advancements yield a generative model that is an order of magnitude faster than conventional approaches, while maintaining high fidelity and diversity in generated images, hence promising widespread applicability in rapid image synthesis tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 17 of its 30 references that are in the map. First posted on arXiv 15 Aug 2024.

Builds on

17 of 30 references.

Closest ancestors · 11

Same direction, newest first

  1. 2022Scalable Diffusion Models with Transformers19 Dec
  2. 2022GENIE: Higher-Order Denoising Diffusion Solvers11 Oct
  3. 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep
  4. 2022Accelerating Diffusion Models via Early Stop of the Diffusion Process25 May
  5. 2022Fast Sampling of Diffusion Models with Exponential Integrator29 Apr
  6. 2022Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoders19 Feb
  7. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  8. 2021Gotta Go Fast When Generating Data with Score-Based Models28 May
  9. 2021Improved Denoising Diffusion Probabilistic Models18 Feb
  10. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  11. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 6

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  4. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  5. 2019An Introduction to Variational Autoencoderscited by 997
  6. 2020Adversarial score matching and improved sampling for image generationcited by 95

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024A Simple Early Exiting Framework for Accelerated Sampling in Diffusion Models
  2. 2025Glance: Accelerating Diffusion Models with 1 Sample
  3. 2023Faster Diffusion: Rethinking the Role of the Encoder for Diffusion Model Inference
  4. 2026Efficient Video Diffusion Models: Advancements and Challenges
  5. 2025CacheQuant: Comprehensively Accelerated Diffusion Models
  6. 2026Just-in-Time: Training-Free Spatial Acceleration for Diffusion Transformers
  7. 2023AutoDiffusion: Training-Free Optimization of Time Steps and Architectures for Automated Diffusion Model Acceleration
  8. 2026ZEUS: Accelerating Diffusion Models with Only Second-Order Predictor