mlsanityData to 14 Oct 2026

gDDIM: Generalized denoising diffusion implicit models

arXiv 2206.05564 ↗First posted 11 Jun 2022cs.LGcited by 125

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Our goal is to extend the denoising diffusion implicit model (DDIM) to general diffusion models~(DMs) besides isotropic diffusions. Instead of constructing a non-Markov noising process as in the original DDIM, we examine the mechanism of DDIM from a numerical perspective. We discover that the DDIM can be obtained by using some specific approximations of the score when solving the corresponding stochastic differential equation. We present an interpretation of the accelerating effects of DDIM that also explains the advantages of a deterministic sampling scheme over the stochastic one for fast sampling. Building on this insight, we extend DDIM to general DMs, coined generalized DDIM (gDDIM), with a small but delicate modification in parameterizing the score network. We validate gDDIM in two non-isotropic DMs: Blurring diffusion model (BDM) and Critically-damped Langevin diffusion model (CLD). We observe more than 20 times acceleration in BDM. In the CLD, a diffusion model by augmenting the diffusion process with velocity, our algorithm achieves an FID score of 2.26, on CIFAR10, with only 50 number of score function evaluations~(NFEs) and an FID score of 2.86 with only 27 NFEs. Code is available at https://github.com/qsh-zh/gDDIM

Key facts. Cited by 125 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 28 of its 50 references that are in the map. First posted on arXiv 11 Jun 2022.

Builds on

28 of 50 references.

Closest ancestors · 22

Same direction, newest first

  1. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
  2. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  3. 2022Fast Sampling of Diffusion Models with Exponential Integrator29 Apr
  4. 2022Pseudo Numerical Methods for Diffusion Models on Manifolds20 Feb
  5. 2022Learning Fast Samplers for Diffusion Models by Differentiating Through Sample Quality11 Feb
  6. 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Models17 Jan
  7. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  8. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANs15 Dec
  9. 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusion14 Dec
  10. 2021Diffusion Normalizing Flow14 Oct
  11. 2021Structured Denoising Diffusion Models in Discrete State-Spaces7 Jul
  12. 2021Score-based Generative Modeling in Latent Space10 Jun
10 more
  1. 2021Learning to Efficiently Sample from Diffusion Probabilistic Models7 Jun
  2. 2021On Fast Sampling of Diffusion Probabilistic Models31 May
  3. 2021Gotta Go Fast When Generating Data with Score-Based Models28 May
  4. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  5. 2021Improved Denoising Diffusion Probabilistic Models18 Feb
  6. 2021Maximum Likelihood Training of Score-Based Diffusion Models22 Jan
  7. 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed7 Jan
  8. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  9. 2020Denoising Diffusion Implicit Models6 Oct
  10. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 6

  1. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  3. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  4. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  5. 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 594
  6. 2021SNIPS: Solving Noisy Inverse Problems Stochasticallycited by 191

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 10; 2023: 40; 2024: 39; 2025: 24; 2026: 12.

125 papers.

Sort:

By area:

  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  2. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  3. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
  4. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
  5. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
  6. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 450
  7. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
  8. 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 350
  9. 2022A Survey on Generative Diffusion Modelcited by 240
  10. 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 217
  11. 2023PTQD: Accurate Post-Training Quantization for Diffusion Modelscited by 170
  12. 2024SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Modelscited by 170
38 more
  1. 2023Contrastive Energy Prediction for Exact Energy-Guided Diffusion Sampling in Offline Reinforcement Learningcited by 149
  2. 2024Learning-to-Cache: Accelerating Diffusion Transformer via Layer Cachingcited by 142
  3. 2022GENIE: Higher-Order Denoising Diffusion Solverscited by 127
  4. 2023Understanding the Latent Space of Diffusion Models through the Lens of Riemannian Geometrycited by 125
  5. 2023Parallel Sampling of Diffusion Modelscited by 112
  6. 2023DiffiT: Diffusion Vision Transformers for Image Generationcited by 106
  7. 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 103
  8. 2024DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Modelscited by 98
  9. 2023Generative Skill Chaining: Long-Horizon Skill Planning with Diffusion Modelscited by 91
  10. 2023InstructVideo: Instructing Video Diffusion Models with Human Feedbackcited by 86
  11. 2024A Survey of Resource-efficient LLM and Multimodal Foundation Modelscited by 86
  12. 2024Accelerating Convergence of Score-Based Diffusion Models, Provablycited by 76
  13. 2023Restoration-Degradation Beyond Linear Diffusions: A Non-Asymptotic Analysis For DDIM-Type Samplerscited by 74
  14. 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimizationcited by 73
  15. 2023TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Modelscited by 69
  16. 2024A Survey on Diffusion Models for Time Series and Spatio-Temporal Datacited by 67
  17. 2023The Blessing of Randomness: SDE Beats ODE in General Diffusion-based Image Editingcited by 62
  18. 2024Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Priorcited by 60
  19. 2024Rethinking the Spatial Inconsistency in Classifier-Free Diffusion Guidancecited by 59
  20. 2024Boosting Diffusion Models with Moving Average Sampling in Frequency Domaincited by 55
  21. 2022Efficient Diffusion Models for Vision: A Surveycited by 51
  22. 2024Diffusion Bridge Implicit Modelscited by 49
  23. 2025Fast Solvers for Discrete Diffusion Models: Theory and Applications of High-Order Algorithmscited by 47
  24. 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editingcited by 39
  25. 2023SEEDS: Exponential SDE Solvers for Fast High-Quality Sampling from Diffusion Modelscited by 36
  26. 2025Score as Action: Fine-Tuning Diffusion Generative Models by Continuous-time Reinforcement Learningcited by 33
  27. 2023ExposureDiffusion: Learning to Expose for Low-light Image Enhancementcited by 29
  28. 2023Unsupervised Discovery of Semantic Latent Directions in Diffusion Modelscited by 28
  29. 2024Unifying Bayesian Flow Networks and Diffusion Models through Stochastic Differential Equationscited by 28
  30. 2023Generative Modeling with Phase Stochastic Bridgescited by 25
  31. 2024EDA-DM: Enhanced Distribution Alignment for Post-Training Quantization of Diffusion Modelscited by 23
  32. 2024Provable Benefit of Annealed Langevin Monte Carlo for Non-log-concave Samplingcited by 23
  33. 2024Edify Image: High-Quality Image Generation with Pixel Space Laplacian Diffusion Modelscited by 23
  34. 2025Lumos-1: On Autoregressive Video Generation with Discrete Diffusion from a Unified Model Perspectivecited by 22
  35. 2022Few-shot Image Generation with Diffusion Modelscited by 21
  36. 2023Fast Diffusion Modelcited by 21
  37. 2023FRDiff : Feature Reuse for Universal Training-free Acceleration of Diffusion Modelscited by 20
  38. 2024Scores as Actions: a framework of fine-tuning diffusion models by continuous-time reinforcement learningcited by 19

50 most cited of 125 All 125 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023Improved DDIM Sampling with Moment Matching Gaussian Mixtures
  2. 2021Bilateral Denoising Diffusion Models
  3. 2026Blind denoising diffusion models and the blessings of dimensionality
  4. 2024Denoising Diffusion Probabilistic Models in Six Simple Steps
  5. 2022Accelerating Diffusion Models via Early Stop of the Diffusion Process
  6. 2023Interpreting and Improving Diffusion Models from an Optimization Perspective
  7. 2023Fast Inference in Denoising Diffusion Models via MMD Finetuning
  8. 2022Blurring Diffusion Models