mlsanityData to 7 Oct 2026

Conditional Image Generation with Score-Based Diffusion Models

arXiv 2111.13606 ↗First posted 26 Nov 2021cs.LG cs.CV stat.MLcited by 195

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Score-based diffusion models have emerged as one of the most promising frameworks for deep generative modelling. In this work we conduct a systematic comparison and theoretical analysis of different approaches to learning conditional probability distributions with score-based diffusion models. In particular, we prove results which provide a theoretical justification for one of the most successful estimators of the conditional score. Moreover, we introduce a multi-speed diffusion framework, which leads to a new estimator for the conditional score, performing on par with previous state-of-the-art approaches. Our theoretical and experimental findings are accompanied by an open source library MSDiff which allows for application and further research of multi-speed diffusion models.

Key facts. Cited by 195 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 15 of its 30 references that are in the map. First posted on arXiv 26 Nov 2021.

Builds on

15 of 30 references.

Closest ancestors · 4

Same direction, newest first

  1. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  2. 2021Maximum Likelihood Training of Score-Based Diffusion Models22 Jan
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  4. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 11

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  3. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  4. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  5. 2013Auto-Encoding Variational Bayescited by 3,980
  6. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  7. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  8. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
  9. 2015Holistically-Nested Edge Detectioncited by 590
  10. 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 577
  11. 2021Hierarchical Conditional Flow: A Unified Framework for Image Super-Resolution and Image Rescalingcited by 73

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 17; 2023: 49; 2024: 64; 2025: 38; 2026: 27.

195 papers.

Sort:

By area:

  1. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  2. 2022Diffusion Models in Vision: A Surveycited by 1,008
  3. 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 266
  4. 2022A Survey on Generative Diffusion Modelcited by 238
  5. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
  6. 2022Riemannian Score-Based Generative Modellingcited by 216
  7. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  8. 2023A Survey on Video Diffusion Modelscited by 203
  9. 2023Generative Diffusion Prior for Unified Image Restoration and Enhancementcited by 198
  10. 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Modelscited by 195
  11. 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 169
  12. 2022Diffusion Models for Video Prediction and Infillingcited by 134
38 more
  1. 2022GENIE: Higher-Order Denoising Diffusion Solverscited by 127
  2. 2022Score-Based Generative Models Detect Manifoldscited by 121
  3. 2023UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policycited by 117
  4. 2023Kandinsky: an Improved Text-to-Image Synthesis with Image Prior and Latent Diffusioncited by 114
  5. 2023Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscalingcited by 103
  6. 2024TFG: Unified Training-Free Guidance for Diffusion Modelscited by 103
  7. 2024FlowPolicy: Enabling Fast and Robust 3D Flow-based Policy via Consistency Flow Matching for Robot Manipulationcited by 99
  8. 2024Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play Priorscited by 93
  9. 2023TrojDiff: Trojan Attacks on Diffusion Models with Diverse Targetscited by 88
  10. 2023Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregationcited by 81
  11. 2024Diffusion Models in Low-Level Vision: A Surveycited by 73
  12. 2023Benchmarking Autoregressive Conditional Diffusion Models for Turbulent Flow Simulationcited by 65
  13. 2024Image Conductor: Precision Control for Interactive Video Synthesiscited by 62
  14. 2023On the Design Fundamentals of Diffusion Models: A Surveycited by 59
  15. 2022Conditional Simulation Using Diffusion Schr"odinger Bridgescited by 58
  16. 2022Diffusion Model Based Posterior Sampling for Noisy Linear Inverse Problemscited by 58
  17. 2024Smoothed Energy Guidance: Guiding Diffusion Models with Reduced Energy Curvature of Attentioncited by 55
  18. 2022Sequential Neural Score Estimation: Likelihood-Free Inference with Conditional Score Based Diffusion Modelscited by 50
  19. 2022Efficient Diffusion Models for Vision: A Surveycited by 50
  20. 2024Diffusion Bridge Implicit Modelscited by 47
  21. 2022Compositional Score Modeling for Simulation-based Inferencecited by 46
  22. 2023Designing a Better Asymmetric VQGAN for StableDiffusioncited by 45
  23. 2024DEFT: Efficient Fine-Tuning of Diffusion Models by Learning the Generalised h-transformcited by 44
  24. 2023Infinite-Dimensional Diffusion Modelscited by 38
  25. 2023Conditional score-based diffusion models for Bayesian inference in infinite dimensionscited by 37
  26. 2023DiffMIC: Dual-Guidance Diffusion Network for Medical Image Classificationcited by 32
  27. 2024Variational Diffusion Posterior Sampling with Midpoint Guidancecited by 32
  28. 2023SUR-adapter: Enhancing Text-to-Image Pre-trained Diffusion Models with Large Language Modelscited by 29
  29. 2023UniGS: Unified Representation for Image Generation and Segmentationcited by 29
  30. 2024DreamOmni: Unified Image Generation and Editingcited by 29
  31. 2025Towards Better Alignment: Training Diffusion Models with Reinforcement Learning Against Sparse Rewardscited by 29
  32. 2023Speech Driven Video Editing via an Audio-Conditioned Diffusion Modelcited by 28
  33. 2024Divide-and-Conquer Posterior Sampling for Denoising Diffusion Priorscited by 28
  34. 2024Deep Generative Data Assimilation in Multimodal Settingcited by 28
  35. 2024Recent Advances on Machine Learning for Computational Fluid Dynamics: A Surveycited by 27
  36. 2023Conditional Optimal Transport on Function Spacescited by 26
  37. 2023Posterior Sampling Based on Gradient Flows of the MMD with Negative Distance Kernelcited by 25
  38. 2023LLMGA: Multimodal Large Language Model based Generation Assistantcited by 25

50 most cited of 195 All 195 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2022How Much is Enough? A Study on Diffusion Times in Score-based Generative Models
  2. 2022Understanding Diffusion Models: A Unified Perspective
  3. 2021A Variational Perspective on Diffusion-Based Generative Models and Score Matching
  4. 2023Conditional Image Generation with Pretrained Generative Model
  5. 2026Where the Score Lives: A Wavelet View of Diffusion
  6. 2026Simulation-free and finite-time diffusion model
  7. 2024Analyzing Neural Network-Based Generative Diffusion Models through Convex Optimization
  8. 2023A Complete Recipe for Diffusion Generative Models