mlsanityData to 7 Oct 2026

Score-Based Generative Modeling through Stochastic Differential Equations

arXiv 2011.13456 ↗First posted 26 Nov 2020cs.LG stat.MLcited by 8,964

On the map: World models → Video-generation world models and simulators

also in 1 more
Abstract (arXiv)

Creating noise from data is easy; creating data from noise is generative modeling. We present a stochastic differential equation (SDE) that smoothly transforms a complex data distribution to a known prior distribution by slowly injecting noise, and a corresponding reverse-time SDE that transforms the prior distribution back into the data distribution by slowly removing the noise. Crucially, the reverse-time SDE depends only on the time-dependent gradient field (aka, score) of the perturbed data distribution. By leveraging advances in score-based generative modeling, we can accurately estimate these scores with neural networks, and use numerical SDE solvers to generate samples. We show that this framework encapsulates previous approaches in score-based generative modeling and diffusion probabilistic modeling, allowing for new sampling procedures and new modeling capabilities. In particular, we introduce a predictor-corrector framework to correct errors in the evolution of the discretized reverse-time SDE. We also derive an equivalent neural ODE that samples from the same distribution as the SDE, but additionally enables exact likelihood computation, and improved sampling efficiency. In addition, we provide a new way to solve inverse problems with score-based models, as demonstrated with experiments on class-conditional generation, image inpainting, and colorization. Combined with multiple architectural improvements, we achieve record-breaking performance for unconditional image generation on CIFAR-10 with an Inception score of 9.89 and FID of 2.20, a competitive likelihood of 2.99 bits/dim, and demonstrate high fidelity generation of 1024 x 1024 images for the first time from a score-based generative model.

Key facts. Cited by 8,964 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 1 of its 51 references that are in the map. First posted on arXiv 26 Nov 2020.

Builds on

1 of 51 references.

Closest ancestors · 1

Same direction, newest first

  1. 2020Denoising Diffusion Probabilistic Models19 Jun

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 115; 2022: 405; 2023: 1437; 2024: 2160; 2025: 2579; 2026: 2268.

8,964 papers.

Sort:

By area:

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  4. 2022Classifier-Free Diffusion Guidancecited by 5,717
  5. 2022Generative Adversarial Networkscited by 5,603
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2022Flow Matching for Generative Modelingcited by 5,426
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  10. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  11. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  12. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
38 more
  1. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  2. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  3. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  4. 2022Video Diffusion Modelscited by 2,280
  5. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  6. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  7. 2023Consistency Modelscited by 1,778
  8. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  9. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  10. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  11. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  12. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  13. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  14. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  15. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  16. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  17. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  18. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  19. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  20. 2021Variational Diffusion Modelscited by 1,145
  21. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  22. 2022Human Motion Diffusion Modelcited by 1,062
  23. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  24. 2022Diffusion Models in Vision: A Surveycited by 1,008
  25. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
  26. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  27. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
  28. 2022Denoising Diffusion Restoration Modelscited by 951
  29. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
  30. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
  31. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
  32. 2025Large Language Diffusion Modelscited by 872
  33. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
  34. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  35. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
  36. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  37. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  38. 2024Simple and Effective Masked Diffusion Language Modelscited by 800

50 most cited of 8,964 All 8,964 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026A Tutorial on Diffusion Theory: From Differential Equations to Diffusion Models
  2. 2023Closed-Form Diffusion Models
  3. 2025Adaptivity and Convergence of Probability Flow ODEs in Diffusion Generative Models
  4. 2025From Score Matching to Diffusion: A Fine-Grained Error Analysis in the Gaussian Setting
  5. 2023Solving Inverse Problems with Score-Based Generative Priors learned from Noisy Data