mlsanityData to 7 Oct 2026

DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models

arXiv 2211.01095 ↗First posted 2 Nov 2022cs.LG cs.CVcited by 924

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Diffusion probabilistic models (DPMs) have achieved impressive success in high-resolution image synthesis, especially in recent large-scale text-to-image generation applications. An essential technique for improving the sample quality of DPMs is guided sampling, which usually needs a large guidance scale to obtain the best sample quality. The commonly-used fast sampler for guided sampling is DDIM, a first-order diffusion ODE solver that generally needs 100 to 250 steps for high-quality samples. Although recent works propose dedicated high-order solvers and achieve a further speedup for sampling without guidance, their effectiveness for guided sampling has not been well-tested before. In this work, we demonstrate that previous high-order fast samplers suffer from instability issues, and they even become slower than DDIM when the guidance scale grows large. To further speed up guided sampling, we propose DPM-Solver++, a high-order solver for the guided sampling of DPMs. DPM-Solver++ solves the diffusion ODE with the data prediction model and adopts thresholding methods to keep the solution matches training data distribution. We further propose a multistep variant of DPM-Solver++ to address the instability issue by reducing the effective step size. Experiments show that DPM-Solver++ can generate high-quality samples within only 15 to 20 steps for guided sampling by pixel-space and latent-space DPMs.

Key facts. Cited by 924 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 43 of its 80 references that are in the map. First posted on arXiv 2 Nov 2022.

Builds on

43 of 80 references.

Closest ancestors · 28

Same direction, newest first

  1. 2022On Distillation of Guided Diffusion Models6 Oct
  2. 2022Classifier-Free Diffusion Guidance26 Jul
  3. 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equations14 Jul
  4. 2022Estimating the Optimal Covariance with Imperfect Mean in Diffusion Probabilistic Models15 Jun
  5. 2022gDDIM: Generalized denoising diffusion implicit models11 Jun
  6. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
  7. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  8. 2022Fast Sampling of Diffusion Models with Exponential Integrator29 Apr
  9. 2022Pseudo Numerical Methods for Diffusion Models on Manifolds20 Feb
  10. 2022Learning Fast Samplers for Diffusion Models by Differentiating Through Sample Quality11 Feb
  11. 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Models17 Jan
  12. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
16 more
  1. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANs15 Dec
  2. 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusion14 Dec
  3. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesis29 Nov
  4. 2021Bilateral Denoising Diffusion Models26 Aug
  5. 2021Variational Diffusion Models1 Jul
  6. 2021Score-based Generative Modeling in Latent Space10 Jun
  7. 2021On Fast Sampling of Diffusion Probabilistic Models31 May
  8. 2021Cascaded Diffusion Models for High Fidelity Image Generation30 May
  9. 2021Gotta Go Fast When Generating Data with Score-Based Models28 May
  10. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  11. 2021Noise Estimation for Generative Diffusion Models6 Apr
  12. 2021Improved Denoising Diffusion Probabilistic Models18 Feb
  13. 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed7 Jan
  14. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  15. 2020Denoising Diffusion Implicit Models6 Oct
  16. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 15

  1. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  4. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  6. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  7. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  8. 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 666
  9. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
  10. 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 511
  11. 2022Diffusion-GAN: Training GANs with Diffusioncited by 203
  12. 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
3 more
  1. 2022Diffusion-based Molecule Generation with Informative Prior Bridgescited by 104
  2. 2022Lossy Compression with Gaussian Diffusioncited by 87
  3. 2021WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesiscited by 65

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 5; 2023: 154; 2024: 250; 2025: 297; 2026: 218.

924 papers.

Sort:

By area:

  1. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  2. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  3. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
  4. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  5. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  6. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  7. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  8. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  9. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
  10. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 441
  11. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
  12. 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 371
38 more
  1. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
  2. 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 303
  3. 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 297
  4. 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Modelscited by 284
  5. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 276
  6. 2023Q-Diffusion: Quantizing Diffusion Modelscited by 266
  7. 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
  8. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
  9. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  10. 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 245
  11. 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 242
  12. 2023Goal-Conditioned Imitation Learning using Score-based Diffusion Policiescited by 229
  13. 2023SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Secondscited by 227
  14. 2022MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generationcited by 225
  15. 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 216
  16. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
  17. 2023LCM-LoRA: A Universal Stable-Diffusion Acceleration Modulecited by 211
  18. 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 209
  19. 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsitycited by 204
  20. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
  21. 2022Continuous diffusion for categorical datacited by 202
  22. 2024Taming Rectified Flow for Inversion and Editingcited by 200
  23. 2024Stable Audio Opencited by 192
  24. 2023One Transformer Fits All Distributions in Multi-Modal Diffusion at Scalecited by 185
  25. 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
  26. 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 178
  27. 2023Denoising Diffusion Bridge Modelscited by 171
  28. 2023FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Leadcited by 170
  29. 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 169
  30. 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformerscited by 169
  31. 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 168
  32. 2023PTQD: Accurate Post-Training Quantization for Diffusion Modelscited by 167
  33. 2023UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANscited by 165
  34. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
  35. 2023DPM-Solver-v3: Improved Diffusion ODE Solver with Empirical Model Statisticscited by 161
  36. 2023Cache Me if You Can: Accelerating Diffusion Models through Block Cachingcited by 149
  37. 2023LEDITS++: Limitless Image Editing using Text-to-Image Modelscited by 147
  38. 2023Contrastive Energy Prediction for Exact Energy-Guided Diffusion Sampling in Offline Reinforcement Learningcited by 145

50 most cited of 924 All 924 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Optimizing Few-Step Sampler for Diffusion Probabilistic Model
  2. 2023Fast Diffusion Probabilistic Model Sampling through the lens of Backward Error Analysis
  3. 2023DPM-OT: A New Diffusion Probabilistic Model Based on Optimal Transport
  4. 2023Accelerating Guided Diffusion Sampling with Splitting Numerical Methods
  5. 2024A Simple Early Exiting Framework for Accelerated Sampling in Diffusion Models
  6. 2026Adaptive Second-Order Solvers for Fast Stochastic Diffusion Sampling
  7. 2024T-Stitch: Accelerating Sampling in Pre-Trained Diffusion Models with Trajectory Stitching
  8. 2023SEEDS: Exponential SDE Solvers for Fast High-Quality Sampling from Diffusion Models