mlsanityData to 7 Oct 2026

Adaptive Stochastic Coefficients for Accelerating Diffusion Sampling

arXiv 2510.23285 ↗First posted 27 Oct 2025cs.CVcited by 6

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Diffusion-based generative processes, formulated as differential equation solving, frequently balance computational speed with sample quality. Our theoretical investigation of ODE- and SDE-based solvers reveals complementary weaknesses: ODE solvers accumulate irreducible gradient error along deterministic trajectories, while SDE methods suffer from amplified discretization errors when the step budget is limited. Building upon this insight, we introduce AdaSDE, a novel single-step SDE solver that aims to unify the efficiency of ODEs with the error resilience of SDEs. Specifically, we introduce a single per-step learnable coefficient, estimated via lightweight distillation, which dynamically regulates the error correction strength to accelerate diffusion sampling. Notably, our framework can be integrated with existing solvers to enhance their capabilities. Extensive experiments demonstrate state-of-the-art performance: at 5 NFE, AdaSDE achieves FID scores of 4.18 on CIFAR-10, 8.05 on FFHQ and 6.96 on LSUN Bedroom. Codes are available in https://github.com/WLU-wry02/AdaSDE.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 45 of its 53 references that are in the map. First posted on arXiv 27 Oct 2025.

Builds on

45 of 53 references.

Closest ancestors · 30

Same direction, newest first

  1. 2025Distilling Parallel Gradients for Fast ODE Solvers of Diffusion Models20 Jul
  2. 2024Simple and Fast Distillation of Diffusion Models29 Sep
  3. 2024Learning to Discretize Denoising Diffusion ODEs24 May
  4. 2024On the Trajectory Regularity of ODE-based Diffusion Sampling18 May
  5. 2024Accelerating Diffusion Sampling with Optimized Time Steps27 Feb
  6. 2023Fast ODE-based Sampling for Diffusion Models in Around 5 Steps30 Nov
  7. 2023Adversarial Diffusion Distillation28 Nov
  8. 2023DPM-Solver-v3: Improved Diffusion ODE Solver with Empirical Model Statistics20 Oct
  9. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference6 Oct
  10. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion1 Oct
  11. 2023SA-Solver: Stochastic Adams Solver for Fast Sampling of Diffusion Models10 Sep
  12. 2023Elucidating the Exposure Bias in Diffusion Models29 Aug
18 more
  1. 2023Restart Sampling for Improving Generative Processes26 Jun
  2. 2023A Geometric Perspective on Diffusion Models31 May
  3. 2023Alleviating Exposure Bias in Diffusion Models through Sampling with Shifted Time Steps24 May
  4. 2023TRACT: Denoising Diffusion Models with Transitive Closure Time-Distillation7 Mar
  5. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Models9 Feb
  6. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models2 Nov
  7. 2022GENIE: Higher-Order Denoising Diffusion Solvers11 Oct
  8. 2022On Distillation of Guided Diffusion Models6 Oct
  9. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
  10. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  11. 2022Fast Sampling of Diffusion Models with Exponential Integrator29 Apr
  12. 2022Pseudo Numerical Methods for Diffusion Models on Manifolds20 Feb
  13. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  14. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  15. 2021Improved Denoising Diffusion Probabilistic Models18 Feb
  16. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  17. 2020Denoising Diffusion Implicit Models6 Oct
  18. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 15

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  6. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  8. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  9. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  10. 2017User-friendly guarantees for the Langevin Monte Carlo with inaccurate gradientcited by 116
  11. 2024StyleStudio: Text-Driven Style Transfer with Selective Control of Style Elementscited by 26
  12. 2025Taming Video Models for 3D and 4D Generation via Zero-Shot Camera Controlcited by 14
3 more
  1. 2025Distinguished Quantized Guidance for Diffusion-based Sequence Recommendationcited by 13
  2. 2025Addressing Missing Data Issue for Diffusion-based Recommendationcited by 4
  3. 2025Detail++: Training-Free Detail Enhancer for T2I Diffusion Modelscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.

  1. 2025Dual-Stream Diffusion for World-Model Augmented Vision-Language-Action Modelcited by 33
  2. 2025Parallel Diffusion Solver via Residual Dirichlet Policy Optimizationcited by 3
  3. 2026Few-Step Diffusion Sampling Through Instance-Aware Discretizationscited by 3
  4. 2026Free Lunch for Stabilizing Rectified Flow Inversioncited by 2
  5. 2026BAG: Budget-Aware Gating for Diffusion Cachingcited by 1
  6. 2026VADF: Vision-Adaptive Diffusion Policy Framework for Efficient Robotic Manipulationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Elucidating the solution space of extended reverse-time SDE for diffusion models
  2. 2023On Accelerating Diffusion-Based Sampling Process via Improved Integration Approximation
  3. 2023SEEDS: Exponential SDE Solvers for Fast High-Quality Sampling from Diffusion Models
  4. 2026Formalizing the Sampling Design Space of Diffusion-Based Generative Models via Adaptive Solvers and Wasserstein-Bounded Timesteps
  5. 2024Accelerating Convergence of Score-Based Diffusion Models, Provably
  6. 2025SADA: Stability-guided Adaptive Diffusion Acceleration
  7. 2026A Tutorial on Diffusion Theory: From Differential Equations to Diffusion Models
  8. 2023Distilling ODE Solvers of Diffusion Models into Smaller Steps