mlsanityData to 13 Oct 2026

Is Monotonic Sampling Necessary in Diffusion Models?

arXiv 2605.11773 ↗First posted 12 May 2026cs.LG cs.AIcited by 0

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Diffusion models generate samples by iteratively denoising a Gaussian prior, traversing a sequence of noise levels that, in every published sampler, decreases monotonically. Six years of intensive work has refined nearly every aspect of this recipe, including the corruption operator, the training objective, the schedule shape, the architecture, and the ODE solver. Yet the assumption of monotonicity itself has never been systematically tested. Here we ask whether monotonic sampling is load-bearing or merely conventional. We design four families of structured nonmonotonic schedules and apply them to three architecturally distinct generative models, DDPM, EDM, and Flow Matching, across NFE budgets ranging from 10 to 200 function evaluations, plus a 42-cell hyperparameter ablation, on CIFAR-10. Across all 90 tested configurations, no tested nonmonotonic schedule improves on the monotonic baseline. The magnitude of the penalty, however, spans nearly three orders of magnitude: persistent and substantial in DDPM, intermediate in Flow Matching, and indistinguishable from zero in EDM. We show that this variation is not noise but a structural property of each trained denoiser, and we formalize it as the Schedule Sensitivity Coefficient, a cheap, architecture-agnostic diagnostic that provides evidence of non-convergence to the Bayes-optimal denoiser at the critical noise level. Our findings justify the field's tacit reliance on monotonic schedules and supply a new probe of diffusion model quality complementary to sample-quality metrics such as Frechet Inception Distance.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 41 of its 49 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

41 of 49 references.

Closest ancestors · 31

Same direction, newest first

  1. 2024Improved Noise Schedule for Diffusion Training3 Jul
  2. 2024Guiding a Diffusion Model with a Bad Version of Itself4 Jun
  3. 2024Align Your Steps: Optimizing Sampling Schedules in Diffusion Models22 Apr
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
  5. 2024Scalable High-Resolution Pixel-Space Image Synthesis with Hourglass Diffusion Transformers21 Jan
  6. 2023Analyzing and Improving the Training Dynamics of Diffusion Models5 Dec
  7. 2023Restart Sampling for Improving Generative Processes26 Jun
  8. 2023Common Diffusion Noise Schedules and Sample Steps are Flawed15 May
  9. 2023Efficient Diffusion Training via Min-SNR Weighting Strategy16 Mar
  10. 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentation1 Mar
  11. 2023Consistent Diffusion Models: Mitigating Sampling Drift by Learning to be Consistent17 Feb
  12. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Models9 Feb
19 more
  1. 2023Simple diffusion: End-to-end diffusion for high resolution images26 Jan
  2. 2023On the Importance of Noise Scheduling for Diffusion Models26 Jan
  3. 2022Scalable Diffusion Models with Transformers19 Dec
  4. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models2 Nov
  5. 2022Blurring Diffusion Models12 Sep
  6. 2022Soft Diffusion: Score Matching for General Corruptions12 Sep
  7. 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noise19 Aug
  8. 2022Classifier-Free Diffusion Guidance26 Jul
  9. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
  10. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  11. 2022Fast Sampling of Diffusion Models with Exponential Integrator29 Apr
  12. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  13. 2021Variational Diffusion Models1 Jul
  14. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  15. 2021Improved Denoising Diffusion Probabilistic Models18 Feb
  16. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  17. 2020Denoising Diffusion Implicit Models6 Oct
  18. 2020Denoising Diffusion Probabilistic Models19 Jun
  19. 2020Improved Techniques for Training Score-Based Generative Models16 Jun

Other references · 10

  1. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,023
  2. 2022Flow Matching for Generative Modelingcited by 5,542
  3. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,077
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,607
  5. 2022Building Normalizing Flows with Stochastic Interpolantscited by 979
  6. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 928
  7. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 917
  8. 2018Assessing Generative Models via Precision and Recallcited by 405
  9. 2022Generative Modelling With Inverse Heat Dissipationcited by 165
  10. 2019Effectively Unbiased FID and Inception Score and where to find themcited by 162

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025On the Collapse Errors Induced by the Deterministic Sampler for Diffusion Models
  2. 2023Restoration-Degradation Beyond Linear Diffusions: A Non-Asymptotic Analysis For DDIM-Type Samplers
  3. 2026Rethinking the Diffusion Model from a Langevin Perspective
  4. 2025Test-Time Scaling of Diffusion Models via Noise Trajectory Search
  5. 2024Constant Rate Scheduling: A General Framework for Optimizing Diffusion Noise Schedule via Distributional Change
  6. 2023The Emergence of Reproducibility and Generalizability in Diffusion Models
  7. 2023The Missing U for Efficient Diffusion Models
  8. 2025Diffusion models under low-noise regime