Is Monotonic Sampling Necessary in Diffusion Models?
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion models generate samples by iteratively denoising a Gaussian prior, traversing a sequence of noise levels that, in every published sampler, decreases monotonically. Six years of intensive work has refined nearly every aspect of this recipe, including the corruption operator, the training objective, the schedule shape, the architecture, and the ODE solver. Yet the assumption of monotonicity itself has never been systematically tested. Here we ask whether monotonic sampling is load-bearing or merely conventional. We design four families of structured nonmonotonic schedules and apply them to three architecturally distinct generative models, DDPM, EDM, and Flow Matching, across NFE budgets ranging from 10 to 200 function evaluations, plus a 42-cell hyperparameter ablation, on CIFAR-10. Across all 90 tested configurations, no tested nonmonotonic schedule improves on the monotonic baseline. The magnitude of the penalty, however, spans nearly three orders of magnitude: persistent and substantial in DDPM, intermediate in Flow Matching, and indistinguishable from zero in EDM. We show that this variation is not noise but a structural property of each trained denoiser, and we formalize it as the Schedule Sensitivity Coefficient, a cheap, architecture-agnostic diagnostic that provides evidence of non-convergence to the Bayes-optimal denoiser at the critical noise level. Our findings justify the field's tacit reliance on monotonic schedules and supply a new probe of diffusion model quality complementary to sample-quality metrics such as Frechet Inception Distance.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 41 of its 49 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
41 of 49 references.
Closest ancestors · 31
Same direction, newest first
- 2024Improved Noise Schedule for Diffusion Training3 Jul
- 2024Guiding a Diffusion Model with a Bad Version of Itself4 Jun
- 2024Align Your Steps: Optimizing Sampling Schedules in Diffusion Models22 Apr
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
- 2024Scalable High-Resolution Pixel-Space Image Synthesis with Hourglass Diffusion Transformers21 Jan
- 2023Analyzing and Improving the Training Dynamics of Diffusion Models5 Dec
- 2023Restart Sampling for Improving Generative Processes26 Jun
- 2023Common Diffusion Noise Schedules and Sample Steps are Flawed15 May
- 2023Efficient Diffusion Training via Min-SNR Weighting Strategy16 Mar
- 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentation1 Mar
- 2023Consistent Diffusion Models: Mitigating Sampling Drift by Learning to be Consistent17 Feb
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Models9 Feb
19 more
- 2023Simple diffusion: End-to-end diffusion for high resolution images26 Jan
- 2023On the Importance of Noise Scheduling for Diffusion Models26 Jan
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models2 Nov
- 2022Blurring Diffusion Models12 Sep
- 2022Soft Diffusion: Score Matching for General Corruptions12 Sep
- 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noise19 Aug
- 2022Classifier-Free Diffusion Guidance26 Jul
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
- 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
- 2022Fast Sampling of Diffusion Models with Exponential Integrator29 Apr
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Variational Diffusion Models1 Jul
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2021Improved Denoising Diffusion Probabilistic Models18 Feb
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
- 2020Improved Techniques for Training Score-Based Generative Models16 Jun
Other references · 10
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,023
- 2022Flow Matching for Generative Modelingcited by 5,542
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,077
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,607
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 979
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 928
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 917
- 2018Assessing Generative Models via Precision and Recallcited by 405
- 2022Generative Modelling With Inverse Heat Dissipationcited by 165
- 2019Effectively Unbiased FID and Inception Score and where to find themcited by 162
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025On the Collapse Errors Induced by the Deterministic Sampler for Diffusion Models
- 2023Restoration-Degradation Beyond Linear Diffusions: A Non-Asymptotic Analysis For DDIM-Type Samplers
- 2026Rethinking the Diffusion Model from a Langevin Perspective
- 2025Test-Time Scaling of Diffusion Models via Noise Trajectory Search
- 2024Constant Rate Scheduling: A General Framework for Optimizing Diffusion Noise Schedule via Distributional Change
- 2023The Emergence of Reproducibility and Generalizability in Diffusion Models
- 2023The Missing U for Efficient Diffusion Models
- 2025Diffusion models under low-noise regime