Denoising growth complexity: Data geometry and certified schedules for diffusion sampling
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Two central challenges in diffusion-based sampling are the theoretical one of understanding their remarkable effectiveness even in high-dimensional settings, and the practical one of designing algorithms with certified performance guarantees. We show that these questions are intimately connected via the denoising growth complexity (mathsfDGC). It is a geometric measure defined by a log-time weighted integral of the derivative of the denoising mean-squared error along the Gaussian heat flow. We show how the mathsfDGC increments lead to a simple and explicit bound on the KL error of an Euler scheme applied to the stochastic innovations representation. The bound is local along the path: each step is controlled by the corresponding mathsfDGC increment and its relative stepsize. This structure allows us to derive KL sampling guarantees for optimized stepsize schedules, both in a simpler single-block setting and in a more refined K-block setting. The mathsfDGC function has a natural martingale structure, which we exploit to develop fully data-certified versions of these algorithms. It also admits information-theoretic upper bounds in terms of covariance, rate distortion, metric entropy, and the Poincar'e constant, thereby recovering and sharpening a range of existing diffusion-sampling guarantees, as well as giving new results. In log heat-time, the fine partition limit is governed by an integral involving the square root of the mathsfDGC density, whereas a single-block schedule depends on its ordinary integral. This comparison precisely characterizes when adaptation to data geometry yields substantial computational gains, including logarithmic-to-constant separations for simple Gaussian mixture models.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 44 of its 59 references that are in the map. First posted on arXiv 28 Jul 2026.
Builds on
44 of 59 references.
Closest ancestors · 39
Same direction, newest first
- 2026High-accuracy sampling for diffusion models and log-concave distributions1 Feb
- 2026High-accuracy and dimension-free sampling with diffusions15 Jan
- 2025Faster Diffusion Models via Higher-Order Approximation30 Jun
- 2025Dimension-Free Convergence of Diffusion Models for Approximate Gaussian Mixtures7 Apr
- 2025Minimax Optimality of the Probability Flow ODE for Diffusion Models12 Mar
- 2025Information-Theoretic Proofs for Diffusion Sampling4 Feb
- 2024Provable Acceleration for Diffusion Models under Minimal Assumptions30 Oct
- 2024Denoising diffusion probabilistic models are optimally adaptive to unknown low dimensionality24 Oct
- 2024Linear Convergence of Diffusion Models Under the Manifold Hypothesis11 Oct
- 2024O(d/T) Convergence Theory for Diffusion Probabilistic Models under Minimal Assumptions27 Sep
- 2024Convergence of Diffusion Models Under the Manifold Hypothesis in High-Dimensions27 Sep
- 2024A Sharp Convergence Theory for The Probability Flow ODEs of Diffusion Models5 Aug
27 more
- 2024Reverse Transition Kernel: A Flexible Framework to Accelerate Diffusion Inference26 May
- 2024Learning to Discretize Denoising Diffusion ODEs24 May
- 2024Adapting to Unknown Low-Dimensional Structures in Score-Based Diffusion Models23 May
- 2024Learning general Gaussian mixtures with efficient score matching29 Apr
- 2024Learning Mixtures of Gaussians Using Diffusion Models29 Apr
- 2024Align Your Steps: Optimizing Sampling Schedules in Diffusion Models22 Apr
- 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization11 Apr
- 2024Accelerating Convergence of Score-Based Diffusion Models, Provably6 Mar
- 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localization7 Aug
- 2023Learning Mixtures of Gaussians Using the DDPM Objective3 Jul
- 2023Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models15 Jun
- 2023Error Bounds for Flow Matching Methods26 May
- 2023The probability flow ODE is provably fast19 May
- 2023Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Data14 Feb
- 2022Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptions3 Nov
- 2022Convergence of score-based generative modeling for general data distributions26 Sep
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep
- 2022Diffusion Models in Vision: A Survey10 Sep
- 2022Convergence for score-based generative modeling with polynomial complexity13 Jun
- 2022Score-Based Generative Models Detect Manifolds2 Jun
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
- 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
- 2022Riemannian Score-Based Generative Modelling6 Feb
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Learning to Efficiently Sample from Diffusion Probabilistic Models7 Jun
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 5
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
- 2023Sampling, Diffusions, and Stochastic Localizationcited by 38
- 2025Fast Score-Based Sampling via Log-Concave Reductionscited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026The data geometry of masking diffusion: Certified-optimal schedules via unmasking growth complexity
- 2025Sublinear iterations can suffice even for DDPMs
- 2025Computational bottlenecks for denoising diffusions
- 2026Geometry-Aware Discretization Error of Diffusion Models
- 2023A Geometric Perspective on Diffusion Models
- 2025Optimal Stepsize for Diffusion Sampling
- 2024Score-Optimal Diffusion Schedules
- 2024Faster Diffusion Sampling with Randomized Midpoints: Sequential and Parallel