Dimension-free error estimate for diffusion model and optimal scheduling
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion generative models have emerged as powerful tools for producing synthetic data from an empirically observed distribution. A common approach involves simulating the time-reversal of an Ornstein-Uhlenbeck (OU) process initialized at the true data distribution. Since the score function associated with the OU process is typically unknown, it is approximated using a trained neural network. This approximation, along with finite time simulation, time discretization and statistical approximation, introduce several sources of error whose impact on the generated samples must be carefully understood. Previous analyses have quantified the error between the generated and the true data distributions in terms of Wasserstein distance or Kullback-Leibler (KL) divergence. However, both metrics present limitations: KL divergence requires absolute continuity between distributions, while Wasserstein distance, though more general, leads to error bounds that scale poorly with dimension, rendering them impractical in high-dimensional settings. In this work, we derive an explicit, dimension-free bound on the discrepancy between the generated and the true data distributions. The bound is expressed in terms of a smooth test functional with bounded first and second derivatives. The key novelty lies in the use of this weaker, functional metric to obtain dimension-independent guarantees, at the cost of higher regularity on the test functions. As an application, we formulate and solve a variational problem to minimize the time-discretization error, leading to the derivation of an optimal time-scheduling strategy for the reverse-time diffusion. Interestingly, this scheduler has appeared previously in the literature in a different context; our analysis provides a new justification for its optimality, now grounded in minimizing the discretization bias in generative sampling.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 51 of its 62 references that are in the map. First posted on arXiv 1 Dec 2025.
Builds on
51 of 62 references.
Closest ancestors · 39
Same direction, newest first
- 2025On the Edge of Memorization in Diffusion Models25 Aug
- 2025Faster Diffusion Models via Higher-Order Approximation30 Jun
- 2025Dimension-Free Convergence of Diffusion Models for Approximate Gaussian Mixtures7 Apr
- 2025Minimax Optimality of the Probability Flow ODE for Diffusion Models12 Mar
- 2025Advancing Wasserstein Convergence Analysis of Score-Based Models: Insights from Discretization and Second-Order Acceleration7 Feb
- 2025Information-Theoretic Proofs for Diffusion Sampling4 Feb
- 2025Low-dimensional adaptation of diffusion models: Convergence in total variation22 Jan
- 2024Instance-dependent Convergence Theory for Diffusion Models17 Oct
- 2024Linear Convergence of Diffusion Models Under the Manifold Hypothesis11 Oct
- 2024O(d/T) Convergence Theory for Diffusion Probabilistic Models under Minimal Assumptions27 Sep
- 2024Convergence of Diffusion Models Under the Manifold Hypothesis in High-Dimensions27 Sep
- 2024A Sharp Convergence Theory for The Probability Flow ODEs of Diffusion Models5 Aug
27 more
- 2024Faster Diffusion Sampling with Randomized Midpoints: Sequential and Parallel3 Jun
- 2024Learning general Gaussian mixtures with efficient score matching29 Apr
- 2024Learning Mixtures of Gaussians Using Diffusion Models29 Apr
- 2024Accelerating Convergence of Score-Based Diffusion Models, Provably6 Mar
- 2024Dynamical Regimes of Diffusion Models28 Feb
- 2024An analysis of the noise schedule for score-based generative models7 Feb
- 2024Convergence Analysis for General Probability Flow ODEs of Diffusion Models in Wasserstein Distances31 Jan
- 2023A Note on the Convergence of Denoising Diffusion Probabilistic Models10 Dec
- 2023Wasserstein Convergence Guarantees for a General Class of Score-Based Generative Models18 Nov
- 2023KL Convergence Guarantees for Score diffusion models under minimal data assumptions23 Aug
- 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localization7 Aug
- 2023Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models15 Jun
- 2023Error Bounds for Flow Matching Methods26 May
- 2023Improved Convergence of Score-Based Diffusion Models via Prediction-Correction23 May
- 2023The probability flow ODE is provably fast19 May
- 2023Diffusion Models are Minimax Optimal Distribution Estimators3 Mar
- 2023Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Data14 Feb
- 2022From Denoising Diffusions to Denoising Markov Models7 Nov
- 2022Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptions3 Nov
- 2022Convergence of score-based generative modeling for general data distributions26 Sep
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep
- 2022Convergence of denoising diffusion models under the manifold hypothesis10 Aug
- 2022Convergence for score-based generative modeling with polynomial complexity13 Jun
- 2022Score-Based Generative Models Detect Manifolds2 Jun
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modeling1 Jun
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 12
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Generative Adversarial Networkscited by 5,627
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
- 2020Generative Modeling with Denoising Auto-Encoders and Langevin Samplingcited by 119
- 2023Convergence of flow-based generative models via proximal gradient descent in Wasserstein spacecited by 34
- 2025Accelerated Diffusion Models via Speculative Samplingcited by 31
- 2025d2: Improving Reasoning in Diffusion Language Models via Trajectory Likelihood Estimationcited by 27
- 2025A Theoretical Analysis of Discrete Flow Matching Generative Modelscited by 14
- 2025Error Analysis of Discrete Flow with Generator Matchingcited by 9
- 2025Finite-Time Analysis of Discrete-Time Stochastic Interpolantscited by 4
- 2025Scale-Wise VAR is Secretly Discrete Diffusioncited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025A Sharp KL-Convergence Analysis for Diffusion Models under Minimal Assumptions
- 2026A Unified Kullback--Leibler Divergence Analysis of Generative Diffusion Models via Entropy Production Rate
- 2026A Gaussian Perspective for Distributional Discrepancy in Generative Diffusion Models
- 2024Wasserstein Bounds for generative diffusion models with Gaussian tail targets
- 2025Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distance
- 2026From Score Approximation to Distribution Approximation in Score-Based Diffusion Models
- 2025Optimization-Free Diffusion Model -- A Perturbation Theory Approach
- 2026Tightening the Score Matching Gap for Diffusion Models