On diffusion-based generative models and their error bounds: The log-concave case with full convergence estimates
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
We provide full theoretical guarantees for the convergence behaviour of diffusion-based generative models under the assumption of strongly log-concave data distributions while our approximating class of functions used for score estimation is made of Lipschitz continuous functions avoiding any Lipschitzness assumption on the score function. We demonstrate via a motivating example, sampling from a Gaussian distribution with unknown mean, the powerfulness of our approach. In this case, explicit estimates are provided for the associated optimization problem, i.e. score approximation, while these are combined with the corresponding sampling estimates. As a result, we obtain the best known upper bound estimates in terms of key quantities of interest, such as the dimension and rates of convergence, for the Wasserstein-2 distance between the data distribution (Gaussian with unknown mean) and our sampling algorithm. Beyond the motivating example and in order to allow for the use of a diverse range of stochastic optimizers, we present our results using an L2-accurate score estimation assumption, which crucially is formed under an expectation with respect to the stochastic optimizer and our novel auxiliary process that uses only known information. This approach yields the best known convergence rate for our sampling algorithm.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 30 of its 58 references that are in the map. First posted on arXiv 22 Nov 2023.
Builds on
30 of 58 references.
Closest ancestors · 19
Same direction, newest first
- 2023Wasserstein Convergence Guarantees for a General Class of Score-Based Generative Models18 Nov
- 2023KL Convergence Guarantees for Score diffusion models under minimal data assumptions23 Aug
- 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localization7 Aug
- 2023Improved Convergence of Score-Based Diffusion Models via Prediction-Correction23 May
- 2023The probability flow ODE is provably fast19 May
- 2023Diffusion Models are Minimax Optimal Distribution Estimators3 Mar
- 2023Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Data14 Feb
- 2022Score-based Generative Modeling Secretly Minimizes the Wasserstein Distance13 Dec
- 2022Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptions3 Nov
- 2022Convergence of score-based generative modeling for general data distributions26 Sep
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep
- 2022Let us Build Bridges: Understanding and Extending Diffusion Generative Models31 Aug
7 more
- 2022Convergence of denoising diffusion models under the manifold hypothesis10 Aug
- 2022Convergence for score-based generative modeling with polynomial complexity13 Jun
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modeling1 Jun
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 11
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
- 2018Lipschitz regularity of deep neural networks: analysis and efficient estimationcited by 415
- 2019Efficient and Accurate Estimation of Lipschitz Constants for Deep Neural Networkscited by 293
- 2020Generative Modeling with Denoising Auto-Encoders and Langevin Samplingcited by 119
- 2022Can Push-forward Generative Models Fit Multimodal Distributions?cited by 41
- 2018On stochastic gradient Langevin dynamics with dependent data streams in the logconcave casecited by 20
- 2021Polygonal Unadjusted Langevin Algorithms: Creating stable and efficient adaptive algorithms for neural networkscited by 11
Built on by
Citing papers per year: 2024: 7; 2025: 11; 2026: 7.
25 papers.
Sort:
By area:
- 2024Convergence Analysis for General Probability Flow ODEs of Diffusion Models in Wasserstein Distancescited by 56
- 2025Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distancecited by 29
- 2024Convergence of Continuous Normalizing Flows for Learning Probability Distributionscited by 26
- 2025Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distancecited by 21
- 2025Discrete Diffusion Models: Novel Analysis and New Sampler Guaranteescited by 20
- 2024Broadening Target Distributions for Accelerated Diffusion Models via a Novel Analysis Approachcited by 19
- 2025Advancing Wasserstein Convergence Analysis of Score-Based Models: Insights from Discretization and Second-Order Accelerationcited by 17
- 2025Wasserstein Convergence of Score-based Generative Models under Semiconvexity and Discontinuous Gradientscited by 15
- 2024Generating High Dimensional User-Specific Wireless Channels using Diffusion Modelscited by 14
- 2024Wasserstein Bounds for generative diffusion models with Gaussian tail targetscited by 10
- 2025Assessing the Quality of Denoising Diffusion Models in Wasserstein Distance: Noisy Score and Optimal Boundscited by 9
- 2024Theory on Score-Mismatched Diffusion Models and Zero-Shot Conditional Samplerscited by 7
13 more
- 2025Non-asymptotic error bounds for probability flow ODEs under weak log-concavitycited by 7
- 2025Sublinear iterations can suffice even for DDPMscited by 7
- 2025Distribution estimation via Flow Matching with Lipschitz guaranteescited by 6
- 2025Wasserstein Convergence of Critically Damped Langevin Diffusionscited by 6
- 2024Denoising Diffusions with Optimal Transport: Localization, Curvature, and Multi-Scale Complexitycited by 5
- 2026Multi-Subspace Multi-Modal Modeling for Diffusion Models: Estimation, Convergence and Mixture of Expertscited by 1
- 2026Entropy-Based Dimension-Free Convergence and Loss-Adaptive Schedules for Diffusion Modelscited by 1
- 2025Flatness-Aware Stochastic Gradient Langevin Dynamicscited by 0
- 2026Adaptive Auxiliary Prompt Blending for Target-Faithful Diffusion Generationcited by 0
- 2026Convergence of empirical subgradients for optimal transport-based objectivescited by 0
- 2026Diffusion Flow Matching: Dimension-Improved KL Bounds and Wasserstein Guaranteescited by 0
- 2026Tightening the Score Matching Gap for Diffusion Modelscited by 0
- 2026A Stochastic Analysis Perspective on Diffusion Modelscited by 0
- 2026A Stochastic Analysis Perspective on Diffusion Models9 Oct 2026
- 2026Tightening the Score Matching Gap for Diffusion Models5 Jul 2026
- 2026Diffusion Flow Matching: Dimension-Improved KL Bounds and Wasserstein Guarantees15 Jun 2026
- 2026Convergence of empirical subgradients for optimal transport-based objectives27 May 2026
- 2026Adaptive Auxiliary Prompt Blending for Target-Faithful Diffusion Generation19 Mar 2026
- 2026Entropy-Based Dimension-Free Convergence and Loss-Adaptive Schedules for Diffusion Models29 Jan 2026
- 2026Multi-Subspace Multi-Modal Modeling for Diffusion Models: Estimation, Convergence and Mixture of Experts4 Jan 2026
- 2025Sublinear iterations can suffice even for DDPMs6 Nov 2025
- 2025Wasserstein Convergence of Critically Damped Langevin Diffusions4 Nov 2025
- 2025Non-asymptotic error bounds for probability flow ODEs under weak log-concavity20 Oct 2025
- 2025Flatness-Aware Stochastic Gradient Langevin Dynamics2 Oct 2025
- 2025Discrete Diffusion Models: Novel Analysis and New Sampler Guarantees20 Sep 2025
13 more
- 2025Distribution estimation via Flow Matching with Lipschitz guarantees2 Sep 2025
- 2025Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distance5 Aug 2025
- 2025Assessing the Quality of Denoising Diffusion Models in Wasserstein Distance: Noisy Score and Optimal Bounds11 Jun 2025
- 2025Wasserstein Convergence of Score-based Generative Models under Semiconvexity and Discontinuous Gradients6 May 2025
- 2025Advancing Wasserstein Convergence Analysis of Score-Based Models: Insights from Discretization and Second-Order Acceleration7 Feb 2025
- 2025Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distance4 Jan 2025
- 2024Wasserstein Bounds for generative diffusion models with Gaussian tail targets15 Dec 2024
- 2024Denoising Diffusions with Optimal Transport: Localization, Curvature, and Multi-Scale Complexity3 Nov 2024
- 2024Theory on Score-Mismatched Diffusion Models and Zero-Shot Conditional Samplers17 Oct 2024
- 2024Generating High Dimensional User-Specific Wireless Channels using Diffusion Models5 Sep 2024
- 2024Convergence of Continuous Normalizing Flows for Learning Probability Distributions31 Mar 2024
- 2024Broadening Target Distributions for Accelerated Diffusion Models via a Novel Analysis Approach21 Feb 2024
- 2024Convergence Analysis for General Probability Flow ODEs of Diffusion Models in Wasserstein Distances31 Jan 2024
- 2024Convergence Analysis for General Probability Flow ODEs of Diffusion Models in Wasserstein Distancescited by 56
- 2025Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distancecited by 29
- 2025Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distancecited by 21
- 2025Discrete Diffusion Models: Novel Analysis and New Sampler Guaranteescited by 20
- 2024Broadening Target Distributions for Accelerated Diffusion Models via a Novel Analysis Approachcited by 19
- 2025Advancing Wasserstein Convergence Analysis of Score-Based Models: Insights from Discretization and Second-Order Accelerationcited by 17
- 2025Wasserstein Convergence of Score-based Generative Models under Semiconvexity and Discontinuous Gradientscited by 15
- 2024Generating High Dimensional User-Specific Wireless Channels using Diffusion Modelscited by 14
- 2024Wasserstein Bounds for generative diffusion models with Gaussian tail targetscited by 10
- 2025Assessing the Quality of Denoising Diffusion Models in Wasserstein Distance: Noisy Score and Optimal Boundscited by 9
- 2024Theory on Score-Mismatched Diffusion Models and Zero-Shot Conditional Samplerscited by 7
- 2025Non-asymptotic error bounds for probability flow ODEs under weak log-concavitycited by 7
12 most cited of 22 All 22 (JSON)
- 2026A Stochastic Analysis Perspective on Diffusion Models9 Oct 2026
- 2026Tightening the Score Matching Gap for Diffusion Models5 Jul 2026
- 2026Diffusion Flow Matching: Dimension-Improved KL Bounds and Wasserstein Guarantees15 Jun 2026
- 2026Adaptive Auxiliary Prompt Blending for Target-Faithful Diffusion Generation19 Mar 2026
- 2026Entropy-Based Dimension-Free Convergence and Loss-Adaptive Schedules for Diffusion Models29 Jan 2026
- 2026Multi-Subspace Multi-Modal Modeling for Diffusion Models: Estimation, Convergence and Mixture of Experts4 Jan 2026
- 2025Sublinear iterations can suffice even for DDPMs6 Nov 2025
- 2025Wasserstein Convergence of Critically Damped Langevin Diffusions4 Nov 2025
- 2025Non-asymptotic error bounds for probability flow ODEs under weak log-concavity20 Oct 2025
- 2025Discrete Diffusion Models: Novel Analysis and New Sampler Guarantees20 Sep 2025
- 2025Distribution estimation via Flow Matching with Lipschitz guarantees2 Sep 2025
- 2025Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distance5 Aug 2025
12 newest of 22 All 22 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models
- 2024Global Well-posedness and Convergence Analysis of Score-based Generative Models via Sharp Lipschitz Estimates
- 2026Generalization Properties of Score-matching Diffusion Models for Intrinsically Low-dimensional Data
- 2023A Note on the Convergence of Denoising Diffusion Probabilistic Models
- 2025Algorithm- and Data-Dependent Generalization Bounds for Diffusion Models
- 2025From Score Matching to Diffusion: A Fine-Grained Error Analysis in the Gaussian Setting
- 2024Discrete vs. Continuous Trade-offs for Generative Models
- 2025Low-dimensional adaptation of diffusion models: Convergence in total variation