mlsanityData to 7 Oct 2026

Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distance

arXiv 2501.02298 ↗First posted 4 Jan 2025stat.ML cs.LGcited by 27

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Score-based Generative Models (SGMs) aim to sample from a target distribution by learning score functions using samples perturbed by Gaussian noise. Existing convergence bounds for SGMs in the W2-distance rely on stringent assumptions about the data distribution. In this work, we present a novel framework for analyzing W2-convergence in SGMs, significantly relaxing traditional assumptions such as log-concavity and score regularity. Leveraging the regularization properties of the Ornstein--Uhlenbeck (OU) process, we show that weak log-concavity of the data distribution evolves into log-concavity over time. This transition is rigorously quantified through a PDE-based analysis of the Hamilton--Jacobi--Bellman equation governing the log-density of the forward process. Moreover, we establish that the drift of the time-reversed OU process alternates between contractive and non-contractive regimes, reflecting the dynamics of concavity. Our approach circumvents the need for stringent regularity conditions on the score function and its estimators, relying instead on milder, more practical assumptions. We demonstrate the wide applicability of this framework through explicit computations on Gaussian mixture models, illustrating its versatility and potential for broader classes of data distributions.

Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 43 of its 65 references that are in the map. First posted on arXiv 4 Jan 2025.

Builds on

43 of 65 references.

Closest ancestors · 21

Same direction, newest first

  1. 2024Score-based generative models are provably robust: an uncertainty quantification perspective24 May
  2. 2024Wasserstein proximal operators describe score-based generative models and resolve memorization9 Feb
  3. 2024An analysis of the noise schedule for score-based generative models7 Feb
  4. 2024Contractive Diffusion Probabilistic Models23 Jan
  5. 2023On diffusion-based generative models and their error bounds: The log-concave case with full convergence estimates22 Nov
  6. 2023Wasserstein Convergence Guarantees for a General Class of Score-Based Generative Models18 Nov
  7. 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localization7 Aug
  8. 2023Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models15 Jun
  9. 2023Diffusion Models are Minimax Optimal Distribution Estimators3 Mar
  10. 2022Score-based Generative Modeling Secretly Minimizes the Wasserstein Distance13 Dec
  11. 2022Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptions3 Nov
  12. 2022An optimal control perspective on diffusion-based generative modeling2 Nov
9 more
  1. 2022Convergence of score-based generative modeling for general data distributions26 Sep
  2. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep
  3. 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep
  4. 2022Convergence of denoising diffusion models under the manifold hypothesis10 Aug
  5. 2022Convergence for score-based generative modeling with polynomial complexity13 Jun
  6. 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modeling1 Jun
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  8. 2020Denoising Diffusion Implicit Models6 Oct
  9. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 22

  1. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  3. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  4. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 439
  5. 2021SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Modelscited by 415
  6. 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 206
  7. 2015Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithmcited by 195
  8. 2017Underdamped Langevin MCMC: A non-asymptotic analysiscited by 131
  9. 2020Generative Modeling with Denoising Auto-Encoders and Langevin Samplingcited by 118
  10. 2018Log-concave sampling: Metropolis-Hastings algorithms are fastcited by 117
  11. 2020Structured Logconcave Sampling with a Restricted Gaussian Oraclecited by 85
  12. 2019The Randomized Midpoint Method for Log-Concave Samplingcited by 77
10 more
  1. 2022Improved analysis for a proximal algorithm for samplingcited by 72
  2. 2019High-Order Langevin Diffusion Yields an Accelerated MCMC Algorithmcited by 36
  3. 2023A mean-field games laboratory for generative modelingcited by 28
  4. 2021Sqrt(d) Dimension Dependence of Langevin Monte Carlocited by 25
  5. 2023Projected Langevin dynamics and a gradient flow for entropic optimal transportcited by 17
  6. 2024DiffPuter: Empowering Diffusion Models for Missing Data Imputationcited by 17
  7. 2024Theoretical guarantees in KL for Diffusion Flow Matchingcited by 14
  8. 2023Chain of Log-Concave Markov Chainscited by 13
  9. 2023Bayesian ECG reconstruction using denoising diffusion generative modelscited by 2
  10. 2024The exponential turnpike phenomenon for mean field game systems: weakly monotone drifts and small interactionscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 13; 2026: 14.

27 papers.

Sort:

By area:

  1. 2025Low-dimensional adaptation of diffusion models: Convergence in total variationcited by 38
  2. 2025Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distancecited by 20
  3. 2025Advancing Wasserstein Convergence Analysis of Score-Based Models: Insights from Discretization and Second-Order Accelerationcited by 17
  4. 2025Wasserstein Convergence of Score-based Generative Models under Semiconvexity and Discontinuous Gradientscited by 15
  5. 2025Assessing the Quality of Denoising Diffusion Models in Wasserstein Distance: Noisy Score and Optimal Boundscited by 8
  6. 2025Non-asymptotic error bounds for probability flow ODEs under weak log-concavitycited by 7
  7. 2026Lipschitz regularity in Flow Matching and Diffusion Models: sharp sampling rates and functional inequalitiescited by 6
  8. 2025Wasserstein Convergence of Critically Damped Langevin Diffusionscited by 5
  9. 2025The Performance Of The Unadjusted Langevin Algorithm Without Smoothness Assumptionscited by 4
  10. 2025Optimal Denoising in Score-Based Generative Models: The Role of Data Regularitycited by 4
  11. 2025Pathway to O(√d) Complexity bound under Wasserstein metric of flow-based modelscited by 4
  12. 2025Exponential Convergence Guarantees for Iterative Markovian Fittingcited by 3
15 more
  1. 2026On Forgetting and Stability of Score-based Generative modelscited by 3
  2. 2025A Malliavin-Gamma calculus approach to Score Based Diffusion Generative models for random fieldscited by 2
  3. 2026Query Lower Bounds for Diffusion Samplingcited by 2
  4. 2026Wasserstein bounds for denoising diffusion probabilistic models via the F"ollmer processcited by 2
  5. 2026Load--Reserve Wasserstein Propagation for Isotropic Diffusion Samplerscited by 1
  6. 2026Diffusion Models for Adaptive Sequential Data Generationcited by 1
  7. 2025Factor-Based Conditional Diffusion Model for Contextual Portfolio Optimizationcited by 0
  8. 2026Do Heavy Tails Help Diffusion? On the Subtle Trade-off Between Initialization and Trainingcited by 0
  9. 2026Theoretical guidelines for annealed Langevin dynamics in compositional simulation-based inferencecited by 0
  10. 2026Diffusion Flow Matching: Dimension-Improved KL Bounds and Wasserstein Guaranteescited by 0
  11. 2026Near-Lipschitz stability of the Kim--Milman flow mapcited by 0
  12. 2026Tightening the Score Matching Gap for Diffusion Modelscited by 0
  13. 2026Breaking the Curse with BAND: Nonparametric Distribution Estimation in High Dimensionscited by 0
  14. 2026Diffusion Models for High-Dimensional Clustered Data: Intrinsic-Dimension Adaptivity via Bayesian Classificationcited by 0
  15. 2026Universal Local Error and Realized Amplification for the First-Order EDM Predictorcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Global Well-posedness and Convergence Analysis of Score-based Generative Models via Sharp Lipschitz Estimates
  2. 2025Algorithm- and Data-Dependent Generalization Bounds for Diffusion Models
  3. 2023Improved Convergence of Score-Based Diffusion Models via Prediction-Correction
  4. 2026Non-asymptotic Convergence of Stochastic Gradient Descent in Score-based Generative Models
  5. 2024Discrete vs. Continuous Trade-offs for Generative Models
  6. 2026Generalizing Score-based generative models for Heavy-tailed Distributions
  7. 2024Convergence Analysis of Probability Flow ODE for Score-based Generative Models
  8. 2021Score-based Generative Modeling in Latent Space