mlsanityData to 7 Oct 2026

Wasserstein Convergence of Score-based Generative Models under Semiconvexity and Discontinuous Gradients

arXiv 2505.03432 ↗First posted 6 May 2025cs.LG math.OC math.PRcited by 15

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Score-based Generative Models (SGMs) approximate a data distribution by perturbing it with Gaussian noise and subsequently denoising it via a learned reverse diffusion process. These models excel at modeling complex data distributions and generating diverse samples, achieving state-of-the-art performance across domains such as computer vision, audio generation, reinforcement learning, and computational biology. Despite their empirical success, existing Wasserstein-2 convergence analysis typically assume strong regularity conditions-such as smoothness or strict log-concavity of the data distribution-that are rarely satisfied in practice. In this work, we establish the first non-asymptotic Wasserstein-2 convergence guarantees for SGMs targeting semiconvex distributions with potentially discontinuous gradients. Our upper bounds are explicit and sharp in key parameters, achieving optimal dependence of O(√d) on the data dimension d and convergence rate of order one. The framework accommodates a wide class of practically relevant distributions, including symmetric modified half-normal distributions, Gaussian mixtures, double-well potentials, and elastic net potentials. By leveraging semiconvexity without requiring smoothness assumptions on the potential such as differentiability, our results substantially broaden the theoretical foundations of SGMs, bridging the gap between empirical success and rigorous guarantees in non-smooth, complex data regimes.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 63 of its 95 references that are in the map. First posted on arXiv 6 May 2025.

Builds on

63 of 95 references.

Closest ancestors · 28

Same direction, newest first

  1. 2025Advancing Wasserstein Convergence Analysis of Score-Based Models: Insights from Discretization and Second-Order Acceleration7 Feb
  2. 2025Low-dimensional adaptation of diffusion models: Convergence in total variation22 Jan
  3. 2025Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distance4 Jan
  4. 2024Wasserstein Bounds for generative diffusion models with Gaussian tail targets15 Dec
  5. 2024Provable Acceleration for Diffusion Models under Minimal Assumptions30 Oct
  6. 2024Score-based generative models are provably robust: an uncertainty quantification perspective24 May
  7. 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization11 Apr
  8. 2024An analysis of the noise schedule for score-based generative models7 Feb
  9. 2024Contractive Diffusion Probabilistic Models23 Jan
  10. 2023On diffusion-based generative models and their error bounds: The log-concave case with full convergence estimates22 Nov
  11. 2023Wasserstein Convergence Guarantees for a General Class of Score-Based Generative Models18 Nov
  12. 2023State of the Art on Diffusion Models for Visual Computing11 Oct
16 more
  1. 2023KL Convergence Guarantees for Score diffusion models under minimal data assumptions23 Aug
  2. 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localization7 Aug
  3. 2023Improved Convergence of Score-Based Diffusion Models via Prediction-Correction23 May
  4. 2023Diffusion Models are Minimax Optimal Distribution Estimators3 Mar
  5. 2023Universal Guidance for Diffusion Models14 Feb
  6. 2022Score-based Generative Modeling Secretly Minimizes the Wasserstein Distance13 Dec
  7. 2022Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptions3 Nov
  8. 2022Convergence of score-based generative modeling for general data distributions26 Sep
  9. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep
  10. 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep
  11. 2022Let us Build Bridges: Understanding and Extending Diffusion Generative Models31 Aug
  12. 2022Convergence of denoising diffusion models under the manifold hypothesis10 Aug
  13. 2022Convergence for score-based generative modeling with polynomial complexity13 Jun
  14. 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modeling1 Jun
  15. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  16. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 35

  1. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  3. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  4. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  5. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  6. 2022Human Motion Diffusion Modelcited by 1,062
  7. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
  8. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  9. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
  10. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
  11. 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 577
  12. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
23 more
  1. 2021Score-based diffusion models for accelerated MRIcited by 308
  2. 2023IDQL: Implicit Q-Learning as an Actor-Critic Method with Diffusion Policiescited by 307
  3. 2022Torsional Diffusion for Molecular Conformer Generationcited by 262
  4. 2023Imitating Human Behaviour with Diffusion Modelscited by 260
  5. 2023Goal-Conditioned Imitation Learning using Score-based Diffusion Policiescited by 229
  6. 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Modelscited by 195
  7. 2021Symbolic Music Generation with Diffusion Modelscited by 152
  8. 2020Generative Modeling with Denoising Auto-Encoders and Langevin Samplingcited by 118
  9. 2022Latent Diffusion for Language Generationcited by 110
  10. 2023Consistency Models as a Rich and Efficient Policy Class for Reinforcement Learningcited by 93
  11. 2023Diffusion Models for Reinforcement Learning: A Surveycited by 84
  12. 2023A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AIcited by 68
  13. 2022Latent Diffusion Energy-Based Model for Interpretable Text Modelingcited by 67
  14. 2018Weakly-Convex Concave Min-Max Optimization: Provable Algorithms and Applications in Machine Learningcited by 62
  15. 2018Subgradient methods for sharp weakly convex functionscited by 33
  16. 2018First-order Convergence Theory for Weakly-Convex-Weakly-Concave Min-max Problemscited by 33
  17. 2019Quadratically Regularized Subgradient Methods for Weakly Convex Optimization with Weakly Convex Constraintscited by 25
  18. 2023Projected Langevin dynamics and a gradient flow for entropic optimal transportcited by 17
  19. 2021Learning with Gradient Descent and Weakly Convex Lossescited by 16
  20. 2023Quantitative contraction rates for Sinkhorn's algorithm: beyond bounded costs and compact marginalscited by 13
  21. 2021Polygonal Unadjusted Langevin Algorithms: Creating stable and efficient adaptive algorithms for neural networkscited by 11
  22. 2019Incremental Methods for Weakly Convex Optimizationcited by 7
  23. 2025The Performance Of The Unadjusted Langevin Algorithm Without Smoothness Assumptionscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 10.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Generalization Properties of Score-matching Diffusion Models for Intrinsically Low-dimensional Data
  2. 2026Intrinsic Wasserstein Rates for Score-Based Generative Models on Smooth Manifolds
  3. 2026Non-asymptotic Convergence of Stochastic Gradient Descent in Score-based Generative Models
  4. 2025Algorithm- and Data-Dependent Generalization Bounds for Diffusion Models
  5. 2023A Note on the Convergence of Denoising Diffusion Probabilistic Models
  6. 2024Global Well-posedness and Convergence Analysis of Score-based Generative Models via Sharp Lipschitz Estimates
  7. 2022Convergence of the Inexact Langevin Algorithm in KL Divergence with Application to Score-based Generative Models
  8. 2025From Score Matching to Diffusion: A Fine-Grained Error Analysis in the Gaussian Setting