Wasserstein Convergence of Score-based Generative Models under Semiconvexity and Discontinuous Gradients
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Score-based Generative Models (SGMs) approximate a data distribution by perturbing it with Gaussian noise and subsequently denoising it via a learned reverse diffusion process. These models excel at modeling complex data distributions and generating diverse samples, achieving state-of-the-art performance across domains such as computer vision, audio generation, reinforcement learning, and computational biology. Despite their empirical success, existing Wasserstein-2 convergence analysis typically assume strong regularity conditions-such as smoothness or strict log-concavity of the data distribution-that are rarely satisfied in practice. In this work, we establish the first non-asymptotic Wasserstein-2 convergence guarantees for SGMs targeting semiconvex distributions with potentially discontinuous gradients. Our upper bounds are explicit and sharp in key parameters, achieving optimal dependence of O(√d) on the data dimension d and convergence rate of order one. The framework accommodates a wide class of practically relevant distributions, including symmetric modified half-normal distributions, Gaussian mixtures, double-well potentials, and elastic net potentials. By leveraging semiconvexity without requiring smoothness assumptions on the potential such as differentiability, our results substantially broaden the theoretical foundations of SGMs, bridging the gap between empirical success and rigorous guarantees in non-smooth, complex data regimes.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 63 of its 95 references that are in the map. First posted on arXiv 6 May 2025.
Builds on
63 of 95 references.
Closest ancestors · 28
Same direction, newest first
- 2025Advancing Wasserstein Convergence Analysis of Score-Based Models: Insights from Discretization and Second-Order Acceleration7 Feb
- 2025Low-dimensional adaptation of diffusion models: Convergence in total variation22 Jan
- 2025Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distance4 Jan
- 2024Wasserstein Bounds for generative diffusion models with Gaussian tail targets15 Dec
- 2024Provable Acceleration for Diffusion Models under Minimal Assumptions30 Oct
- 2024Score-based generative models are provably robust: an uncertainty quantification perspective24 May
- 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization11 Apr
- 2024An analysis of the noise schedule for score-based generative models7 Feb
- 2024Contractive Diffusion Probabilistic Models23 Jan
- 2023On diffusion-based generative models and their error bounds: The log-concave case with full convergence estimates22 Nov
- 2023Wasserstein Convergence Guarantees for a General Class of Score-Based Generative Models18 Nov
- 2023State of the Art on Diffusion Models for Visual Computing11 Oct
16 more
- 2023KL Convergence Guarantees for Score diffusion models under minimal data assumptions23 Aug
- 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localization7 Aug
- 2023Improved Convergence of Score-Based Diffusion Models via Prediction-Correction23 May
- 2023Diffusion Models are Minimax Optimal Distribution Estimators3 Mar
- 2023Universal Guidance for Diffusion Models14 Feb
- 2022Score-based Generative Modeling Secretly Minimizes the Wasserstein Distance13 Dec
- 2022Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptions3 Nov
- 2022Convergence of score-based generative modeling for general data distributions26 Sep
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep
- 2022Let us Build Bridges: Understanding and Extending Diffusion Generative Models31 Aug
- 2022Convergence of denoising diffusion models under the manifold hypothesis10 Aug
- 2022Convergence for score-based generative modeling with polynomial complexity13 Jun
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modeling1 Jun
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 35
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2022Human Motion Diffusion Modelcited by 1,062
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
- 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
- 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 577
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
23 more
- 2021Score-based diffusion models for accelerated MRIcited by 308
- 2023IDQL: Implicit Q-Learning as an Actor-Critic Method with Diffusion Policiescited by 307
- 2022Torsional Diffusion for Molecular Conformer Generationcited by 262
- 2023Imitating Human Behaviour with Diffusion Modelscited by 260
- 2023Goal-Conditioned Imitation Learning using Score-based Diffusion Policiescited by 229
- 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Modelscited by 195
- 2021Symbolic Music Generation with Diffusion Modelscited by 152
- 2020Generative Modeling with Denoising Auto-Encoders and Langevin Samplingcited by 118
- 2022Latent Diffusion for Language Generationcited by 110
- 2023Consistency Models as a Rich and Efficient Policy Class for Reinforcement Learningcited by 93
- 2023Diffusion Models for Reinforcement Learning: A Surveycited by 84
- 2023A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AIcited by 68
- 2022Latent Diffusion Energy-Based Model for Interpretable Text Modelingcited by 67
- 2018Weakly-Convex Concave Min-Max Optimization: Provable Algorithms and Applications in Machine Learningcited by 62
- 2018Subgradient methods for sharp weakly convex functionscited by 33
- 2018First-order Convergence Theory for Weakly-Convex-Weakly-Concave Min-max Problemscited by 33
- 2019Quadratically Regularized Subgradient Methods for Weakly Convex Optimization with Weakly Convex Constraintscited by 25
- 2023Projected Langevin dynamics and a gradient flow for entropic optimal transportcited by 17
- 2021Learning with Gradient Descent and Weakly Convex Lossescited by 16
- 2023Quantitative contraction rates for Sinkhorn's algorithm: beyond bounded costs and compact marginalscited by 13
- 2021Polygonal Unadjusted Langevin Algorithms: Creating stable and efficient adaptive algorithms for neural networkscited by 11
- 2019Incremental Methods for Weakly Convex Optimizationcited by 7
- 2025The Performance Of The Unadjusted Langevin Algorithm Without Smoothness Assumptionscited by 4
Built on by
Citing papers per year: 2025: 5; 2026: 10.
15 papers.
Sort:
By area:
- 2025Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distancecited by 20
- 2025Non-asymptotic error bounds for probability flow ODEs under weak log-concavitycited by 7
- 2026Lipschitz regularity in Flow Matching and Diffusion Models: sharp sampling rates and functional inequalitiescited by 6
- 2025Pathway to O(√d) Complexity bound under Wasserstein metric of flow-based modelscited by 4
- 2026On Forgetting and Stability of Score-based Generative modelscited by 3
- 2025A Malliavin-Gamma calculus approach to Score Based Diffusion Generative models for random fieldscited by 2
- 2026Wasserstein bounds for denoising diffusion probabilistic models via the F"ollmer processcited by 2
- 2026Load--Reserve Wasserstein Propagation for Isotropic Diffusion Samplerscited by 1
- 2026Score Approximation for Diffusion Models on Arbitrary Low-Dimensional Structurescited by 1
- 2026Score Accuracy Along the Forward Diffusion Does Not Certify Numerical Stability in Diffusion Samplingcited by 1
- 2025Flatness-Aware Stochastic Gradient Langevin Dynamicscited by 0
- 2026Finite Sample Bounds for Learning with Score Matchingcited by 0
- 2026Universal Local Error and Realized Amplification for the First-Order EDM Predictor7 Oct 2026
- 2026Score Accuracy Along the Forward Diffusion Does Not Certify Numerical Stability in Diffusion Sampling9 Jul 2026
- 2026Tightening the Score Matching Gap for Diffusion Models5 Jul 2026
- 2026Score Approximation for Diffusion Models on Arbitrary Low-Dimensional Structures18 Jun 2026
- 2026Diffusion Flow Matching: Dimension-Improved KL Bounds and Wasserstein Guarantees15 Jun 2026
- 2026Wasserstein bounds for denoising diffusion probabilistic models via the F"ollmer process18 May 2026
- 2026Finite Sample Bounds for Learning with Score Matching13 May 2026
- 2026Lipschitz regularity in Flow Matching and Diffusion Models: sharp sampling rates and functional inequalities7 Apr 2026
- 2026Load--Reserve Wasserstein Propagation for Isotropic Diffusion Samplers20 Mar 2026
- 2026On Forgetting and Stability of Score-based Generative models29 Jan 2026
- 2025Pathway to O(√d) Complexity bound under Wasserstein metric of flow-based models7 Dec 2025
- 2025Non-asymptotic error bounds for probability flow ODEs under weak log-concavity20 Oct 2025
3 more
- 2025Flatness-Aware Stochastic Gradient Langevin Dynamics2 Oct 2025
- 2025Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distance5 Aug 2025
- 2025A Malliavin-Gamma calculus approach to Score Based Diffusion Generative models for random fields19 May 2025
- 2025Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distancecited by 20
- 2025Non-asymptotic error bounds for probability flow ODEs under weak log-concavitycited by 7
- 2026Lipschitz regularity in Flow Matching and Diffusion Models: sharp sampling rates and functional inequalitiescited by 6
- 2026On Forgetting and Stability of Score-based Generative modelscited by 3
- 2025A Malliavin-Gamma calculus approach to Score Based Diffusion Generative models for random fieldscited by 2
- 2026Wasserstein bounds for denoising diffusion probabilistic models via the F"ollmer processcited by 2
- 2026Load--Reserve Wasserstein Propagation for Isotropic Diffusion Samplerscited by 1
- 2026Score Approximation for Diffusion Models on Arbitrary Low-Dimensional Structurescited by 1
- 2026Score Accuracy Along the Forward Diffusion Does Not Certify Numerical Stability in Diffusion Samplingcited by 1
- 2026Diffusion Flow Matching: Dimension-Improved KL Bounds and Wasserstein Guaranteescited by 0
- 2026Tightening the Score Matching Gap for Diffusion Modelscited by 0
- 2026Universal Local Error and Realized Amplification for the First-Order EDM Predictorcited by 0
- 2026Universal Local Error and Realized Amplification for the First-Order EDM Predictor7 Oct 2026
- 2026Score Accuracy Along the Forward Diffusion Does Not Certify Numerical Stability in Diffusion Sampling9 Jul 2026
- 2026Tightening the Score Matching Gap for Diffusion Models5 Jul 2026
- 2026Score Approximation for Diffusion Models on Arbitrary Low-Dimensional Structures18 Jun 2026
- 2026Diffusion Flow Matching: Dimension-Improved KL Bounds and Wasserstein Guarantees15 Jun 2026
- 2026Wasserstein bounds for denoising diffusion probabilistic models via the F"ollmer process18 May 2026
- 2026Lipschitz regularity in Flow Matching and Diffusion Models: sharp sampling rates and functional inequalities7 Apr 2026
- 2026Load--Reserve Wasserstein Propagation for Isotropic Diffusion Samplers20 Mar 2026
- 2026On Forgetting and Stability of Score-based Generative models29 Jan 2026
- 2025Non-asymptotic error bounds for probability flow ODEs under weak log-concavity20 Oct 2025
- 2025Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distance5 Aug 2025
- 2025A Malliavin-Gamma calculus approach to Score Based Diffusion Generative models for random fields19 May 2025
Similar, not cited
Close in wording, no citation either way
- 2026Generalization Properties of Score-matching Diffusion Models for Intrinsically Low-dimensional Data
- 2026Intrinsic Wasserstein Rates for Score-Based Generative Models on Smooth Manifolds
- 2026Non-asymptotic Convergence of Stochastic Gradient Descent in Score-based Generative Models
- 2025Algorithm- and Data-Dependent Generalization Bounds for Diffusion Models
- 2023A Note on the Convergence of Denoising Diffusion Probabilistic Models
- 2024Global Well-posedness and Convergence Analysis of Score-based Generative Models via Sharp Lipschitz Estimates
- 2022Convergence of the Inexact Langevin Algorithm in KL Divergence with Application to Score-based Generative Models
- 2025From Score Matching to Diffusion: A Fine-Grained Error Analysis in the Gaussian Setting