Structural and Convergence Analysis of Discrete-Time Denoising Diffusion Probabilistic Models
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
This paper studies the original discrete-time denoising diffusion probabilistic model (DDPM) from a probabilistic point of view. We present three main theoretical results. First, we show that the time-dependent score function associated with the forward diffusion process admits a characterization as the backward component of a forward--backward stochastic differential equation (FBSDE). This result provides a structural description of the score function and clarifies how score estimation errors propagate along the reverse-time dynamics. As a by-product, we also obtain a system of semilinear parabolic PDEs for the score function. Second, we use tools from Schr"odinger's problem to relate distributional errors arising in reverse time to corresponding errors in forward time. This approach allows us to control the reverse-time sampling error in a systematic way. Third, combining these results, we derive an explicit upper bound for the total variation distance between the sampling distribution of the discrete-time DDPM algorithm and the target data distribution under general finite noise schedules. The resulting bound separates the contributions of the learning error and the time discretization error. Our analysis highlights the intrinsic probabilistic structure underlying discrete-time DDPMs and provides a clearer understanding of the sources of error in their sampling procedure.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 37 of its 45 references that are in the map. First posted on arXiv 3 Jun 2024.
Builds on
37 of 45 references.
Closest ancestors · 18
Same direction, newest first
- 2024Adapting to Unknown Low-Dimensional Structures in Score-Based Diffusion Models23 May
- 2024An analysis of the noise schedule for score-based generative models7 Feb
- 2023A Note on the Convergence of Denoising Diffusion Probabilistic Models10 Dec
- 2023KL Convergence Guarantees for Score diffusion models under minimal data assumptions23 Aug
- 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localization7 Aug
- 2023Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models15 Jun
- 2022Convergence of score-based generative modeling for general data distributions26 Sep
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep
- 2022A Survey on Generative Diffusion Model6 Sep
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep
- 2022Convergence of denoising diffusion models under the manifold hypothesis10 Aug
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equations14 Jul
6 more
- 2022Convergence for score-based generative modeling with polynomial complexity13 Jun
- 2022Fast Sampling of Diffusion Models with Exponential Integrator29 Apr
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modeling1 Jun
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 19
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Video Diffusion Modelscited by 2,280
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
- 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 577
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
- 2021SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Modelscited by 415
- 2021Score-based diffusion models for accelerated MRIcited by 308
- 2013A survey of the Schr"odinger problem and some of its connections with optimal transportcited by 286
7 more
- 2021Crystal Diffusion Variational Autoencoder for Periodic Material Generationcited by 268
- 2022Diffusion Probabilistic Modeling for Video Generationcited by 237
- 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Modelscited by 195
- 2021Diff-TTS: A Denoising Diffusion Model for Text-to-Speechcited by 156
- 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
- 2021Score-Based Point Cloud Denoisingcited by 83
- 2022Towards performant and reliable undersampled MR reconstruction via diffusion model samplingcited by 59
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023Fast Diffusion Probabilistic Model Sampling through the lens of Backward Error Analysis
- 2026Connections between the F"ollmer process and the denoising diffusion probabilistic model
- 2023Using Ornstein-Uhlenbeck Process to understand Denoising Diffusion Probabilistic Model and its Noise Schedules
- 2024O(d/T) Convergence Theory for Diffusion Probabilistic Models under Minimal Assumptions
- 2024Non-asymptotic bounds for forward processes in denoising diffusions: Ornstein-Uhlenbeck is hard to beat
- 2025Assessing the Quality of Denoising Diffusion Models in Wasserstein Distance: Noisy Score and Optimal Bounds
- 2023Denoising Diffusion Samplers
- 2024Denoising Diffusion Probabilistic Models in Six Simple Steps