mlsanityData to 14 Oct 2026

From Score Learning to Discretized Sampling: An End-to-End Generalization Analysis of Diffusion Models

arXiv 2607.23226 ↗First posted 25 Jul 2026cs.LG math.ST stat.THcited by 2

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Despite the empirical success of score-based diffusion models, a complete theoretical understanding of how finite-sample learning, network parameterization, and numerical discretization jointly dictate generative quality remains underdeveloped. Existing sampling analyses often evaluate the generative performance conditional on an oracle score or a pre-specified error threshold. In this work, we establish a unified convergence and generalization framework for score-based diffusion models parameterized by practical ResNet-type architectures. We analyze the generalization and convergence properties from the practical finite-sample, discrete-time learning problem of the score function to the ideal continuous-time, population-level objective. Based on the generalization result of the learning problem of score function, we analyze the sampling process induced by the learned score function and provide an end-to-end total variation distance estimate for the generated terminal distribution. This estimate explicitly decomposes the overall generative error into four interpretable components: the truncation error of the forward process, the reverse-time discretization error, the generalization error incorporating both finite data and forward-time discretization, and the training optimization gap. Our results quantitatively characterize how the training sample size, temporal discretization grids, and optimization accuracy jointly control the final fidelity of samples generated by diffusion models.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 25 of its 42 references that are in the map. First posted on arXiv 25 Jul 2026.

Builds on

25 of 42 references.

Closest ancestors · 18

Same direction, newest first

  1. 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization11 Apr
  2. 2024Score-based Diffusion Models via Stochastic Differential Equations -- a Technical Tutorial12 Feb
  3. 2024Contractive Diffusion Probabilistic Models23 Jan
  4. 2023On the Generalization Properties of Diffusion Models3 Nov
  5. 2023Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Data14 Feb
  6. 2022Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptions3 Nov
  7. 2022Convergence of score-based generative modeling for general data distributions26 Sep
  8. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep
  9. 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep
  10. 2022Convergence of denoising diffusion models under the manifold hypothesis10 Aug
  11. 2022Convergence for score-based generative modeling with polynomial complexity13 Jun
  12. 2022Score-Based Generative Models Detect Manifolds2 Jun
6 more
  1. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  2. 2021Improved Denoising Diffusion Probabilistic Models18 Feb
  3. 2021Maximum Likelihood Training of Score-Based Diffusion Models22 Jan
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  5. 2020Denoising Diffusion Implicit Models6 Oct
  6. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 7

  1. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  3. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  4. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  5. 2020Generative Modeling with Denoising Auto-Encoders and Langevin Samplingcited by 119
  6. 2021Generalization Error Bounds for Iterative Recovery Algorithms Unfolded as Neural Networkscited by 11
  7. 2019Large Sample Mean-Field Stochastic Optimizationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2022How Much is Enough? A Study on Diffusion Times in Score-based Generative Models
  2. 2024Evaluating the design space of diffusion-based generative models
  3. 2026From Score Approximation to Distribution Approximation in Score-Based Diffusion Models
  4. 2026Where the Score Lives: A Wavelet View of Diffusion
  5. 2026A Stochastic Analysis Perspective on Diffusion Models
  6. 2025Algorithm- and Data-Dependent Generalization Bounds for Diffusion Models
  7. 2025From Score Matching to Diffusion: A Fine-Grained Error Analysis in the Gaussian Setting
  8. 2025Low-dimensional adaptation of diffusion models: Convergence in total variation