mlsanityData to 7 Oct 2026

Score Accuracy Along the Forward Diffusion Does Not Certify Numerical Stability in Diffusion Sampling

arXiv 2607.08757 ↗First posted 9 Jul 2026stat.ML cs.LG cs.NAcited by 1

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Score matching controls average error under the forward marginals, but a discretized reverse-time sampler evaluates the learned score along its own trajectory. We show that small forward-marginal error does not guarantee numerical stability. We construct a single smooth score field with arbitrarily small forward-marginal L2 error. The learned reverse-time process is nonexplosive, has moments of every order, and can be arbitrarily close to the exact reverse-time process in path-space total variation. Yet its Euler--Maruyama discretizations converge in probability while every positive moment diverges. Thus weak convergence can hold even though every Wasserstein distance Wp, p≥1, diverges. The same failure can occur within one fixed finite neural architecture. We construct a family of bounded, globally Lipschitz denoisers for which both the forward-marginal error and the path-space total variation distance tend to zero, while their Euler--Maruyama endpoints diverge in every Wp. For compactly supported data, we also give a simple positive result. Projecting the learned denoiser onto a known bounded closed convex set containing the support preserves pointwise accuracy, gives grid-uniform moment bounds, and yields Wasserstein convergence under mild local regularity. Experiments with a small fixed DiT-style network show large growth along rare numerical trajectories and its suppression by denoiser projection, while overall trajectory errors remain small.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 13 of its 15 references that are in the map. First posted on arXiv 9 Jul 2026.

Builds on

13 of 15 references.

Closest ancestors · 12

Same direction, newest first

  1. 2026Diffusion Models Observe Only Gradients: A Geometric Perspective on Score Matching Errors4 Jun
  2. 2026On the Robustness of Langevin Dynamics to Score Function Error11 Mar
  3. 2025Wasserstein Convergence of Score-based Generative Models under Semiconvexity and Discontinuous Gradients6 May
  4. 2024Contractive Diffusion Probabilistic Models23 Jan
  5. 2023Wasserstein Convergence Guarantees for a General Class of Score-Based Generative Models18 Nov
  6. 2023KL Convergence Guarantees for Score diffusion models under minimal data assumptions23 Aug
  7. 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localization7 Aug
  8. 2023Reflected Diffusion Models10 Apr
  9. 2022Scalable Diffusion Models with Transformers19 Dec
  10. 2022Convergence of score-based generative modeling for general data distributions26 Sep
  11. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep
  12. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov

Other references · 1

  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2023Stable Target Field for Reduced Variance Score Estimation in Diffusion Models
  2. 2023Denoising Diffusion Samplers
  3. 2025Kernel-Smoothed Scores for Denoising Diffusion: A Bias-Variance Study
  4. 2025Implicit Regularisation in Diffusion Models: An Algorithm-Dependent Generalisation Analysis
  5. 2025Low-dimensional adaptation of diffusion models: Convergence in total variation
  6. 2024O(d/T) Convergence Theory for Diffusion Probabilistic Models under Minimal Assumptions
  7. 2026Variance-Reduced Diffusion Sampling via Target Score Identity
  8. 2023Consistent Diffusion Models: Mitigating Sampling Drift by Learning to be Consistent