mlsanityData to 14 Oct 2026

Diffusion Model for Manifold Data: Score Decomposition, Curvature, and Statistical Complexity

arXiv 2603.20645 ↗First posted 21 Mar 2026cs.LGcited by 7

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Diffusion models have become a leading framework in generative modeling, yet their theoretical understanding -- especially for high-dimensional data concentrated on low-dimensional structures -- remains incomplete. This paper investigates how diffusion models learn such structured data, focusing on two key aspects: statistical complexity and influence of data geometric properties. By modeling data as samples from a smooth Riemannian manifold, our analysis reveals crucial decompositions of score functions in diffusion models under different levels of injected noise. We also highlight the interplay of manifold curvature with the structures in the score function. These analyses enable an efficient neural network approximation to the score function, built upon which we further provide statistical rates for score estimation and distribution learning. Remarkably, the obtained statistical rates are governed by the intrinsic dimension of data and the manifold curvature. These results advance the statistical foundations of diffusion models, bridging theory and practice for generative modeling on manifolds.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 20 of its 76 references that are in the map. First posted on arXiv 21 Mar 2026.

Builds on

20 of 76 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026Generalization Properties of Score-matching Diffusion Models for Intrinsically Low-dimensional Data4 Mar
  2. 2025Diffusion Models and the Manifold Hypothesis: Log-Domain Smoothing is Geometry Adaptive2 Oct
  3. 2025When Scores Learn Geometry: Rate Separations under the Manifold Hypothesis29 Sep
  4. 2024Denoising diffusion probabilistic models are optimally adaptive to unknown low dimensionality24 Oct
  5. 2024Convergence of Diffusion Models Under the Manifold Hypothesis in High-Dimensions27 Sep
  6. 2024From optimal score matching to optimal sampling11 Sep
  7. 2024Score-based Diffusion Models via Stochastic Differential Equations -- a Technical Tutorial12 Feb
  8. 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localization7 Aug
  9. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep
  10. 2022Convergence of denoising diffusion models under the manifold hypothesis10 Aug
  11. 2021Soft Truncation: A Universal Training Technique of Score-based Diffusion Model for High Precision Score Estimation10 Jun

Other references · 9

  1. 2020Scaling Laws for Neural Language Modelscited by 6,586
  2. 2013Auto-Encoding Variational Bayescited by 4,053
  3. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  4. 2025Large Language Diffusion Modelscited by 912
  5. 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 745
  6. 2020Scaling Laws for Autoregressive Generative Modelingcited by 522
  7. 2020Generative Modeling with Denoising Auto-Encoders and Langevin Samplingcited by 119
  8. 2025Generalization error bound for denoising score matching under relaxed manifold assumptioncited by 20
  9. 2025Towards Understanding Text Hallucination of Diffusion Models via Local Generation Biascited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025What's Inside Your Diffusion Model? A Score-Based Riemannian Metric to Explore the Data Manifold
  2. 2025Improving the Euclidean Diffusion Generation of Manifold Data by Mitigating Score Function Singularity
  3. 2026Asymptotic Learning Curves for Diffusion Models with Random Features Score and Manifold Data
  4. 2024Manifolds, Random Matrices and Spectral Gaps: The geometric phases of generative diffusion
  5. 2025Be Tangential to Manifold: Discovering Riemannian Metric for Diffusion Models
  6. 2025MAD: Manifold Attracted Diffusion
  7. 2023Generative Modeling on Manifolds Through Mixture of Riemannian Diffusion Processes
  8. 2022Your diffusion model secretly knows the dimension of the data manifold