Diffusion Model for Manifold Data: Score Decomposition, Curvature, and Statistical Complexity
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion models have become a leading framework in generative modeling, yet their theoretical understanding -- especially for high-dimensional data concentrated on low-dimensional structures -- remains incomplete. This paper investigates how diffusion models learn such structured data, focusing on two key aspects: statistical complexity and influence of data geometric properties. By modeling data as samples from a smooth Riemannian manifold, our analysis reveals crucial decompositions of score functions in diffusion models under different levels of injected noise. We also highlight the interplay of manifold curvature with the structures in the score function. These analyses enable an efficient neural network approximation to the score function, built upon which we further provide statistical rates for score estimation and distribution learning. Remarkably, the obtained statistical rates are governed by the intrinsic dimension of data and the manifold curvature. These results advance the statistical foundations of diffusion models, bridging theory and practice for generative modeling on manifolds.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 20 of its 76 references that are in the map. First posted on arXiv 21 Mar 2026.
Builds on
20 of 76 references.
Closest ancestors · 11
Same direction, newest first
- 2026Generalization Properties of Score-matching Diffusion Models for Intrinsically Low-dimensional Data4 Mar
- 2025Diffusion Models and the Manifold Hypothesis: Log-Domain Smoothing is Geometry Adaptive2 Oct
- 2025When Scores Learn Geometry: Rate Separations under the Manifold Hypothesis29 Sep
- 2024Denoising diffusion probabilistic models are optimally adaptive to unknown low dimensionality24 Oct
- 2024Convergence of Diffusion Models Under the Manifold Hypothesis in High-Dimensions27 Sep
- 2024From optimal score matching to optimal sampling11 Sep
- 2024Score-based Diffusion Models via Stochastic Differential Equations -- a Technical Tutorial12 Feb
- 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localization7 Aug
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep
- 2022Convergence of denoising diffusion models under the manifold hypothesis10 Aug
- 2021Soft Truncation: A Universal Training Technique of Score-based Diffusion Model for High Precision Score Estimation10 Jun
Other references · 9
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
- 2025Large Language Diffusion Modelscited by 912
- 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 745
- 2020Scaling Laws for Autoregressive Generative Modelingcited by 522
- 2020Generative Modeling with Denoising Auto-Encoders and Langevin Samplingcited by 119
- 2025Generalization error bound for denoising score matching under relaxed manifold assumptioncited by 20
- 2025Towards Understanding Text Hallucination of Diffusion Models via Local Generation Biascited by 11
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Intrinsic Wasserstein Rates for Score-Based Generative Models on Smooth Manifoldscited by 2
- 2026Diffusion Models for Adaptive Sequential Data Generationcited by 1
- 2026Optimal score function estimation via derivatives constraintscited by 1
- 2026Recovering Weighted Tangent Geometry from a Single-Scale Score Fieldcited by 1
- 2026Matched Queries for Curvature and Density at Branching Junctionscited by 0
- 2026FLARE: Flow Matching with Local Axis-Angle Representations for Stochastic Micromagnetic Evolutioncited by 0
- 2026Geometry-Aware Preference Optimization for Text-to-Image Diffusion Modelscited by 0
- 2026Geometry-Aware Preference Optimization for Text-to-Image Diffusion Models4 Oct 2026
- 2026FLARE: Flow Matching with Local Axis-Angle Representations for Stochastic Micromagnetic Evolution28 Sep 2026
- 2026Matched Queries for Curvature and Density at Branching Junctions1 Sep 2026
- 2026Recovering Weighted Tangent Geometry from a Single-Scale Score Field23 Aug 2026
- 2026Optimal score function estimation via derivatives constraints17 Jun 2026
- 2026Diffusion Models for Adaptive Sequential Data Generation4 Jun 2026
- 2026Intrinsic Wasserstein Rates for Score-Based Generative Models on Smooth Manifolds15 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025What's Inside Your Diffusion Model? A Score-Based Riemannian Metric to Explore the Data Manifold
- 2025Improving the Euclidean Diffusion Generation of Manifold Data by Mitigating Score Function Singularity
- 2026Asymptotic Learning Curves for Diffusion Models with Random Features Score and Manifold Data
- 2024Manifolds, Random Matrices and Spectral Gaps: The geometric phases of generative diffusion
- 2025Be Tangential to Manifold: Discovering Riemannian Metric for Diffusion Models
- 2025MAD: Manifold Attracted Diffusion
- 2023Generative Modeling on Manifolds Through Mixture of Riemannian Diffusion Processes
- 2022Your diffusion model secretly knows the dimension of the data manifold