A Theory of Speciation in Generative Diffusion Models on Compact Riemannian Manifolds
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Speciation in generative diffusion models denotes the emergence of distinct stable branches during denoising, through which initially undifferentiated trajectories progressively commit to different data classes. In this work we develop an intrinsic theory of speciation for diffusion models supported on compact Riemannian manifolds: the aim is to go beyond existing theoretical descriptions, which usually identify speciation with a symmetric pitchfork bifurcation and assume to work in a large-dimensional space. We characterize speciation by bifurcations of the critical points of the evolving probability density. A spectral heat-kernel representation makes explicit the role of the manifold geometry, while Poincar'e-Hopf and Morse theory impose global constraints on the number and type of score equilibria and reveal topologically-imposed geometrical modes. For mixtures of heat kernels, we prove that generic speciation events have a one-dimensional critical kernel and admit an A2 fold normal form; pitchforks and simultaneous multidirectional transitions arise from nongeneric symmetric configurations. We derive geometry-dependent estimates of speciation times for bimodal mixtures and Riemannian regular simplices. We further establish structural stability of nondegenerate folds under score perturbations and show that the first-order time shift is determined solely by the component of the score error along the critical direction. The theory is illustrated on the sphere using mixtures of von Mises-Fisher distributions, where pitchfork and saddle-node bifurcations, topological modes, and hierarchical multiple speciations are observed. Finally, a chart-based intrinsic score-learning scheme based on neural networks contrasts the theoretically predicted transitions on prototypal and more complex datasets.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 23 of its 53 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
23 of 53 references.
Closest ancestors · 12
Same direction, newest first
- 2026How Out-of-Equilibrium Phase Transitions can Seed Pattern Formation in Trained Diffusion Models20 Mar
- 2025The Information Dynamics of Generative Diffusion27 Aug
- 2024Manifolds, Random Matrices and Spectral Gaps: The geometric phases of generative diffusion8 Oct
- 2024Dynamical Regimes of Diffusion Models28 Feb
- 2023Closing the ODE-SDE gap in score-based diffusion models through the Fokker-Planck equation27 Nov
- 2023The statistical thermodynamics of generative diffusion models: Phase transitions, symmetry breaking and critical instability26 Oct
- 2023Understanding the Latent Space of Diffusion Models through the Lens of Riemannian Geometry24 Jul
- 2023Spontaneous Symmetry Breaking in Generative Diffusion Models31 May
- 2022Riemannian Diffusion Models16 Aug
- 2022Riemannian Score-Based Generative Modelling6 Feb
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 11
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2021The Intrinsic Dimension of Images and Its Impact on Learningcited by 307
- 2021Pulling back information geometrycited by 23
- 2015Large-scale Log-determinant Computation through Stochastic Chebyshev Expansionscited by 17
- 2023Manifold Learning by Mixture Models of VAEs for Inverse Problemscited by 16
- 2024Counterfactual Explanations via Riemannian Latent Space Traversalcited by 9
- 2025Connecting Neural Models Latent Geometries with Relative Geodesic Representationscited by 4
- 2026PCAE: Learning Ordered Representations in Latent Space for Intrinsic Dimension Estimation via Principal Component Autoencodercited by 2
- 2014Riemannian simplices and triangulationscited by 1
- 2025Estimating Dataset Dimension via Singular Metrics under the Manifold Hypothesis: Application to Inverse Problemscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Analysis of Diffusion Models for Manifold Data
- 2023Diffusion Models for Constrained Domains
- 2023Generative Modeling on Manifolds Through Mixture of Riemannian Diffusion Processes
- 2026Theory of Speciation Transitions in Diffusion Models with General Class Structure
- 2026Steering Dynamical Regimes of Diffusion Models by Breaking Detailed Balance
- 2025Efficient Diffusion Models for Symmetric Manifolds
- 2026Diffusion Processes on Implicit Manifolds
- 2026Score Shocks: The Burgers Equation Structure of Diffusion Generative Models