Measuring and Decomposing Mode Separation via the Canonical Diffusion
Not on the map. Why?
Abstract (arXiv)
Mode separation, namely how sharply a distribution fragments into barrier-separated clusters, is a fundamental geometric property of densities, difficult to quantify in high dimensions. It is structurally distinct from dispersion, yet existing tools fall short: differential entropy rises with spread regardless of fragmentation, PCA orders directions by variance regardless of barriers, and mutual information requires a mixture decomposition one usually does not have. We measure mode separation through a single stochastic process intrinsic to the density: a unique reversible diffusion with f as its stationary distribution and constant scalar diffusion coefficient. We extract two readouts from its autocovariance matrix: SSA (Sum of Squared Autocorrelations), a scalar barrier-sensitive measure; and DA (Dominant Autocorrelation directions), linear projections ordered by metastability rather than variance. Under an isotropic-Gaussian null, we derive a closed-form spectrum for the empirical autocovariance that generalizes Marchenko--Pastur, with an analytic upper edge that selects the lag at which DA is read off. Both readouts use only samples and a score function, scaling to high dimensions through pretrained score-based generative models via Tweedie's identity. We apply our framework to three settings: (i) synthetic Gaussian mixtures, where SSA tracks mutual information; (ii) SDXL text-to-image generations, where SSA and DA capture structure that entropy and PCA miss; and (iii) molecular dynamics of alanine dipeptide, where DA recovers the known slow backbone dihedrals from static samples alone.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 0 of its 34 references that are in the map. First posted on arXiv 9 May 2026.
Builds on
0 of 34 references.
No references here yet.
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026MCMC Can See Can't Seecited by 0
- 2026MCMC Can See Can't See14 Oct 2026
Similar, not cited
Close in wording, no citation either way
- 2026A Random Matrix Theory Perspective on the Consistency of Diffusion Models
- 2024Dynamical Regimes of Diffusion Models
- 2026Diffusion Removes Langevin's Conditioning Dependence: A Sharp Gaussian Analysis
- 2026How Many Directions Must a Truncated Diffusion Sampler Retain? Matching Bounds Under Power-Law Spectra
- 2025Cross-fluctuation phase transitions reveal sampling dynamics in diffusion models
- 2023ρ-Diffusion: A diffusion-based density estimation framework for computational physics
- 2026When Diffusion Model Can Ignore Dimension: An Entropy-Based Theory
- 2025Analysis of Diffusion Models for Manifold Data