mlsanityData to 14 Oct 2026

Measuring and Decomposing Mode Separation via the Canonical Diffusion

arXiv 2605.08777 ↗First posted 9 May 2026stat.ML cs.LG math.PRcited by 1

Not on the map. Why?

Abstract (arXiv)

Mode separation, namely how sharply a distribution fragments into barrier-separated clusters, is a fundamental geometric property of densities, difficult to quantify in high dimensions. It is structurally distinct from dispersion, yet existing tools fall short: differential entropy rises with spread regardless of fragmentation, PCA orders directions by variance regardless of barriers, and mutual information requires a mixture decomposition one usually does not have. We measure mode separation through a single stochastic process intrinsic to the density: a unique reversible diffusion with f as its stationary distribution and constant scalar diffusion coefficient. We extract two readouts from its autocovariance matrix: SSA (Sum of Squared Autocorrelations), a scalar barrier-sensitive measure; and DA (Dominant Autocorrelation directions), linear projections ordered by metastability rather than variance. Under an isotropic-Gaussian null, we derive a closed-form spectrum for the empirical autocovariance that generalizes Marchenko--Pastur, with an analytic upper edge that selects the lag at which DA is read off. Both readouts use only samples and a score function, scaling to high dimensions through pretrained score-based generative models via Tweedie's identity. We apply our framework to three settings: (i) synthetic Gaussian mixtures, where SSA tracks mutual information; (ii) SDXL text-to-image generations, where SSA and DA capture structure that entropy and PCA miss; and (iii) molecular dynamics of alanine dipeptide, where DA recovers the known slow backbone dihedrals from static samples alone.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 0 of its 34 references that are in the map. First posted on arXiv 9 May 2026.

Builds on

0 of 34 references.

No references here yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Random Matrix Theory Perspective on the Consistency of Diffusion Models
  2. 2024Dynamical Regimes of Diffusion Models
  3. 2026Diffusion Removes Langevin's Conditioning Dependence: A Sharp Gaussian Analysis
  4. 2026How Many Directions Must a Truncated Diffusion Sampler Retain? Matching Bounds Under Power-Law Spectra
  5. 2025Cross-fluctuation phase transitions reveal sampling dynamics in diffusion models
  6. 2023ρ-Diffusion: A diffusion-based density estimation framework for computational physics
  7. 2026When Diffusion Model Can Ignore Dimension: An Entropy-Based Theory
  8. 2025Analysis of Diffusion Models for Manifold Data