mlsanityData to 7 Oct 2026

Minimax Lower Bound for Estimating Diffusion-based Local Intrinsic Dimension

arXiv 2609.04822 ↗First posted 4 Sep 2026stat.ML cs.LG math.STcited by 0

Not on the map. Why?

Abstract (arXiv)

While diffusion-based methods have recently emerged as effective tools for probing the intrinsic geometry of high-dimensional data, their statistical difficulty remains largely unexplored. We study estimation of the finite-scale population functional underlying FLIPD (Kamkari et al., 2024; arXiv:2406.03537), a diffusion-based local intrinsic dimension (LID) quantity defined through the logarithmic scale derivative of a Gaussian-smoothed density. Intuitively, Gaussian smoothing turns local dimension into a scale law: near a d-dimensional manifold, the kernel mass grows like σd, so differentiating with respect to the noise scale reveals the intrinsic exponent. Under a regular manifold model, we show uniformly over the model class that the finite-scale field differs from the manifold dimension d by at most O(σ2). We then establish a minimax lower bound of order (nσd)-1 for estimating this finite-scale field from n observations, for n-1/(2α+d)lesssimσ≤σ0. At the smallest scale covered by our lower-bound construction, the bound becomes the nonparametric rate n-2α/(2α+d).

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 19 references that are in the map. First posted on arXiv 4 Sep 2026.

Builds on

8 of 19 references.

References · 8

  1. 2018Characterizing Adversarial Subspaces Using Local Intrinsic Dimensionalitycited by 280
  2. 2019Intrinsic dimension of data representations in deep neural networkscited by 276
  3. 2018Estimating the intrinsic dimension of datasets by a minimal neighborhood informationcited by 246
  4. 2024A Geometric View of Data Complexity: Efficient Local Intrinsic Dimension Estimation with Diffusion Modelscited by 41
  5. 2022LIDL: Local Intrinsic Dimension Estimation Using Approximate Likelihoodcited by 30
  6. 2016Minimax Rates for Estimating the Dimension of a Manifoldcited by 10
  7. 2026A Deep Generative Approach to Stratified Learningcited by 1
  8. 2026Local Hessian Spectral Filtering for Robust Intrinsic Dimension Estimationcited by 1

Built on by

Not cited yet.