mlsanityData to 14 Oct 2026

A Survey and Comparative Evaluation of Intrinsic Dimension Estimators under the Manifold Hypothesis

arXiv 2509.15517 ↗First posted 19 Sep 2025cs.LG stat.APcited by 0

Not on the map. Why?

Abstract (arXiv)

The manifold hypothesis suggests that high-dimensional data often lie on or near a low-dimensional manifold. Estimating the dimension of this manifold is essential for leveraging its structure, yet existing work on dimension estimation is fragmented and lacks systematic evaluation. This article provides a comprehensive survey for both researchers and practitioners. We review often-overlooked theoretical foundations and present eight representative estimators. Through controlled experiments, we analyze how individual factors, such as noise, curvature, and sample size, affect performance. We also compare the estimators on diverse synthetic and real-world datasets, introducing a principled approach to dataset-specific hyperparameter tuning. Our results offer practical guidance for estimator selection and yield insights that will inform future estimator design.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 70 references that are in the map. First posted on arXiv 19 Sep 2025.

Builds on

15 of 70 references.

References · 15

  1. 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 671
  2. 2018Estimating the intrinsic dimension of datasets by a minimal neighborhood informationcited by 250
  3. 2021Scikit-dimension: a Python package for intrinsic dimension estimationcited by 68
  4. 2023Manifold learning: what, how, and whycited by 68
  5. 2021Data-driven discovery of intrinsic dynamicscited by 45
  6. 2022Intrinsic Dimensionality Estimation within Tight Localities: A Theoretical and Experimental Analysiscited by 22
  7. 2021Intrinsic Dimension Estimation Using Wasserstein Distancescited by 20
  8. 2023Manifold Learning by Mixture Models of VAEs for Inverse Problemscited by 17
  9. 2019Geometry-Aware Maximum Likelihood Estimation of Intrinsic Dimensioncited by 15
  10. 2025A Survey of Dimension Estimation Methodscited by 12
  11. 2016Minimax Rates for Estimating the Dimension of a Manifoldcited by 10
  12. 2021Tangent Space and Dimension Estimation with the Wasserstein Distancecited by 10
3 more
  1. 2020Rdimtools: An R package for Dimension Reduction and Intrinsic Dimension Estimationcited by 5
  2. 2023CA-PCA: Manifold Dimension Estimation, Adapted for Curvaturecited by 4
  3. 2020Intrinsic Dimension Estimation via Nearest Constrained Subspace Classifiercited by 1

Built on by

Not cited yet.