mlsanityData to 7 Oct 2026

What is the textitintrinsic dimension of your binary data? -- and how to compute it quickly

arXiv 2404.06326 ↗First posted 9 Apr 2024cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Dimensionality is an important aspect for analyzing and understanding (high-dimensional) data. In their 2006 ICDM paper Tatti et al. answered the question for a (interpretable) dimension of binary data tables by introducing a normalized correlation dimension. In the present work we revisit their results and contrast them with a concept based notion of intrinsic dimension (ID) recently introduced for geometric data sets. To do this, we present a novel approximation for this ID that is based on computing concepts only up to a certain support value. We demonstrate and evaluate our approximation using all available datasets from Tatti et al., which have between 469 and 41271 extrinsic dimensions.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 7 of its 27 references that are in the map. First posted on arXiv 9 Apr 2024.

Builds on

7 of 27 references.

References · 7

  1. 2018Intrinsic Dimension of Geometric Data Setscited by 7
  2. 2023Relative intrinsic dimensionality is intrinsic to learningcited by 6
  3. 2022Intrinsic Dimension for Large-Scale Geometric Learningcited by 4
  4. 2013From-Below Approximations in Boolean Matrix Factorization: Geometry and New Algorithmcited by 3
  5. 2019What is the dimension of your binary data?cited by 3
  6. 2019Distances between Data Sets Based on Summary Statisticscited by 2
  7. 2023Formal concept analysis for evaluating intrinsic dimension of a natural languagecited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.