What is the textitintrinsic dimension of your binary data? -- and how to compute it quickly
Not on the map. Why?
Abstract (arXiv)
Dimensionality is an important aspect for analyzing and understanding (high-dimensional) data. In their 2006 ICDM paper Tatti et al. answered the question for a (interpretable) dimension of binary data tables by introducing a normalized correlation dimension. In the present work we revisit their results and contrast them with a concept based notion of intrinsic dimension (ID) recently introduced for geometric data sets. To do this, we present a novel approximation for this ID that is based on computing concepts only up to a certain support value. We demonstrate and evaluate our approximation using all available datasets from Tatti et al., which have between 469 and 41271 extrinsic dimensions.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 7 of its 27 references that are in the map. First posted on arXiv 9 Apr 2024.
Builds on
7 of 27 references.
References · 7
- 2018Intrinsic Dimension of Geometric Data Setscited by 7
- 2023Relative intrinsic dimensionality is intrinsic to learningcited by 6
- 2022Intrinsic Dimension for Large-Scale Geometric Learningcited by 4
- 2013From-Below Approximations in Boolean Matrix Factorization: Geometry and New Algorithmcited by 3
- 2019What is the dimension of your binary data?cited by 3
- 2019Distances between Data Sets Based on Summary Statisticscited by 2
- 2023Formal concept analysis for evaluating intrinsic dimension of a natural languagecited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.