# The elbow statistic: Multiscale clustering statistical significance

arXiv: https://arxiv.org/abs/2603.03235 · HTML: https://mlsanity.com/paper/2603.03235/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 3 of its 37 references that are in the map.
- First posted on arXiv 3 Mar 2026.

## Builds on (most cited first, 3 of 3)

- [Clustering Algorithms: A Comparative Approach](https://mlsanity.com/paper/1612.08388/) (2016)
- [Statistical Significance for Hierarchical Clustering](https://mlsanity.com/paper/1411.5259/) (2014)
- [Local Minima Structures in Gaussian Mixture Models](https://mlsanity.com/paper/2009.13040/) (2020)

## Abstract (arXiv)

Selecting the number of clusters remains a fundamental challenge in unsupervised learning. Existing approaches typically focus on identifying a single "optimal" partition, often overlooking statistically meaningful structure present across multiple resolutions. We introduce ElbowSig, a general inferential framework for assessing clustering structure over a range of resolutions. The method formalizes the elbow heuristic by defining a normalized discrete curvature statistic based on the sequence of within-cluster heterogeneity values, and evaluates its significance relative to a null distribution of unstructured data. This yields hypothesis tests across resolutions, enabling simultaneous inference at multiple clustering scales. We derive the asymptotic behavior of the null statistic in both large-sample and high-dimensional regimes, characterizing its limiting form and variability. Because it depends only on the heterogeneity sequence, ElbowSig is compatible with a wide range of clustering algorithms, including hard, fuzzy, and model-based methods. Experiments on synthetic and real datasets show that the procedure controls Type-I error under unstructured data while providing power to detect multiscale organization, revealing structure that is often missed by single-resolution selection criteria.
