# Adjusting for Chance Clustering Comparison Measures

arXiv: https://arxiv.org/abs/1512.01286 · HTML: https://mlsanity.com/paper/1512.01286/

## Key facts

- Cited by 27 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Dec 2015.

## Built on by (most cited first, 27 of 27)

- [Semi-relaxed Gromov-Wasserstein divergence with applications on graphs](https://mlsanity.com/paper/2110.02753/) (2021)
- [Boosting Object Representation Learning via Motion and Object Continuity](https://mlsanity.com/paper/2211.09771/) (2022)
- [Characterizing and comparing external measures for the assessment of cluster analysis and community detection](https://mlsanity.com/paper/2102.00708/) (2021)
- [Tensor-based Multi-view Spectral Clustering via Shared Latent Space](https://mlsanity.com/paper/2207.11559/) (2022)
- [An Empirical Study into Clustering of Unseen Datasets with Self-Supervised Encoders](https://mlsanity.com/paper/2406.02465/) (2024)
- [Pairwise Adjusted Mutual Information](https://mlsanity.com/paper/2103.12641/) (2021)
- [AuToMATo: An Out-Of-The-Box Persistence-Based Clustering Algorithm](https://mlsanity.com/paper/2408.06958/) (2024)
- [Cluster Analysis of Malware Family Relationships](https://mlsanity.com/paper/2103.05761/) (2021)
- [LiMIIRL: Lightweight Multiple-Intent Inverse Reinforcement Learning](https://mlsanity.com/paper/2106.01777/) (2021)
- [SOMTimeS: Self Organizing Maps for Time Series Clustering and its Application to Serious Illness Conversations](https://mlsanity.com/paper/2108.11523/) (2021)
- [Multivariate Beta Mixture Model: Probabilistic Clustering With Flexible Cluster Shapes](https://mlsanity.com/paper/2401.16708/) (2024)
- [FastAMI -- a Monte Carlo Approach to the Adjustment for Chance in Clustering Comparison Metrics](https://mlsanity.com/paper/2305.03022/) (2023)
- [Toward Efficient and Incremental Spectral Clustering via Parametric Spectral Clustering](https://mlsanity.com/paper/2311.07833/) (2023)
- [Enhanced Spatial Clustering of Single-Molecule Localizations with Graph Neural Networks](https://mlsanity.com/paper/2412.00173/) (2024)
- [The Hyperspherical Geometry of Community Detection: Modularity as a Distance](https://mlsanity.com/paper/2107.02645/) (2021)
- [Dictionary learning for clustering on hyperspectral images](https://mlsanity.com/paper/2202.00990/) (2022)
- [Impact of Event Encoding and Dissimilarity Measures on Traffic Crash Characterization Based on Sequence of Events](https://mlsanity.com/paper/2302.11077/) (2023)
- [2D Floor Plan Segmentation Based on Down-sampling](https://mlsanity.com/paper/2303.13798/) (2023)
- [Disentangled Latent Spaces Facilitate Data-Driven Auxiliary Learning](https://mlsanity.com/paper/2310.09278/) (2023)
- [Making Multi-Axis Gaussian Graphical Models Scalable to Millions of Cells](https://mlsanity.com/paper/2407.19892/) (2024)
- [Automatic Die Studies for Ancient Numismatics](https://mlsanity.com/paper/2407.20876/) (2024)
- [Multimodal Structure Preservation Learning](https://mlsanity.com/paper/2410.22520/) (2024)
- [Flexible Bivariate Beta Mixture Model: A Probabilistic Approach for Clustering Complex Data Structures](https://mlsanity.com/paper/2502.19938/) (2025)
- [Unifying Information-Theoretic and Pair-Counting Clustering Similarity](https://mlsanity.com/paper/2511.03000/) (2025)
- [Adjusted Similarity Measures and a Violation of Expectations](https://mlsanity.com/paper/2601.10641/) (2026)
- [MultiST: A Cross-Attention-Based Multimodal Model for Spatial Transcriptomic](https://mlsanity.com/paper/2601.13331/) (2026)
- [Bridging Maximum Likelihood and Optimal Transport for Efficient Inference and Model Selection in Stochastic Block Models](https://mlsanity.com/paper/2605.28488/) (2026)

## Abstract (arXiv)

Adjusted for chance measures are widely used to compare partitions/clusterings of the same data set. In particular, the Adjusted Rand Index (ARI) based on pair-counting, and the Adjusted Mutual Information (AMI) based on Shannon information theory are very popular in the clustering community. Nonetheless it is an open problem as to what are the best application scenarios for each measure and guidelines in the literature for their usage are sparse, with the result that users often resort to using both. Generalized Information Theoretic (IT) measures based on the Tsallis entropy have been shown to link pair-counting and Shannon IT measures. In this paper, we aim to bridge the gap between adjustment of measures based on pair-counting and measures based on information theory. We solve the key technical challenge of analytically computing the expected value and variance of generalized IT measures. This allows us to propose adjustments of generalized IT measures, which reduce to well known adjusted clustering comparison measures as special cases. Using the theory of generalized IT measures, we are able to propose the following guidelines for using ARI and AMI as external validation indices: ARI should be used when the reference clustering has large equal sized clusters; AMI should be used when the reference clustering is unbalanced and there exist small clusters.