# Model-based clustering of categorical data based on the Hamming distance

arXiv: https://arxiv.org/abs/2212.04746 · HTML: https://mlsanity.com/paper/2212.04746/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 9 Dec 2022.

## Built on by (most cited first, 1 of 1)

- [Bayesian Model Averaging under Predictor Redundancy via Density-Ratio Posterior Compression](https://mlsanity.com/paper/2606.21080/) (2026)

## Abstract (arXiv)

A model-based approach is developed for clustering categorical data with no natural ordering. The proposed method exploits the Hamming distance to define a family of probability mass functions to model the data. The elements of this family are then considered as kernels of a finite mixture model with an unknown number of components. Conjugate Bayesian inference has been derived for the parameters of the Hamming distribution model. The mixture is framed in a Bayesian nonparametric setting, and a transdimensional blocked Gibbs sampler is developed to provide full Bayesian inference on the number of clusters, their structure, and the group-specific parameters, facilitating the computation with respect to customary reversible jump algorithms. The proposed model encompasses a parsimonious latent class model as a special case when the number of components is fixed. Model performances are assessed via a simulation study and reference datasets, showing improvements in clustering recovery over existing approaches.
