# Escaping the curse of dimensionality in Bayesian model based clustering

arXiv: https://arxiv.org/abs/2006.02700 · HTML: https://mlsanity.com/paper/2006.02700/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 4 Jun 2020.

## Built on by (most cited first, 12 of 12)

- [Bayesian Joint Additive Factor Models for Multiview Learning](https://mlsanity.com/paper/2406.00778/) (2024)
- [Autoregressive Adaptive Hypergraph Transformer for Skeleton-based Activity Recognition](https://mlsanity.com/paper/2411.05692/) (2024)
- [Summarizing Bayesian Nonparametric Mixture Posterior -- Sliced Optimal Transport Metrics for Gaussian Mixtures](https://mlsanity.com/paper/2411.14674/) (2024)
- [Bayesian Transfer Learning](https://mlsanity.com/paper/2312.13484/) (2023)
- [Bayesian nonparametric mixture inconsistency for the number of components: How worried should we be in practice?](https://mlsanity.com/paper/2207.14717/) (2022)
- [Negative-Binomial Randomized Gamma Markov Processes for Heterogeneous Overdispersed Count Time Series](https://mlsanity.com/paper/2402.18995/) (2024)
- [Scalable Posterior Uncertainty for Flexible Density-Based Clustering](https://mlsanity.com/paper/2603.03188/) (2026)
- [Vertical Consensus Inference for High-Dimensional Random Partition](https://mlsanity.com/paper/2603.27864/) (2026)
- [The Relevance Feature and Vector Machine for health applications](https://mlsanity.com/paper/2402.07079/) (2024)
- [Normalizing Flow to Augmented Posterior: Conditional Density Estimation with Interpretable Dimension Reduction for High Dimensional Data](https://mlsanity.com/paper/2507.04216/) (2025)
- [Syntax-Guided Diffusion Language Models with User-Integrated Personalization](https://mlsanity.com/paper/2510.01028/) (2025)
- [A fast non-reversible sampler for Bayesian mixture models](https://mlsanity.com/paper/2510.03226/) (2025)

## Abstract (arXiv)

Bayesian mixture models are widely used for clustering of high-dimensional data with appropriate uncertainty quantification. However, as the dimension of the observations increases, posterior inference often tends to favor too many or too few clusters. This article explains this behavior by studying the random partition posterior in a non-standard setting with a fixed sample size and increasing data dimensionality. We provide conditions under which the finite sample posterior tends to either assign every observation to a different cluster or all observations to the same cluster as the dimension grows. Interestingly, the conditions do not depend on the choice of clustering prior, as long as all possible partitions of observations into clusters have positive prior probabilities, and hold irrespective of the true data-generating model. We then propose a class of latent mixtures for Bayesian clustering (Lamb) on a set of low-dimensional latent variables inducing a partition on the observed data. The model is amenable to scalable posterior inference and we show that it can avoid the pitfalls of high-dimensionality under mild assumptions. The proposed approach is shown to have good performance in simulation studies and an application to inferring cell types based on scRNAseq.