# Mixture models with a prior on the number of components

arXiv: https://arxiv.org/abs/1502.06241 · HTML: https://mlsanity.com/paper/1502.06241/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 22 Feb 2015.

## Built on by (most cited first, 20 of 20)

- [A Survey of Community Detection Approaches: From Statistical Modeling to Deep Learning](https://mlsanity.com/paper/2101.01669/) (2021)
- [Adaptive variational Bayes: Optimality, computation and applications](https://mlsanity.com/paper/2109.03204/) (2021)
- [Many processors, little time: MCMC for partitions via optimal transport couplings](https://mlsanity.com/paper/2202.11258/) (2022)
- [Clustering consistency with Dirichlet process mixtures](https://mlsanity.com/paper/2205.12924/) (2022)
- [Strong identifiability and parameter learning in regression with heterogeneous response](https://mlsanity.com/paper/2212.04091/) (2022)
- [Spatiotemporal Clustering with Neyman-Scott Processes via Connections to Bayesian Nonparametric Mixture Models](https://mlsanity.com/paper/2201.05044/) (2022)
- [Amortized Bayesian Mixture Models](https://mlsanity.com/paper/2501.10229/) (2025)
- [Why the Rich Get Richer? On the Balancedness of Random Partition Models](https://mlsanity.com/paper/2201.12697/) (2022)
- [Fast sampling and model selection for Bayesian mixture models](https://mlsanity.com/paper/2501.07668/) (2025)
- [Bayesian nonparametric mixture inconsistency for the number of components: How worried should we be in practice?](https://mlsanity.com/paper/2207.14717/) (2022)
- [VICatMix: variational Bayesian clustering and variable selection for discrete biomedical data](https://mlsanity.com/paper/2406.16227/) (2024)
- [Neural Representations Reveal Distinct Modes of Class Fitting in Residual Convolutional Networks](https://mlsanity.com/paper/2212.00771/) (2022)
- [Bayesian outcome-guided multi-view mixture models with applications in molecular precision medicine](https://mlsanity.com/paper/2303.00318/) (2023)
- [Entropy regularization in probabilistic clustering](https://mlsanity.com/paper/2307.10065/) (2023)
- [Modeling Random Networks with Heterogeneous Reciprocity](https://mlsanity.com/paper/2308.10113/) (2023)
- [A Bayesian Methodology for Estimation for Sparse Canonical Correlation](https://mlsanity.com/paper/2310.19621/) (2023)
- [Mixture models for data with unknown distributions](https://mlsanity.com/paper/2502.19605/) (2025)
- [Fair Bayesian Model-Based Clustering](https://mlsanity.com/paper/2506.12839/) (2025)
- [Fair Model-based Clustering](https://mlsanity.com/paper/2602.21509/) (2026)
- [DP-Splat: Bayesian Nonparametric Complexity Control for Gaussian Splatting](https://mlsanity.com/paper/2607.10912/) (2026)

## Abstract (arXiv)

A natural Bayesian approach for mixture models with an unknown number of components is to take the usual finite mixture model with Dirichlet weights, and put a prior on the number of components---that is, to use a mixture of finite mixtures (MFM). While inference in MFMs can be done with methods such as reversible jump Markov chain Monte Carlo, it is much more common to use Dirichlet process mixture (DPM) models because of the relative ease and generality with which DPM samplers can be applied. In this paper, we show that, in fact, many of the attractive mathematical properties of DPMs are also exhibited by MFMs---a simple exchangeable partition distribution, restaurant process, random measure representation, and in certain cases, a stick-breaking representation. Consequently, the powerful methods developed for inference in DPMs can be directly applied to MFMs as well. We illustrate with simulated and real data, including high-dimensional gene expression data.
