Clustering consistency with Dirichlet process mixtures
Not on the map. Why?
Abstract (arXiv)
Dirichlet process mixtures are flexible non-parametric models, particularly suited to density estimation and probabilistic clustering. In this work we study the posterior distribution induced by Dirichlet process mixtures as the sample size increases, and more specifically focus on consistency for the unknown number of clusters when the observed data are generated from a finite mixture. Crucially, we consider the situation where a prior is placed on the concentration parameter of the underlying Dirichlet process. Previous findings in the literature suggest that Dirichlet process mixtures are typically not consistent for the number of clusters if the concentration parameter is held fixed and data come from a finite mixture. Here we show that consistency for the number of clusters can be achieved if the concentration parameter is adapted in a fully Bayesian way, as commonly done in practice. Our results are derived for data coming from a class of finite mixtures, with mild assumptions on the prior for the concentration parameter and for a variety of choices of likelihood kernels for the mixture.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 4 of its 28 references that are in the map. First posted on arXiv 25 May 2022.
Builds on
4 of 28 references.
References · 4
- 2015Mixture models with a prior on the number of componentscited by 20
- 2013Inconsistency of Pitman-Yor process mixtures for the number of componentscited by 7
- 2020Finite mixture models do not reliably learn the number of componentscited by 6
- 2019Posterior Distribution for the Number of Clusters in Dirichlet Process Mixture Modelscited by 2
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 0; 2025: 1; 2026: 2.
6 papers.
- 2022Bayesian nonparametric mixture inconsistency for the number of components: How worried should we be in practice?cited by 1
- 2023Fair Clustering via Hierarchical Fair-Dirichlet Processcited by 1
- 2026Scalable Posterior Uncertainty for Flexible Density-Based Clusteringcited by 1
- 2023Entropy regularization in probabilistic clusteringcited by 0
- 2025Spectral gap of Metropolis-within-Gibbs under log-concavitycited by 0
- 2026Nested Atoms Model with Application to Clustering Big Population-Scale Single-Cell Datacited by 0
- 2026Nested Atoms Model with Application to Clustering Big Population-Scale Single-Cell Data13 Apr 2026
- 2026Scalable Posterior Uncertainty for Flexible Density-Based Clustering3 Mar 2026
- 2025Spectral gap of Metropolis-within-Gibbs under log-concavity30 Sep 2025
- 2023Entropy regularization in probabilistic clustering19 Jul 2023
- 2023Fair Clustering via Hierarchical Fair-Dirichlet Process27 May 2023
- 2022Bayesian nonparametric mixture inconsistency for the number of components: How worried should we be in practice?29 Jul 2022