Inconsistency of Pitman-Yor process mixtures for the number of components
Not on the map. Why?
Abstract (arXiv)
In many applications, a finite mixture is a natural model, but it can be difficult to choose an appropriate number of components. To circumvent this choice, investigators are increasingly turning to Dirichlet process mixtures (DPMs), and Pitman-Yor process mixtures (PYMs), more generally. While these models may be well-suited for Bayesian density estimation, many investigators are using them for inferences about the number of components, by considering the posterior on the number of components represented in the observed data. We show that this posterior is not consistent --- that is, on data from a finite mixture, it does not concentrate at the true number of components. This result applies to a large class of nonparametric mixtures, including DPMs and PYMs, over a wide variety of families of component distributions, including essentially all discrete families, as well as continuous exponential families satisfying mild regularity conditions (such as multivariate Gaussians).
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Aug 2013.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 0; 2024: 0; 2025: 0; 2026: 3.
7 papers.
- 2022Clustering consistency with Dirichlet process mixturescited by 6
- 2021Evaluating Sensitivity to the Stick-Breaking Prior in Bayesian Nonparametricscited by 4
- 2022Bayesian nonparametric mixture inconsistency for the number of components: How worried should we be in practice?cited by 1
- 2026Scalable Posterior Uncertainty for Flexible Density-Based Clusteringcited by 1
- 2022Neural Representations Reveal Distinct Modes of Class Fitting in Residual Convolutional Networkscited by 0
- 2026A Data-Informed Variational Clustering Framework for Noisy High-Dimensional Datacited by 0
- 2026DP-Splat: Bayesian Nonparametric Complexity Control for Gaussian Splattingcited by 0
- 2026DP-Splat: Bayesian Nonparametric Complexity Control for Gaussian Splatting12 Jul 2026
- 2026A Data-Informed Variational Clustering Framework for Noisy High-Dimensional Data8 Apr 2026
- 2026Scalable Posterior Uncertainty for Flexible Density-Based Clustering3 Mar 2026
- 2022Neural Representations Reveal Distinct Modes of Class Fitting in Residual Convolutional Networks1 Dec 2022
- 2022Bayesian nonparametric mixture inconsistency for the number of components: How worried should we be in practice?29 Jul 2022
- 2022Clustering consistency with Dirichlet process mixtures25 May 2022
- 2021Evaluating Sensitivity to the Stick-Breaking Prior in Bayesian Nonparametrics8 Jul 2021