On the Normalizing Constant of the Continuous Categorical Distribution
Not on the map. Why?
Abstract (arXiv)
Probability distributions supported on the simplex enjoy a wide range of applications across statistics and machine learning. Recently, a novel family of such distributions has been discovered: the continuous categorical. This family enjoys remarkable mathematical simplicity; its density function resembles that of the Dirichlet distribution, but with a normalizing constant that can be written in closed form using elementary functions only. In spite of this mathematical simplicity, our understanding of the normalizing constant remains far from complete. In this work, we characterize the numerical behavior of the normalizing constant and we present theoretical and methodological advances that can, in turn, help to enable broader applications of the continuous categorical distribution. Our code is available at https://github.com/cunningham-lab/cb_and_cc/.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 5 of its 17 references that are in the map. First posted on arXiv 28 Apr 2022.
Builds on
5 of 17 references.
References · 5
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2019The continuous Bernoulli: fixing a pervasive error in variational autoencoderscited by 40
- 2020The continuous categorical: a novel simplex-valued exponential familycited by 12
- 2020Uses and Abuses of the Cross-Entropy Loss: Case Studies in Modern Deep Learningcited by 10
Built on by
Citing papers per year: 2022: 1.
1 paper.