A Probabilistic Circuit-Induced Pseudo-Metric for Out-of-Distribution Detection
Not on the map. Why?
Abstract (arXiv)
Probabilistic Circuits (PCs) are tractable generative models whose internal nodes encode a hierarchy of probabilistic summaries over different variable scopes. Existing PC-based out-of-distribution (OOD) detection methods ignore this hierarchy, reducing the entire circuit to the scalar likelihood (or its uncertainty) computed at the root. We introduce Hierarchical Likelihood Vector (HLV), a representation whose entries are the likelihoods associated with selected PC nodes and define the Hierarchical Likelihood Distance (HLD), a PC-induced pseudo-metric that compares the probability distributions through the expectations of their HLVs. We show that HLD is an integral probability metric over a function class naturally induced by the PC and develop a principled goodness-of-fit hypothesis test for unsupervised OOD detection. Unlike existing approaches, the trained PC alone serves as the representation of the in-distribution: no held-out in-distribution data are required at deployment. We further show that the quantities required by the hypothesis test can be computed exactly, directly from the trained circuit, yielding an approximate analytic decision threshold. Experiments on tabular and MNIST datasets demonstrate that exploiting the hierarchical probabilistic summaries encoded through the PC improve OOD detection over root-likelihood, uncertainty-, typicality- and kernel-based baselines, while naturally localizing distribution shifts to the PC nodes responsible for the shift.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 38 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
14 of 38 references.
References · 14
- 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 453
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2016A Kernelized Stein Discrepancy for Goodness-of-fit Tests and Model Evaluationcited by 236
- 2020Why Normalizing Flows Fail to Detect Out-of-Distribution Datacited by 221
- 2019Input complexity and out-of-distribution detection with likelihood-based generative modelscited by 186
- 2020Likelihood Regret: An Out-of-Distribution Detection Score For Variational Auto-encodercited by 145
- 2016A Kernel Test of Goodness of Fitcited by 143
- 2016On the Latent Variable Interpretation in Sum-Product Networkscited by 40
- 2021Tractable Regularization of Probabilistic Circuitscited by 39
- 2024Scaling Tractable Probabilistic Circuits: A Systems Perspectivecited by 23
- 2020Group Fairness by Probabilistic Modeling with Latent Fair Decisionscited by 22
- 2020Joints in Random Forestscited by 21
2 more
- 2019On Tractable Computation of Expected Predictionscited by 19
- 2015On the Relationship between Sum-Product Networks and Bayesian Networkscited by 13
Built on by
Not cited yet.