λ-PSD: Scalable Approximate SNR-Optimised Polynomial Stein Discrepancies
Not on the map. Why?
Abstract (arXiv)
Polynomial Stein discrepancies (PSD) provide a scalable alternative to kernel Stein methods for measuring sample quality and goodness-of-fit testing, but their statistical properties remain poorly understood. We show that increasing polynomial degree primarily amplifies signal without adequately controlling variance, rather than directly optimising the signal-to-noise ratio (SNR). Under suitable assumptions, this might lead to a failure mode in which the SNR2 can provably decay exponentially with polynomial degree. Motivated by this observation, we reformulate Stein discrepancy construction as an explicit SNR2 maximisation problem, yielding a Rayleigh quotient over Stein features. This perspective motivates λ-PSD, an approximate scalable covariance-aware reweighting scheme defined in a low-dimensional subspace. Under Gaussian settings, we show that λ-PSD avoids the exponential SNR2 collapse and achieves a stable SNR2. Empirically, λ-PSD substantially improves test power while retaining linear-time complexity in the number of samples, highlighting the importance of SNR-aware design for scalable Stein discrepancies.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
14 of 26 references.
References · 14
- 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 498
- 2016A Kernelized Stein Discrepancy for Goodness-of-fit Tests and Model Evaluationcited by 236
- 2016A Kernel Test of Goodness of Fitcited by 143
- 2017Measuring Sample Quality with Kernelscited by 119
- 2016Generative Models and Model Criticism via Optimized Maximum Mean Discrepancycited by 99
- 2015Measuring Sample Quality with Stein's Methodcited by 94
- 2019Rank-normalization, folding, and localization: An improved widehatR for assessing convergence of MCMCcited by 90
- 2017A Linear-Time Kernel Goodness-of-Fit Testcited by 41
- 2018Random Feature Stein Discrepanciescited by 23
- 2016Black-box Importance Samplingcited by 13
- 2020Semi-Exact Control Functionals From Sard's Methodcited by 9
- 2016Sparse Generalized Eigenvalue Problem: Optimal Statistical Rates via Truncated Rayleigh Flowcited by 6
2 more
Built on by
Not cited yet.