mlsanityData to 7 Oct 2026

λ-PSD: Scalable Approximate SNR-Optimised Polynomial Stein Discrepancies

arXiv 2606.26621 ↗First posted 25 Jun 2026stat.ME stat.CO stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Polynomial Stein discrepancies (PSD) provide a scalable alternative to kernel Stein methods for measuring sample quality and goodness-of-fit testing, but their statistical properties remain poorly understood. We show that increasing polynomial degree primarily amplifies signal without adequately controlling variance, rather than directly optimising the signal-to-noise ratio (SNR). Under suitable assumptions, this might lead to a failure mode in which the SNR2 can provably decay exponentially with polynomial degree. Motivated by this observation, we reformulate Stein discrepancy construction as an explicit SNR2 maximisation problem, yielding a Rayleigh quotient over Stein features. This perspective motivates λ-PSD, an approximate scalable covariance-aware reweighting scheme defined in a low-dimensional subspace. Under Gaussian settings, we show that λ-PSD avoids the exponential SNR2 collapse and achieves a stable SNR2. Empirically, λ-PSD substantially improves test power while retaining linear-time complexity in the number of samples, highlighting the importance of SNR-aware design for scalable Stein discrepancies.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 25 Jun 2026.

Builds on

14 of 26 references.

References · 14

  1. 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 498
  2. 2016A Kernelized Stein Discrepancy for Goodness-of-fit Tests and Model Evaluationcited by 236
  3. 2016A Kernel Test of Goodness of Fitcited by 143
  4. 2017Measuring Sample Quality with Kernelscited by 119
  5. 2016Generative Models and Model Criticism via Optimized Maximum Mean Discrepancycited by 99
  6. 2015Measuring Sample Quality with Stein's Methodcited by 94
  7. 2019Rank-normalization, folding, and localization: An improved widehatR for assessing convergence of MCMCcited by 90
  8. 2017A Linear-Time Kernel Goodness-of-Fit Testcited by 41
  9. 2018Random Feature Stein Discrepanciescited by 23
  10. 2016Black-box Importance Samplingcited by 13
  11. 2020Semi-Exact Control Functionals From Sard's Methodcited by 9
  12. 2016Sparse Generalized Eigenvalue Problem: Optimal Statistical Rates via Truncated Rayleigh Flowcited by 6
2 more
  1. 2022Neural Stein critics with staged L2-regularizationcited by 2
  2. 2024The Polynomial Stein Discrepancy for Assessing Moment Convergencecited by 2

Built on by

Not cited yet.