Robust inference using density-powered Stein operators
Not on the map. Why?
Abstract (arXiv)
We introduce a density-power weighted variant of the Stein operator, called the γ-Stein operator, for robust inference with unnormalized probability models. The operator is motivated by the first variation of the γ-divergence under infinitesimal escort transport and weights the usual Stein field by a positive power of the model density. This weighting down-weights observations in low model-density regions, providing a principled robustness mechanism while retaining the normalizing-constant-free structure of score matching. We develop the resulting γ-score matching estimating equations and discuss their non-integrable, generalized-method-of-moments character. We further study two extensions: a γ-kernelized Stein discrepancy, interpreted as a robust diagnostic or contaminated-null goodness-of-fit procedure, and γ-Stein variational gradient descent for robust posterior approximation. Numerical examples on directional, mixture, and quartic-potential models illustrate the robustness--efficiency trade-off: positive γ can stabilize inference under targeted contamination, whereas γ=0 remains preferable under clean well-specified models.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 12 of its 29 references that are in the map. First posted on arXiv 6 Nov 2025.
Builds on
12 of 29 references.
References · 12
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2018Computational Optimal Transportcited by 780
- 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 507
- 2016A Kernelized Stein Discrepancy for Goodness-of-fit Tests and Model Evaluationcited by 236
- 2016A Kernel Test of Goodness of Fitcited by 143
- 2017Measuring Sample Quality with Kernelscited by 119
- 2021Kernel Stein Discrepancy Descentcited by 57
- 2021Robust Generalised Bayesian Inference for Intractable Likelihoodscited by 53
- 2020Entropy-Regularized 2-Wasserstein Distance between Gaussian Measurescited by 32
- 2021Stein's Method Meets Computational Statistics: A Review of Some Recent Developmentscited by 32
- 2022Robust self-tuning semiparametric PCA for contaminated elliptical distributioncited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.