mlsanityData to 14 Oct 2026

Robust inference using density-powered Stein operators

arXiv 2511.03963 ↗First posted 6 Nov 2025stat.ML cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

We introduce a density-power weighted variant of the Stein operator, called the γ-Stein operator, for robust inference with unnormalized probability models. The operator is motivated by the first variation of the γ-divergence under infinitesimal escort transport and weights the usual Stein field by a positive power of the model density. This weighting down-weights observations in low model-density regions, providing a principled robustness mechanism while retaining the normalizing-constant-free structure of score matching. We develop the resulting γ-score matching estimating equations and discuss their non-integrable, generalized-method-of-moments character. We further study two extensions: a γ-kernelized Stein discrepancy, interpreted as a robust diagnostic or contaminated-null goodness-of-fit procedure, and γ-Stein variational gradient descent for robust posterior approximation. Numerical examples on directional, mixture, and quartic-potential models illustrate the robustness--efficiency trade-off: positive γ can stabilize inference under targeted contamination, whereas γ=0 remains preferable under clean well-specified models.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 12 of its 29 references that are in the map. First posted on arXiv 6 Nov 2025.

Builds on

12 of 29 references.

References · 12

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  3. 2018Computational Optimal Transportcited by 780
  4. 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 507
  5. 2016A Kernelized Stein Discrepancy for Goodness-of-fit Tests and Model Evaluationcited by 236
  6. 2016A Kernel Test of Goodness of Fitcited by 143
  7. 2017Measuring Sample Quality with Kernelscited by 119
  8. 2021Kernel Stein Discrepancy Descentcited by 57
  9. 2021Robust Generalised Bayesian Inference for Intractable Likelihoodscited by 53
  10. 2020Entropy-Regularized 2-Wasserstein Distance between Gaussian Measurescited by 32
  11. 2021Stein's Method Meets Computational Statistics: A Review of Some Recent Developmentscited by 32
  12. 2022Robust self-tuning semiparametric PCA for contaminated elliptical distributioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.