# Robust inference using density-powered Stein operators

arXiv: https://arxiv.org/abs/2511.03963 · HTML: https://mlsanity.com/paper/2511.03963/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 12 of its 29 references that are in the map.
- First posted on arXiv 6 Nov 2025.

## Builds on (most cited first, 12 of 12)

- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [Generative Modeling by Estimating Gradients of the Data Distribution](https://mlsanity.com/paper/1907.05600/) (2019)
- [Computational Optimal Transport](https://mlsanity.com/paper/1803.00567/) (2018)
- [Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithm](https://mlsanity.com/paper/1608.04471/) (2016)
- [A Kernelized Stein Discrepancy for Goodness-of-fit Tests and Model Evaluation](https://mlsanity.com/paper/1602.03253/) (2016)
- [A Kernel Test of Goodness of Fit](https://mlsanity.com/paper/1602.02964/) (2016)
- [Measuring Sample Quality with Kernels](https://mlsanity.com/paper/1703.01717/) (2017)
- [Kernel Stein Discrepancy Descent](https://mlsanity.com/paper/2105.09994/) (2021)
- [Robust Generalised Bayesian Inference for Intractable Likelihoods](https://mlsanity.com/paper/2104.07359/) (2021)
- [Entropy-Regularized 2-Wasserstein Distance between Gaussian Measures](https://mlsanity.com/paper/2006.03416/) (2020)
- [Stein's Method Meets Computational Statistics: A Review of Some Recent Developments](https://mlsanity.com/paper/2105.03481/) (2021)
- [Robust self-tuning semiparametric PCA for contaminated elliptical distribution](https://mlsanity.com/paper/2206.03662/) (2022)

## Built on by (most cited first, 2 of 2)

- [Implicit geometric regularization in flow matching via density weighted Stein operators](https://mlsanity.com/paper/2512.23956/) (2025)
- [Statistical Inference via Generative Models: Flow Matching and Causal Inference](https://mlsanity.com/paper/2603.09009/) (2026)

## Abstract (arXiv)

We introduce a density-power weighted variant of the Stein operator, called the γ-Stein operator, for robust inference with unnormalized probability models. The operator is motivated by the first variation of the γ-divergence under infinitesimal escort transport and weights the usual Stein field by a positive power of the model density. This weighting down-weights observations in low model-density regions, providing a principled robustness mechanism while retaining the normalizing-constant-free structure of score matching. We develop the resulting γ-score matching estimating equations and discuss their non-integrable, generalized-method-of-moments character. We further study two extensions: a γ-kernelized Stein discrepancy, interpreted as a robust diagnostic or contaminated-null goodness-of-fit procedure, and γ-Stein variational gradient descent for robust posterior approximation. Numerical examples on directional, mixture, and quartic-potential models illustrate the robustness--efficiency trade-off: positive γ can stabilize inference under targeted contamination, whereas γ=0 remains preferable under clean well-specified models.