# Efficient Learning of Stationary Diffusions with Stein-type Discrepancies

arXiv: https://arxiv.org/abs/2601.16597 · HTML: https://mlsanity.com/paper/2601.16597/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 13 of its 32 references that are in the map.
- First posted on arXiv 23 Jan 2026.

## Builds on (most cited first, 13 of 13)

- [An Introduction to Matrix Concentration Inequalities](https://mlsanity.com/paper/1501.01571/) (2015)
- [Differentiable Causal Discovery from Interventional Data](https://mlsanity.com/paper/2007.01754/) (2020)
- [Measuring Sample Quality with Kernels](https://mlsanity.com/paper/1703.01717/) (2017)
- [Measuring Sample Quality with Stein's Method](https://mlsanity.com/paper/1506.03039/) (2015)
- [Permutation-based Causal Inference Algorithms with Interventions](https://mlsanity.com/paper/1705.10220/) (2017)
- [Minimum Stein Discrepancy Estimators](https://mlsanity.com/paper/1906.08283/) (2019)
- [Stein's Method Meets Computational Statistics: A Review of Some Recent Developments](https://mlsanity.com/paper/2105.03481/) (2021)
- [Measuring Sample Quality with Diffusions](https://mlsanity.com/paper/1611.06972/) (2016)
- [NODAGS-Flow: Nonlinear Cyclic Causal Structure Learning](https://mlsanity.com/paper/2301.01849/) (2023)
- [Causal Modeling with Stationary Diffusions](https://mlsanity.com/paper/2310.17405/) (2023)
- [Controlling Moments with Kernel Stein Discrepancies](https://mlsanity.com/paper/2211.05408/) (2022)
- [Graphical continuous Lyapunov models](https://mlsanity.com/paper/2005.10483/) (2020)
- [Generator Identification for Linear SDEs with Additive and Multiplicative Noise](https://mlsanity.com/paper/2310.19491/) (2023)

## Built on by (most cited first, 2 of 2)

- [Sign Identifiability of Causal Effects in Stationary Stochastic Dynamical Systems](https://mlsanity.com/paper/2603.08311/) (2026)
- [Generative Modeling with Flux Matching](https://mlsanity.com/paper/2605.07319/) (2026)

## Abstract (arXiv)

Learning a stationary diffusion amounts to estimating the parameters of a stochastic differential equation whose stationary distribution matches a target distribution. We build on the recently introduced kernel deviation from stationarity (KDS), which enforces stationarity by evaluating expectations of the diffusion's generator in a reproducing kernel Hilbert space. Leveraging the connection between KDS and Stein discrepancies, we introduce the Stein-type KDS (SKDS) as an alternative formulation. We prove that a vanishing SKDS guarantees alignment of the learned diffusion's stationary distribution with the target. Furthermore, under broad parametrizations, SKDS is convex with an empirical version that is ε-quasiconvex with high probability. Empirically, learning with SKDS attains comparable accuracy to KDS while substantially reducing computational cost and yields improvements over the majority of competitive baselines.
