Uniform-in-time Propagation-of-Chaos for Stein Variational Gradient Descent
Not on the map. Why?
Abstract (arXiv)
We study uniform-in-time propagation-of-chaos for continuous-time Stein Variational Gradient Descent (SVGD). Classical finite-time propagation-of-chaos estimates for mean-field systems typically deteriorate rapidly with time and therefore do not directly explain the long-time relation between the finite-particle system and its mean-field limit. We obtain two complementary classes of uniform-in-time propagation-of-chaos results. For broad distributional metrics, we introduce a cutoff strategy which combines finite-time propagation-of-chaos estimates up to an N-dependent horizon with independent quantitative long-time convergence estimates for the finite-particle and mean-field SVGD flows. This yields uniform-in-averaging-time propagation-of-chaos bounds in Langevin kernel Stein discrepancy, Wasserstein-1 distance, and Wasserstein-2 distance, with logarithmic or iterated-logarithmic rates depending on the metric, target and kernel class. We also develop a finite-dimensional theory for matrix-valued finite-rank kernels. For Gaussian targets with bilinear kernels, the SVGD dynamics close exactly on first and second moments, yielding genuine uniform-in-physical-time parametric propagation-of-chaos rates in finite-dimensional Stein-feature metrics. We then prove a conjugacy principle showing that these feature-level estimates transfer to conjugate target-kernel pairs under orientation-preserving diffeomorphisms, thereby extending the theory to broad classes of nonlinear, including multimodal, targets. Together, these results highlight the contrast between generic distributional metrics, for which our general approach yields logarithmic rates, and closed finite-dimensional Stein observables, for which parametric N-1/2 propagation-of-chaos rates persist uniformly in time.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 10 of its 45 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
10 of 45 references.
References · 10
- 2026Generative Modeling via Driftingcited by 116
- 2017Learning to Draw Samples with Amortized Stein Variational Gradient Descentcited by 28
- 2026Generative Drifting is Secretly Score Matching: a Spectral and Variational Perspectivecited by 20
- 2026Gradient Flow Drifting: Generative Modeling via Wasserstein Gradient Flows of KDE-Approximated Divergencescited by 17
- 2026Drifting Fields are not Conservativecited by 13
- 2026On the Wasserstein Gradient Flow Interpretation of Drifting Modelscited by 11
- 2026Finite-Particle Rates for Regularized Stein Variational Gradient Descentcited by 5
- 2026Finite-Particle Convergence Rates for Conservative and Non-Conservative Drifting Modelscited by 4
- 2026Quantitative Local Convergence of Mean-Field Stein Variational Gradient Flowcited by 3
- 2026Uniform-in-Time Weak Propagation-of-Chaos in Shallow Neural Networkscited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.