Robustness and Structure Preservation in Flow-Based Generative Models via Wasserstein Path-Space Divergences
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
We introduce a novel Wasserstein-1 (W1) path-space divergence for stochastic and deterministic dynamics and establish a Wasserstein Uncertainty Propagation (WUP) theorem that bounds the W1 distance between terminal distributions by the proposed divergence, equivalently characterized by a weighted L2 discrepancy between the underlying drifts and the W1 distance between their initial measures. A key ingredient is a probabilistic framework combining adjoint Feynman-Kac representations with synchronous coupling (and reflection coupling on bounded domains), yielding Wasserstein stability estimates beyond existing PDE- and Girsanov-based approaches. The framework accommodates time-varying and possibly degenerate diffusion coefficients, empirical and singular measures, and remains valid in the deterministic limit of flow matching. Unlike KL-based uncertainty quantification bounds, it does not require absolute continuity of path measures and therefore remains well-defined in singular settings. As consequences of the WUP theorem, we derive W1 robustness and generalization bounds for score-based generative models and flow matching at both population and finite-sample levels. We further specialize the framework to group-symmetric targets, providing the first error analysis of equivariant flow-based models and the first quantitative comparison between data augmentation and equivariant inductive bias. Our analysis identifies a symmetry-aware Wasserstein path-space divergence that quantifies the model-form error induced by non-equivariant parametrizations. We prove that this error cannot be removed by additional data or training and vanishes only under equivariant architectures, establishing a precise theoretical advantage of equivariant inductive bias over data augmentation. Numerical experiments on group-symmetric Gaussian mixtures corroborate the theory.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 28 of its 41 references that are in the map. First posted on arXiv 2 Oct 2024.
Builds on
28 of 41 references.
Closest ancestors · 4
Same direction, newest first
- 2024Flow matching achieves almost minimax optimal convergence31 May
- 2023Equivariant flow matching26 Jun
- 2022Flow Matching for Generative Modeling6 Oct
- 2022Equivariant Diffusion for Molecule Generation in 3D31 Mar
Other references · 24
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 626
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 445
- 2019Sliced Score Matching: A Scalable Approach to Density and Score Estimationcited by 384
- 2020Equivariant Flows: Exact Likelihood Generative Learning for Symmetric Densitiescited by 250
- 2022Convergence of denoising diffusion models under the manifold hypothesiscited by 242
- 2022Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptionscited by 219
12 more
- 2022Convergence for score-based generative modeling with polynomial complexitycited by 177
- 2021E(n) Equivariant Normalizing Flowscited by 165
- 2023Diffusion Models are Minimax Optimal Distribution Estimatorscited by 165
- 2023Error Bounds for Flow Matching Methodscited by 91
- 2022Structure-preserving GANscited by 17
- 2024Score-based generative models are provably robust: an uncertainty quantification perspectivecited by 15
- 2023Sample Complexity of Probability Divergences under Group Symmetrycited by 14
- 2023Sample Complexity Bounds for Estimating Probability Divergences under Invariancescited by 12
- 2024What's the score? Automated Denoising Score Matching for Nonlinear Diffusionscited by 7
- 2023Statistical Guarantees of Group-Invariant GANscited by 4
- 2024Robust Generative Learning with Lipschitz-Regularized α-Divergences Allows Minimal Assumptions on Target Distributionscited by 4
- 2024Nonlinear denoising score matching for enhanced learning of structured distributionscited by 3
Built on by
Citing papers per year: 2025: 3.
3 papers.
- 2025Rao-Blackwell Gradient Estimators for Equivariant Denoising Diffusioncited by 5
- 2025Statistical Learning Guarantees for Group-Invariant Barron Functionscited by 1
- 2025Concentration Inequalities for Stochastic Optimization of Unbounded Objective Functions with Application to Denoising Score Matchingcited by 0
- 2025Statistical Learning Guarantees for Group-Invariant Barron Functions27 Sep 2025
- 2025Rao-Blackwell Gradient Estimators for Equivariant Denoising Diffusion14 Feb 2025
- 2025Concentration Inequalities for Stochastic Optimization of Unbounded Objective Functions with Application to Denoising Score Matching12 Feb 2025
Similar, not cited
Close in wording, no citation either way
- 2025Pathway to O(√d) Complexity bound under Wasserstein metric of flow-based models
- 2026Diffusion Flow Matching: Dimension-Improved KL Bounds and Wasserstein Guarantees
- 2026Generalized Wasserstein Flow Matching: Transport Plans, Everywhere, All at Once
- 2025Non-asymptotic error bounds for probability flow ODEs under weak log-concavity
- 2024Convergence Analysis for General Probability Flow ODEs of Diffusion Models in Wasserstein Distances
- 2025Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distance
- 2025Theoretical Guarantees for High Order Trajectory Refinement in Generative Flows
- 2025Wasserstein Convergence of Score-based Generative Models under Semiconvexity and Discontinuous Gradients