mlsanityData to 14 Oct 2026

Weighted Stochastic Differential Equation to Implement Wasserstein-Fisher-Rao Gradient Flow

arXiv 2512.17878 ↗First posted 19 Dec 2025cs.LG cs.AI stat.MLcited by 0

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Score-based diffusion models currently constitute the state of the art in continuous generative modeling. These methods are typically formulated via overdamped or underdamped Ornstein--Uhlenbeck-type stochastic differential equations, in which sampling is driven by a combination of deterministic drift and Brownian diffusion, resulting in continuous particle trajectories in the ambient space. While such dynamics enjoy exponential convergence guarantees for strongly log-concave target distributions, it is well known that their mixing rates deteriorate exponentially in the presence of nonconvex or multimodal landscapes, such as double-well potentials. Since many practical generative modeling tasks involve highly non-log-concave target distributions, considerable recent effort has been devoted to developing sampling schemes that improve exploration beyond classical diffusion dynamics. A promising line of work leverages tools from information geometry to augment diffusion-based samplers with controlled mass reweighting mechanisms. This perspective leads naturally to Wasserstein--Fisher--Rao (WFR) geometries, which couple transport in the sample space with vertical (reaction) dynamics on the space of probability measures. In this work, we formulate such reweighting mechanisms through the introduction of explicit correction terms and show how they can be implemented via weighted stochastic differential equations using the Feynman--Kac representation. Our study provides a preliminary but rigorous investigation of WFR-based sampling dynamics, and aims to clarify their geometric and operator-theoretic structure as a foundation for future theoretical and algorithmic developments.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 10 of its 40 references that are in the map. First posted on arXiv 19 Dec 2025.

Builds on

10 of 40 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Score-based Diffusion Models via Stochastic Differential Equations -- a Technical Tutorial12 Feb

Other references · 9

  1. 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 208
  2. 2015Optimal Entropy-Transport problems and a new Hellinger-Kantorovich distance between positive measurescited by 139
  3. 2017Underdamped Langevin MCMC: A non-asymptotic analysiscited by 133
  4. 2017User-friendly guarantees for the Langevin Monte Carlo with inaccurate gradientcited by 116
  5. 2019The Randomized Midpoint Method for Log-Concave Samplingcited by 78
  6. 2018On sampling from a log-concave density using kinetic Langevin diffusionscited by 62
  7. 2020On the Convergence of Langevin Monte Carlo: The Interplay between Tail Growth and Smoothnesscited by 55
  8. 2020Convergence of Langevin Monte Carlo in Chi-Squared and Renyi Divergencecited by 42
  9. 2017Beyond Log-concavity: Provable Guarantees for Sampling Multi-modal Distributions using Simulated Tempering Langevin Monte Carlocited by 33

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Wasserstein Convergence of Critically Damped Langevin Diffusions
  2. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusions
  3. 2025Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distance
  4. 2024Convergence Analysis for General Probability Flow ODEs of Diffusion Models in Wasserstein Distances
  5. 2025Advancing Wasserstein Convergence Analysis of Score-Based Models: Insights from Discretization and Second-Order Acceleration
  6. 2024Diffusion models for Gaussian distributions: Exact solutions and Wasserstein errors
  7. 2025Non-asymptotic error bounds for probability flow ODEs under weak log-concavity
  8. 2026Fast Sampling for Flows and Diffusions with Lazy and Point Mass Stochastic Interpolants