Proximal optimal transport divergences
Not on the map. Why?
Abstract (arXiv)
We introduce the proximal optimal transport divergence, a novel discrepancy measure that interpolates between information divergences and optimal transport distances via an infimal convolution formulation. This divergence provides a principled foundation for optimal transport proximals and proximal optimization methods frequently used in generative modeling. We explore its mathematical properties, including smoothness, boundedness, and computational tractability, and establish connections to primal-dual formulations and adversarial learning. The proximal operator associated with the proximal optimal transport divergence can be interpreted as a transport map that pushes a reference distribution toward the optimal generative distribution, which approximates the target distribution that is only accessible through data samples. Building on the Benamou-Brenier dynamic formulation of classical optimal transport, we also establish a dynamic formulation for proximal OT divergences. The resulting dynamic formulation is a first order mean-field game whose optimality conditions are governed by a pair of nonlinear partial differential equations: a backward Hamilton-Jacobi equation and a forward continuity equation. Our framework generalizes existing approaches while offering new insights and computational tools for generative modeling, distributionally robust optimization, and gradient-based learning in probability spaces.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 28 of its 62 references that are in the map. First posted on arXiv 17 May 2025.
Builds on
28 of 62 references.
References · 28
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2018Computational Optimal Transportcited by 780
- 2016f-GAN: Training Generative Neural Samplers using Variational Divergence Minimizationcited by 506
- 2019Sliced Score Matching: A Scalable Approach to Density and Score Estimationcited by 384
- 2020How to train your neural ODE: the world of Jacobian and kinetic regularizationcited by 228
- 2019Optimal transport mapping via input convex neural networkscited by 206
- 2020OT-Flow: Fast and Accurate Continuous Normalizing Flows via Optimal Transportcited by 143
16 more
- 2019A Primer on PAC-Bayesian Learningcited by 132
- 2022Score-Based Generative Models Detect Manifoldscited by 122
- 2014On the relation between optimal transport and Schr"odinger bridges: A stochastic control viewpointcited by 99
- 2020Interacting particle solutions of Fokker-Planck equations through gradient-log-density estimationcited by 88
- 2019Distributionally Robust Optimization: A Reviewcited by 76
- 2020Conditional Sampling with Monotone GANs: from Generative Models to Likelihood-Free Inferencecited by 42
- 2021KALE Flow: A Relaxed KL Gradient Flow for Probabilities with Disjoint Supportcited by 37
- 2023A mean-field games laboratory for generative modelingcited by 28
- 2022Structure-preserving GANscited by 17
- 2024Wasserstein proximal operators describe score-based generative models and resolve memorizationcited by 14
- 2023Unifying Distributionally Robust Optimization via Optimal Transport Theorycited by 13
- 2019Formulation and properties of a divergence used to compare probability measures without absolute continuitycited by 11
- 2023A kernel formula for regularized Wasserstein proximal operatorscited by 11
- 2022Lipschitz-regularized gradient flows and generative particle algorithms for high-dimensional scarce datacited by 8
- 2024Robust Generative Learning with Lipschitz-Regularized α-Divergences Allows Minimal Assumptions on Target Distributionscited by 4
- 2024Combining Wasserstein-1 and Wasserstein-2 proximals: robust manifold learning via well-posed generative flowscited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.