# Conditional Wasserstein Distances with Applications in Bayesian OT Flow Matching

arXiv: https://arxiv.org/abs/2403.18705 · HTML: https://mlsanity.com/paper/2403.18705/

## Key facts

- Cited by 36 papers in the map (data through 14 Oct 2026).
- Placed in Flow matching, time series and science, one of 14 directions in Diffusion models.
- Builds on 33 of its 63 references that are in the map.
- First posted on arXiv 27 Mar 2024.

## Placed in

- Diffusion models / [Flow matching, time series and science](https://mlsanity.com/diffusion/flow-matching-time-series-and-science/)

## Builds on (most cited first, 30 of 33)

- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [Diffusion Models Beat GANs on Image Synthesis](https://mlsanity.com/paper/2105.05233/) (2021)
- [Flow Matching for Generative Modeling](https://mlsanity.com/paper/2210.02747/) (2022)
- [Neural Ordinary Differential Equations](https://mlsanity.com/paper/1806.07366/) (2018)
- [Improved Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2102.09672/) (2021)
- [Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow](https://mlsanity.com/paper/2209.03003/) (2022)
- [Conditional Generative Adversarial Nets](https://mlsanity.com/paper/1411.1784/) (2014)
- [Building Normalizing Flows with Stochastic Interpolants](https://mlsanity.com/paper/2209.15571/) (2022)
- [Improving and generalizing flow-based generative models with minibatch optimal transport](https://mlsanity.com/paper/2302.00482/) (2023)
- [Learning Generative Models with Sinkhorn Divergences](https://mlsanity.com/paper/1706.00292/) (2017)
- [Multisample Flow Matching: Straightening Flows with Minibatch Couplings](https://mlsanity.com/paper/2304.14772/) (2023)
- [Learning Likelihoods with Conditional Normalizing Flows](https://mlsanity.com/paper/1912.00042/) (2019)
- [Guided Image Generation with Conditional Invertible Neural Networks](https://mlsanity.com/paper/1907.02392/) (2019)
- [Flow Matching for Scalable Simulation-Based Inference](https://mlsanity.com/paper/2305.17161/) (2023)
- [Guided Flows for Generative Modeling and Decision Making](https://mlsanity.com/paper/2311.13443/) (2023)
- [Stochastic interpolants with data-dependent couplings](https://mlsanity.com/paper/2310.03725/) (2023)
- [Deep Bayesian Inversion](https://mlsanity.com/paper/1811.05910/) (2018)
- [Supervised Training of Conditional Monge Maps](https://mlsanity.com/paper/2206.14262/) (2022)
- [Stochastic Normalizing Flows for Inverse Problems: a Markov Chains Viewpoint](https://mlsanity.com/paper/2109.11375/) (2021)
- [Conditional Optimal Transport on Function Spaces](https://mlsanity.com/paper/2311.05672/) (2023)
- [Posterior Sampling Based on Gradient Flows of the MMD with Negative Distance Kernel](https://mlsanity.com/paper/2310.03054/) (2023)
- [Generalized Normalizing Flows via Markov Chains](https://mlsanity.com/paper/2111.12506/) (2021)
- [Optimal Transport for Conditional Domain Matching and Label Shift](https://mlsanity.com/paper/2006.08161/) (2020)
- [Wasserstein Steepest Descent Flows of Discrepancies with Riesz Kernels](https://mlsanity.com/paper/2211.01804/) (2022)
- [Nonparametric Generative Modeling with Conditional Sliced-Wasserstein Flows](https://mlsanity.com/paper/2305.02164/) (2023)
- [Conditional Generative Models are Provably Robust: Pointwise Guarantees for Bayesian Inverse Problems](https://mlsanity.com/paper/2303.15845/) (2023)
- [Extended Flow Matching: a Method of Conditional Generation with Generalized Continuity Equation](https://mlsanity.com/paper/2402.18839/) (2024)
- [Data Driven Conditional Optimal Transport](https://mlsanity.com/paper/1910.11422/) (2019)
- [Understanding the training of infinitely deep and wide ResNets with Conditional Optimal Transport](https://mlsanity.com/paper/2403.12887/) (2024)
- [A generative flow for conditional sampling via optimal transport](https://mlsanity.com/paper/2307.04102/) (2023)

## Built on by (most cited first, 30 of 36)

- [PnP-Flow: Plug-and-Play Image Restoration with Flow Matching](https://mlsanity.com/paper/2410.02423/) (2024)
- [Dynamic Conditional Optimal Transport through Simulation-Free Flows](https://mlsanity.com/paper/2404.04240/) (2024)
- [On the Relation between Rectified Flows and Optimal Transport](https://mlsanity.com/paper/2505.19712/) (2025)
- [Flow Matching: Markov Kernels, Stochastic Processes and Transport Plans](https://mlsanity.com/paper/2501.16839/) (2025)
- [Flow Matching with Semidiscrete Couplings](https://mlsanity.com/paper/2509.25519/) (2025)
- [Efficient Prior Calibration From Indirect Data](https://mlsanity.com/paper/2405.17955/) (2024)
- [Source Separation by Flow Matching](https://mlsanity.com/paper/2505.16119/) (2025)
- [A Likelihood Based Approach to Distribution Regression Using Conditional Deep Generative Models](https://mlsanity.com/paper/2410.02025/) (2024)
- [Fast filtering of non-Gaussian models using Amortized Optimal Transport Maps](https://mlsanity.com/paper/2503.12633/) (2025)
- [Improved Immiscible Diffusion: Accelerate Diffusion Training by Reducing Its Miscibility](https://mlsanity.com/paper/2505.18521/) (2025)
- [Rethinking the Diffusion Models for Numerical Tabular Data Imputation from the Perspective of Wasserstein Gradient Flow](https://mlsanity.com/paper/2406.15762/) (2024)
- [Modeling Stochastic Conditional Dynamics from Sparse Observations via Kernel-Stabilized Flow Matching](https://mlsanity.com/paper/2411.08314/) (2024)
- [A Geometric Approach to Optimal Experimental Design](https://mlsanity.com/paper/2510.14848/) (2025)
- [Generalized Wasserstein Flow Matching: Transport Plans, Everywhere, All at Once](https://mlsanity.com/paper/2605.08424/) (2026)
- [A local squared Wasserstein-2 method for efficient reconstruction of models with uncertainty](https://mlsanity.com/paper/2406.06825/) (2024)
- [DAWN-FM: Data-Aware and Noise-Informed Flow Matching for Solving Inverse Problems](https://mlsanity.com/paper/2412.04766/) (2024)
- [Provable Mixed-Noise Learning with Flow-Matching](https://mlsanity.com/paper/2508.18122/) (2025)
- [GRASP: Guided Residual Adapters with Sample-wise Partitioning](https://mlsanity.com/paper/2512.01675/) (2025)
- [Pairwise Optimal Transports for Training All-to-All Flow-Based Condition Transfer Model](https://mlsanity.com/paper/2504.03188/) (2025)
- [Binding Multiple Modalities via Multimodal Wasserstein Barycenter](https://mlsanity.com/paper/2609.33800/) (2026)
- [Conditional Generative Models for Contrast-Enhanced Synthesis of T1w and T1 Maps in Brain MRI](https://mlsanity.com/paper/2410.08894/) (2024)
- [PnP-DA: Towards Principled Plug-and-Play Integration of Variational Data Assimilation and Generative Models](https://mlsanity.com/paper/2508.00325/) (2025)
- [Quantifying the noise sensitivity of the Wasserstein metric for images](https://mlsanity.com/paper/2510.01015/) (2025)
- [Conditional Unbalanced Optimal Transport Maps: An Outlier-Robust Framework for Conditional Generative Modeling](https://mlsanity.com/paper/2603.06972/) (2026)
- [Sampling Boltzmann distributions via normalizing flow approximation of transport maps](https://mlsanity.com/paper/2603.14258/) (2026)
- [Prior-Fitted Functional Flow: In-Context Generative Models for Pharmacokinetics](https://mlsanity.com/paper/2604.17670/) (2026)
- [Conditional Random Ordered Transport Spaces](https://mlsanity.com/paper/2606.08113/) (2026)
- [A Distributionally Robust Framework for Learned Reconstructions in Inverse Problems](https://mlsanity.com/paper/2606.30230/) (2026)
- [Representations from Pretrained Machine-Learning Interatomic Potentials as Coarse Coordinates for Material Generation and Evaluation](https://mlsanity.com/paper/2607.28776/) (2026)
- [Gromov-Monge Flow Matching for Equivariant Graph Generation](https://mlsanity.com/paper/2608.26961/) (2026)

## Abstract (arXiv)

In inverse problems, many conditional generative models approximate the posterior measure by minimizing a distance between the joint measure and its learned approximation. While this approach also controls the distance between the posterior measures in the case of the Kullback--Leibler divergence, this is in general not hold true for the Wasserstein distance. In this paper, we introduce a conditional Wasserstein distance via a set of restricted couplings that equals the expected Wasserstein distance of the posteriors. Interestingly, the dual formulation of the conditional Wasserstein-1 flow resembles losses in the conditional Wasserstein GAN literature in a quite natural way. We derive theoretical properties of the conditional Wasserstein distance, characterize the corresponding geodesics and velocity fields as well as the flow ODEs. Subsequently, we propose to approximate the velocity fields by relaxing the conditional Wasserstein distance. Based on this, we propose an extension of OT Flow Matching for solving Bayesian inverse problems and demonstrate its numerical advantages on an inverse problem and class-conditional image generation.
