mlsanityData to 14 Oct 2026

Computing high-dimensional optimal transport by flow neural networks

arXiv 2305.11857 ↗First posted 19 May 2023stat.ML cs.LG stat.MEcited by 8

Not on the map. Why?

Abstract (arXiv)

Computing optimal transport (OT) for general high-dimensional data has been a long-standing challenge. Despite much progress, most of the efforts including neural network methods have been focused on the static formulation of the OT problem. The current work proposes to compute the dynamic OT between two arbitrary distributions P and Q by optimizing a flow model, where both distributions are only accessible via finite samples. Our method learns the dynamic OT by finding an invertible flow that minimizes the transport cost. The trained optimal transport flow subsequently allows for performing many downstream tasks, including infinitesimal density ratio estimation (DRE) and domain adaptation by interpolating distributions in the latent space. The effectiveness of the proposed model on high-dimensional data is demonstrated by strong empirical performance on OT baselines, image-to-image translation, and high-dimensional DRE.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 51 of its 83 references that are in the map. First posted on arXiv 19 May 2023.

Builds on

51 of 83 references.

References · 51

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  5. 2018Neural Ordinary Differential Equationscited by 3,779
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  7. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  8. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  9. 2016Density estimation using Real NVPcited by 2,042
  10. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
  11. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  12. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
38 more
  1. 2017Masked Autoregressive Flow for Density Estimationcited by 684
  2. 2018MINE: Mutual Information Neural Estimationcited by 683
  3. 2019Neural Spline Flowscited by 596
  4. 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 594
  5. 2018Invertible Residual Networkscited by 365
  6. 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
  7. 2015A note on the evaluation of generative modelscited by 292
  8. 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 283
  9. 2017Joint Distribution Optimal Transportation for Domain Adaptationcited by 282
  10. 2017Learning to Discover Cross-Domain Relations with Generative Adversarial Networkscited by 278
  11. 2020How to train your neural ODE: the world of Jacobian and kinetic regularizationcited by 228
  12. 2019Optimal transport mapping via input convex neural networkscited by 206
  13. 2020TrajectoryNet: A Dynamic Optimal Transport Network for Modeling Cellular Dynamicscited by 160
  14. 2020OT-Flow: Fast and Accurate Continuous Normalizing Flows via Optimal Transportcited by 143
  15. 2019Wasserstein Fair Classificationcited by 131
  16. 2022Neural Optimal Transportcited by 126
  17. 2020Telescoping Density-Ratio Estimationcited by 108
  18. 2022Action Matching: Learning Stochastic Dynamics from Samplescited by 98
  19. 2019Wasserstein-2 Generative Networkscited by 97
  20. 2019A Machine Learning Framework for Solving High-Dimensional Mean Field Game and Mean Field Control Problemscited by 97
  21. 2021Do Neural Optimal Transport Solvers Work? A Continuous Wasserstein-2 Benchmarkcited by 96
  22. 2020Convex Potential Flows: Universal Probability Distributions with Optimal Transport and Convex Optimizationcited by 90
  23. 2021Density Ratio Estimation via Infinitesimal Classificationcited by 61
  24. 2021Continuous Wasserstein-2 Barycenter Estimation without Minimax Optimizationcited by 51
  25. 2020Scalable Computations of Wasserstein Barycenter via Input Convex Neural Networkscited by 50
  26. 2020Non-Negative Bregman Divergence Minimization for Deep Direct Density Ratio Estimationcited by 45
  27. 2021Neural Monge Map estimation and its applicationscited by 40
  28. 2022Normalizing flow neural networks by JKO schemecited by 39
  29. 20192-Wasserstein Approximation via Restricted Convex Potentials with Application to Improved Training for GANscited by 33
  30. 2021Featurized Density Ratio Estimationcited by 33
  31. 2022On amortizing convex conjugates for optimal transportcited by 31
  32. 2019On Scalable and Efficient Computation of Large Scale Optimal Transportcited by 29
  33. 2018Dynamical Optimal Transport on Discrete Surfacescited by 17
  34. 2019Training Neural Networks for Likelihood/Density Ratio Estimationcited by 17
  35. 2022Bridging Mean-Field Games and Normalizing Flows with Trajectory Regularizationcited by 17
  36. 2022Invertible Neural Networks for Graph Predictioncited by 6
  37. 2022Turning Normalizing Flows into Monge Maps with Geodesic Gaussian Preserving Flowscited by 6
  38. 2020Generalized Unnormalized Optimal Transport and its fast algorithmscited by 5

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 2; 2025: 3; 2026: 1.

8 papers.