mlsanityData to 7 Oct 2026

A scalable deep learning approach for solving high-dimensional dynamic optimal transport

arXiv 2205.07521 ↗First posted 16 May 2022cs.LG cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

The dynamic formulation of optimal transport has attracted growing interests in scientific computing and machine learning, and its computation requires to solve a PDE-constrained optimization problem. The classical Eulerian discretization based approaches suffer from the curse of dimensionality, which arises from the approximation of high-dimensional velocity field. In this work, we propose a deep learning based method to solve the dynamic optimal transport in high dimensional space. Our method contains three main ingredients: a carefully designed representation of the velocity field, the discretization of the PDE constraint along the characteristics, and the computation of high dimensional integral by Monte Carlo method in each time step. Specifically, in the representation of the velocity field, we apply the classical nodal basis function in time and the deep neural networks in space domain with the H1-norm regularization. This technique promotes the regularity of the velocity field in both time and space such that the discretization along the characteristic remains to be stable during the training process. Extensive numerical examples have been conducted to test the proposed method. Compared to other solvers of optimal transport, our method could give more accurate results in high dimensional cases and has very good scalability with respect to dimension. Finally, we extend our method to more complicated cases such as crowd motion problem.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 29 of its 56 references that are in the map. First posted on arXiv 16 May 2022.

Builds on

29 of 56 references.

References · 29

  1. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  2. 2014Deep Learning in Neural Networks: An Overviewcited by 765
  3. 2018Computational Optimal Transportcited by 765
  4. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
  5. 2017Wasserstein GANcited by 635
  6. 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
  7. 2015Optimal Transport for Domain Adaptationcited by 457
  8. 2016Input Convex Neural Networkscited by 407
  9. 2020How to train your neural ODE: the world of Jacobian and kinetic regularizationcited by 228
  10. 2019Optimal transport mapping via input convex neural networkscited by 202
  11. 2016Stochastic Optimization for Large-scale Optimal Transportcited by 188
  12. 2017Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equationscited by 188
17 more
  1. 2020Deep Network Approximation for Smooth Functionscited by 163
  2. 2020TrajectoryNet: A Dynamic Optimal Transport Network for Modeling Cellular Dynamicscited by 155
  3. 2018Improving GANs Using Optimal Transportcited by 122
  4. 2017Large-Scale Optimal Transport and Mapping Estimationcited by 120
  5. 2019A Machine Learning Framework for Solving High-Dimensional Mean Field Game and Mean Field Control Problemscited by 95
  6. 2019ANODE: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEscited by 83
  7. 2015A Primer on Neural Network Models for Natural Language Processingcited by 75
  8. 2018Optimal Transport for Multi-source Domain Adaptation under Target Shiftcited by 67
  9. 2020Neural Network Approximation: Three Hidden Layers Are Enoughcited by 63
  10. 2020Discretize-Optimize vs. Optimize-Discretize for Time-Series Regression and Continuous Normalizing Flowscited by 36
  11. 2021A Survey on Optimal Transport for Machine Learning: Theory and Applicationscited by 35
  12. 2017A Geometric View of Optimal Transportation and Generative Modelcited by 31
  13. 2019Advancements in Image Classification using Convolutional Neural Networkcited by 20
  14. 2019Unnormalized Optimal Transportcited by 15
  15. 2020AE-OT-GAN: Training GANs from data specific latent distributioncited by 13
  16. 2018Multilevel Optimal Transport: a Fast Approximation of Wasserstein-1 distancescited by 4
  17. 2021A Fast Proximal Gradient Method and Convergence Analysis for Dynamic Mean Field Planningcited by 4

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 4.

5 papers.