Normalizing flows as approximations of optimal transport maps via linear-control neural ODEs
Not on the map. Why?
Abstract (arXiv)
In this paper, we consider the problem of recovering the W2-optimal transport map T between absolutely continuous measures μ,nu∈P(ℝn) as the flow of a linear-control neural ODE, where the control depends only on the time variable and takes values in a finite-dimensional space. We first show that, under suitable assumptions on μ,nu and on the controlled vector fields governing the neural ODE, the optimal transport map is contained in the C0c-closure of the flows generated by the system. Then, we tackle the problem under the assumption that only discrete approximations of μN,nuN of the original measures μ,nu are available: we formulate approximated optimal control problems, and we show that their solutions give flows that approximate the original optimal transport map T. In the framework of generative models, the approximating flow constructed here can be seen as a `Normalizing Flow', which usually refers to the task of providing invertible transport maps between probability measures by means of deep neural networks. We propose an iterative numerical scheme based on the Pontryagin Maximum Principle for the resolution of the optimal control problem, resulting in a method for the practical computation of the approximated optimal transport map, and we test it on a two-dimensional example.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 25 of its 51 references that are in the map. First posted on arXiv 2 Nov 2023.
Builds on
25 of 51 references.
References · 25
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2018Computational Optimal Transportcited by 765
- 2017Stable Architectures for Deep Neural Networkscited by 340
- 2017Smooth and Sparse Optimal Transportcited by 83
- 2021Generative Modeling with Optimal Transport Mapscited by 80
- 2021Plugin Estimation of Smooth Optimal Transport Mapscited by 67
- 2021Neural ODE control for classification, approximation and transportcited by 56
- 2020Learning normalizing flows from Entropy-Kantorovich potentialscited by 18
- 2019Quadratically regularized optimal transportcited by 15
- 2020Large-time asymptotics in deep learningcited by 14
13 more
- 2021A Measure Theoretical Approach to the Mean-field Maximum Principle for Training NeurODEscited by 11
- 2021Non-asymptotic convergence bounds for Wasserstein approximation using point cloudscited by 9
- 2019Control in the spaces of ensembles of pointscited by 8
- 2021Deep Learning Approximation of Diffeomorphisms via Linear-Control Systemscited by 7
- 2021A gradient flow equation for optimal control problems with end-point costcited by 6
- 2022Turning Normalizing Flows into Monge Maps with Geodesic Gaussian Preserving Flowscited by 6
- 2014Shape deformation analysis from the optimal control viewpointcited by 5
- 2022Optimal Control of ensembles of dynamical systemscited by 5
- 2018Computing Kantorovich-Wasserstein Distances on d-dimensional histograms using (d+1)-partite graphscited by 4
- 2023From NeurODEs to AutoencODEs: a mean-field control framework for width-varying Neural Networkscited by 3
- 2023Embedding Capabilities of Neural ODEscited by 3
- 2023Approximation Theory, Computing, and Deep Learning on the Wasserstein Spacecited by 3
- 2021On the Structure of Optimal Transportation Plans between Discrete Measurescited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 1.
2 papers.