Functional optimal transport: map estimation and domain adaptation for functional data
Not on the map. Why?
Abstract (arXiv)
We introduce a formulation of optimal transport problem for distributions on function spaces, where the stochastic map between functional domains can be partially represented in terms of an (infinite-dimensional) Hilbert-Schmidt operator mapping a Hilbert space of functions to another. For numerous machine learning tasks, data can be naturally viewed as samples drawn from spaces of functions, such as curves and surfaces, in high dimensions. Optimal transport for functional data analysis provides a useful framework of treatment for such domains. { Since probability measures in infinite dimensional spaces generally lack absolute continuity (that is, with respect to non-degenerate Gaussian measures), the Monge map in the standard optimal transport theory for finite dimensional spaces may not exist. Our approach to the optimal transport problem in infinite dimensions is by a suitable regularization technique -- we restrict the class of transport maps to be a Hilbert-Schmidt space of operators.} To this end, we develop an efficient algorithm for finding the stochastic transport map between functional domains and provide theoretical guarantees on the existence, uniqueness, and consistency of our estimate for the Hilbert-Schmidt operator. We validate our method on synthetic datasets and examine the functional properties of the transport map. Experiments on real-world datasets of robot arm trajectories further demonstrate the effectiveness of our method on applications in domain adaptation.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 39 of its 108 references that are in the map. First posted on arXiv 7 Feb 2021.
Builds on
39 of 108 references.
References · 39
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2017Wasserstein GANcited by 635
- 2015Optimal Transport for Domain Adaptationcited by 457
- 2016Input Convex Neural Networkscited by 407
- 2019Attentive Neural Processescited by 280
- 2018DeepJDOT: Deep Joint Distribution Optimal Transport for Unsupervised Domain Adaptationcited by 212
- 2018RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitationcited by 202
- 2019Optimal transport mapping via input convex neural networkscited by 202
- 2016Stochastic Optimization for Large-scale Optimal Transportcited by 188
27 more
- 2020Geometric Dataset Distances via Optimal Transportcited by 157
- 2017Using Simulation and Domain Adaptation to Improve Efficiency of Deep Robotic Graspingcited by 138
- 2018Improving GANs Using Optimal Transportcited by 122
- 2017Large-Scale Optimal Transport and Mapping Estimationcited by 120
- 2015Gaussian Processes for Data-Efficient Learning in Robotics and Controlcited by 97
- 2018Unsupervised Alignment of Embeddings with Wasserstein Procrustescited by 96
- 2020Convex Potential Flows: Universal Probability Distributions with Optimal Transport and Convex Optimizationcited by 89
- 2017Smooth and Sparse Optimal Transportcited by 83
- 2018Multiple Interactions Made Easy (MIME): Large Scale Demonstrations Data for Imitationcited by 76
- 2020Scalable Computations of Wasserstein Barycenter via Input Convex Neural Networkscited by 49
- 2017Multilevel Clustering via Wasserstein Meanscited by 48
- 2020Outlier-Robust Optimal Transportcited by 45
- 2019Assistive Gym: A Physics Simulation Framework for Assistive Roboticscited by 44
- 2018Convergence and Concentration of Empirical Measures under Wasserstein Distance in Unbounded Functional Spacescited by 41
- 2019Hierarchical Optimal Transport for Multimodal Distribution Alignmentcited by 38
- 2018Towards Optimal Transport with Global Invariancescited by 33
- 2019Improving Sequence-to-Sequence Learning via Optimal Transportcited by 33
- 2019On Scalable and Efficient Computation of Large Scale Optimal Transportcited by 29
- 2020Task-Agnostic Online Reinforcement Learning with an Infinite Mixture of Gaussian Processescited by 23
- 2018Learning to Match via Inverse Optimal Transportcited by 22
- 2013Optimal parameter selection for the alternating direction method of multipliers (ADMM): quadratic problemscited by 19
- 2018Procrustes Metrics on Covariance Operators and Optimal Transportation of Gaussian Processescited by 19
- 2019Recurrent Attentive Neural Process for Sequential Datacited by 15
- 2019Unsupervised Hierarchy Matching with Optimal Transport over Hyperbolic Spacescited by 14
- 2020Online Domain Adaptation for Occupancy Mappingcited by 4
- 2018SERoCS: Safe and Efficient Robot Collaborative Systems for Next Generation Intelligent Industrial Co-Robotscited by 2
- 2020Representing and Denoising Wearable ECG Recordingscited by 2
Built on by
Citing papers per year: 2021: 1; 2022: 4; 2023: 2.
7 papers.
- 2021Neural Monge Map estimation and its applicationscited by 40
- 2022Curriculum Reinforcement Learning using Optimal Transport via Gradual Domain Adaptationcited by 28
- 2023Scalable Optimal Transport Methods in Machine Learning: A Contemporary Surveycited by 27
- 2022GeoECG: Data Augmentation via Wasserstein Geodesic Perturbation for Robust Electrocardiogram Predictioncited by 8
- 2022PhysioMTL: Personalizing Physiological Patterns using Optimal Transport Multi-Task Regressioncited by 3
- 2023Interpolation for Robust Learning: Data Augmentation on Wasserstein Geodesicscited by 3
- 2022On Hypothesis Transfer Learning of Functional Linear Modelscited by 2
- 2023Scalable Optimal Transport Methods in Machine Learning: A Contemporary Survey8 May 2023
- 2023Interpolation for Robust Learning: Data Augmentation on Wasserstein Geodesics4 Feb 2023
- 2022Curriculum Reinforcement Learning using Optimal Transport via Gradual Domain Adaptation18 Oct 2022
- 2022GeoECG: Data Augmentation via Wasserstein Geodesic Perturbation for Robust Electrocardiogram Prediction2 Aug 2022
- 2022On Hypothesis Transfer Learning of Functional Linear Models9 Jun 2022
- 2022PhysioMTL: Personalizing Physiological Patterns using Optimal Transport Multi-Task Regression19 Mar 2022
- 2021Neural Monge Map estimation and its applications7 Jun 2021