Leveraging Optimal Transport via Projections on Subspaces for Machine Learning Applications
Not on the map. Why?
Abstract (arXiv)
Optimal Transport has received much attention in Machine Learning as it allows to compare probability distributions by exploiting the geometry of the underlying space. However, in its original formulation, solving this problem suffers from a significant computational burden. Thus, a meaningful line of work consists at proposing alternatives to reduce this burden while still enjoying its properties. In this thesis, we focus on alternatives which use projections on subspaces. The main such alternative is the Sliced-Wasserstein distance, which we first propose to extend to Riemannian manifolds in order to use it in Machine Learning applications for which using such spaces has been shown to be beneficial in the recent years. We also study sliced distances between positive measures in the so-called unbalanced OT problem. Back to the original Euclidean Sliced-Wasserstein distance between probability measures, we study the dynamic of gradient flows when endowing the space with this distance in place of the usual Wasserstein distance. Then, we investigate the use of the Busemann function, a generalization of the inner product in metric spaces, in the space of probability measures. Finally, we extend the subspace detour approach to incomparable spaces using the Gromov-Wasserstein distance.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 65 of its 621 references that are in the map. First posted on arXiv 23 Nov 2023.
Builds on
65 of 621 references.
References · 65
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
- 2023Flow Matching on General Geometriescited by 265
- 2020Geoopt: Riemannian Optimization in PyTorchcited by 114
- 2019On the geometry of Stein variational gradient descentcited by 82
- 2023Hyperbolic Deep Learning in Computer Vision: A Surveycited by 73
- 2016Normalizing Flows on Riemannian Manifoldscited by 68
- 2021Plugin Estimation of Smooth Optimal Transport Mapscited by 68
- 2021Minibatch optimal transport distances; analysis and applicationscited by 65
38 more
- 2016Convergence Rate of Frank-Wolfe for Non-Convex Objectivescited by 63
- 2022Unbalanced Optimal Transport, from Theory to Numericscited by 46
- 2019Accelerating Langevin Sampling with Birth-deathcited by 45
- 2023Energy-Based Sliced Wasserstein Distancecited by 39
- 2022Neural Optimal Transport with General Cost Functionalscited by 36
- 2021A Survey on Optimal Transport for Machine Learning: Theory and Applicationscited by 35
- 2022Convergence of the Riemannian Langevin Algorithmcited by 25
- 2022Stationary Kernels and Gaussian Processes on Lie Groups and their Homogeneous Spaces I: the compact casecited by 25
- 2019Global convergence of neuron birth-death dynamicscited by 22
- 2016Learning to Draw Samples: With Application to Amortized MLE for Generative Adversarial Learningcited by 21
- 2023A Survey of Geometric Optimization for Deep Learning: From Euclidean Space to Riemannian Manifoldcited by 21
- 2017GAN and VAE from an Optimal Transport Point of Viewcited by 20
- 2019On approximating nabla f with neural networkscited by 18
- 2023Infeasible Deterministic, Stochastic, and Variance-Reduction Algorithms for Optimization under Orthogonality Constraintscited by 18
- 2019Concentration bounds for linear Monge mapping estimation and optimal transport domain adaptationcited by 17
- 2021Input Convex Gradient Networkscited by 17
- 2022On the existence of Monge maps for the Gromov-Wasserstein problemcited by 16
- 2023Sliced Wasserstein Estimation with Control Variatescited by 16
- 2023Stationary Kernels and Gaussian Processes on Lie Groups and their Homogeneous Spaces II: non-compact symmetric spacescited by 15
- 2023Adaptive Log-Euclidean Metrics for SPD Matrix Learningcited by 13
- 2023Properties of Discrete Sliced Wasserstein Lossescited by 12
- 2018Gradient descent in hyperbolic spacecited by 11
- 2023Markovian Sliced Wasserstein Distances: Beyond Independent Projectionscited by 11
- 2023Horospherical Decision Boundaries for Large Margin Classification in Hyperbolic Spacecited by 11
- 2023Riemannian Multinomial Logistics Regression for SPD Neural Networkscited by 11
- 2021Implicit Riemannian Concave Potential Mapscited by 10
- 2022Accelerated Gradient Methods for Geodesically Convex Optimization: Tractable Algorithms and Convergence Analysiscited by 10
- 2023Slicing Unbalanced Optimal Transportcited by 10
- 2022Wrapped Distributions on homogeneous Riemannian manifoldscited by 9
- 2022Optimal Neural Network Approximation of Wasserstein Gradient Direction via Convex Optimizationcited by 9
- 2022Hilbert Curve Projection Distance for Distribution Comparisoncited by 9
- 2023Geometric Relational Embeddings: A Surveycited by 9
- 2020Aligning Hyperbolic Representations: an Optimal Transport-based approachcited by 8
- 2021The Gene Mover's Distance: Single-cell similarity via Optimal Transportcited by 8
- 2019Poincar'e Wasserstein Autoencodercited by 7
- 2021Statistical and Topological Properties of Gaussian Smoothed Sliced Probability Divergencescited by 7
- 2020On a Novel Application of Wasserstein-Procrustes for Unsupervised Cross-Lingual Learningcited by 6
- 2022Deep Optimal Transport for Domain Adaptation on SPD Manifoldscited by 6
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.