mlsanityData to 14 Oct 2026

Leveraging Optimal Transport via Projections on Subspaces for Machine Learning Applications

arXiv 2311.13883 ↗First posted 23 Nov 2023cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Optimal Transport has received much attention in Machine Learning as it allows to compare probability distributions by exploiting the geometry of the underlying space. However, in its original formulation, solving this problem suffers from a significant computational burden. Thus, a meaningful line of work consists at proposing alternatives to reduce this burden while still enjoying its properties. In this thesis, we focus on alternatives which use projections on subspaces. The main such alternative is the Sliced-Wasserstein distance, which we first propose to extend to Riemannian manifolds in order to use it in Machine Learning applications for which using such spaces has been shown to be beneficial in the recent years. We also study sliced distances between positive measures in the so-called unbalanced OT problem. Back to the original Euclidean Sliced-Wasserstein distance between probability measures, we study the dynamic of gradient flows when endowing the space with this distance in place of the usual Wasserstein distance. Then, we investigate the use of the Busemann function, a generalization of the inner product in metric spaces, in the space of probability measures. Finally, we extend the subspace detour approach to incomparable spaces using the Gromov-Wasserstein distance.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 65 of its 621 references that are in the map. First posted on arXiv 23 Nov 2023.

Builds on

65 of 621 references.

References · 65

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  4. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  5. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
  6. 2023Flow Matching on General Geometriescited by 265
  7. 2020Geoopt: Riemannian Optimization in PyTorchcited by 114
  8. 2019On the geometry of Stein variational gradient descentcited by 82
  9. 2023Hyperbolic Deep Learning in Computer Vision: A Surveycited by 73
  10. 2016Normalizing Flows on Riemannian Manifoldscited by 68
  11. 2021Plugin Estimation of Smooth Optimal Transport Mapscited by 68
  12. 2021Minibatch optimal transport distances; analysis and applicationscited by 65
38 more
  1. 2016Convergence Rate of Frank-Wolfe for Non-Convex Objectivescited by 63
  2. 2022Unbalanced Optimal Transport, from Theory to Numericscited by 46
  3. 2019Accelerating Langevin Sampling with Birth-deathcited by 45
  4. 2023Energy-Based Sliced Wasserstein Distancecited by 39
  5. 2022Neural Optimal Transport with General Cost Functionalscited by 36
  6. 2021A Survey on Optimal Transport for Machine Learning: Theory and Applicationscited by 35
  7. 2022Convergence of the Riemannian Langevin Algorithmcited by 25
  8. 2022Stationary Kernels and Gaussian Processes on Lie Groups and their Homogeneous Spaces I: the compact casecited by 25
  9. 2019Global convergence of neuron birth-death dynamicscited by 22
  10. 2016Learning to Draw Samples: With Application to Amortized MLE for Generative Adversarial Learningcited by 21
  11. 2023A Survey of Geometric Optimization for Deep Learning: From Euclidean Space to Riemannian Manifoldcited by 21
  12. 2017GAN and VAE from an Optimal Transport Point of Viewcited by 20
  13. 2019On approximating nabla f with neural networkscited by 18
  14. 2023Infeasible Deterministic, Stochastic, and Variance-Reduction Algorithms for Optimization under Orthogonality Constraintscited by 18
  15. 2019Concentration bounds for linear Monge mapping estimation and optimal transport domain adaptationcited by 17
  16. 2021Input Convex Gradient Networkscited by 17
  17. 2022On the existence of Monge maps for the Gromov-Wasserstein problemcited by 16
  18. 2023Sliced Wasserstein Estimation with Control Variatescited by 16
  19. 2023Stationary Kernels and Gaussian Processes on Lie Groups and their Homogeneous Spaces II: non-compact symmetric spacescited by 15
  20. 2023Adaptive Log-Euclidean Metrics for SPD Matrix Learningcited by 13
  21. 2023Properties of Discrete Sliced Wasserstein Lossescited by 12
  22. 2018Gradient descent in hyperbolic spacecited by 11
  23. 2023Markovian Sliced Wasserstein Distances: Beyond Independent Projectionscited by 11
  24. 2023Horospherical Decision Boundaries for Large Margin Classification in Hyperbolic Spacecited by 11
  25. 2023Riemannian Multinomial Logistics Regression for SPD Neural Networkscited by 11
  26. 2021Implicit Riemannian Concave Potential Mapscited by 10
  27. 2022Accelerated Gradient Methods for Geodesically Convex Optimization: Tractable Algorithms and Convergence Analysiscited by 10
  28. 2023Slicing Unbalanced Optimal Transportcited by 10
  29. 2022Wrapped Distributions on homogeneous Riemannian manifoldscited by 9
  30. 2022Optimal Neural Network Approximation of Wasserstein Gradient Direction via Convex Optimizationcited by 9
  31. 2022Hilbert Curve Projection Distance for Distribution Comparisoncited by 9
  32. 2023Geometric Relational Embeddings: A Surveycited by 9
  33. 2020Aligning Hyperbolic Representations: an Optimal Transport-based approachcited by 8
  34. 2021The Gene Mover's Distance: Single-cell similarity via Optimal Transportcited by 8
  35. 2019Poincar'e Wasserstein Autoencodercited by 7
  36. 2021Statistical and Topological Properties of Gaussian Smoothed Sliced Probability Divergencescited by 7
  37. 2020On a Novel Application of Wasserstein-Procrustes for Unsupervised Cross-Lingual Learningcited by 6
  38. 2022Deep Optimal Transport for Domain Adaptation on SPD Manifoldscited by 6

50 most cited of 65 All 65 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.