mlsanityData to 14 Oct 2026

Embedding Empirical Distributions for Computing Optimal Transport Maps

arXiv 2504.17740 ↗First posted 24 Apr 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Distributional data have become increasingly prominent in modern signal processing, highlighting the necessity of computing optimal transport (OT) maps across multiple probability distributions. Nevertheless, recent studies on neural OT methods predominantly focused on the efficient computation of a single map between two distributions. To address this challenge, we introduce a novel approach to learning transport maps for new empirical distributions. Specifically, we employ the transformer architecture to produce embeddings from distributional data of varying length; these embeddings are then fed into a hypernetwork to generate neural OT maps. Various numerical experiments were conducted to validate the embeddings and the generated OT maps. The model implementation and the code are provided on https://github.com/jiangmingchen/HOTET.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 49 references that are in the map. First posted on arXiv 24 Apr 2025.

Builds on

37 of 49 references.

References · 37

  1. 2017Attention Is All You Needcited by 60,361
  2. 2022Flow Matching for Generative Modelingcited by 5,702
  3. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  4. 2013Auto-Encoding Variational Bayescited by 4,053
  5. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  7. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  8. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  9. 2020Rethinking Attention with Performerscited by 1,601
  10. 2016HyperNetworkscited by 1,027
  11. 2016Input Convex Neural Networkscited by 414
  12. 2019Are Transformers universal approximators of sequence-to-sequence functions?cited by 406
25 more
  1. 2017Joint Distribution Optimal Transportation for Domain Adaptationcited by 282
  2. 2019Model Fusion via Optimal Transportcited by 219
  3. 2019Optimal transport mapping via input convex neural networkscited by 206
  4. 2019Style Transfer by Relaxed Optimal Transport and Self-Similaritycited by 168
  5. 2018Improving GANs Using Optimal Transportcited by 123
  6. 2023A Brief Review of Hypernetworks in Deep Learningcited by 102
  7. 2019Wasserstein-2 Generative Networkscited by 97
  8. 2021Do Neural Optimal Transport Solvers Work? A Continuous Wasserstein-2 Benchmarkcited by 96
  9. 2020COT-GAN: Generating Sequential Data via Causal Optimal Transportcited by 71
  10. 2021Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr"om Methodcited by 63
  11. 2022Supervised Training of Conditional Monge Mapscited by 61
  12. 2020Wasserstein Embedding for Graph Learningcited by 56
  13. 2020Linear Optimal Transport Embedding: Provable Wasserstein classification for certain rigid transformations and perturbationscited by 37
  14. 2023Transformer Fusion with Optimal Transportcited by 36
  15. 2020Wasserstein Regressioncited by 35
  16. 2023Convergence of flow-based generative models via proximal gradient descent in Wasserstein spacecited by 34
  17. 2022Meta Optimal Transportcited by 28
  18. 2021Using Optimal Transport as Alignment Objective for fine-tuning Multilingual Contextualized Embeddingscited by 19
  19. 2024Wasserstein Wormhole: Scalable Optimal Transport Distance with Transformerscited by 14
  20. 2025ResMoE: Space-efficient Compression of Mixture of Experts LLMs via Residual Restorationcited by 12
  21. 2019(q,p)-Wasserstein GANs: Comparing Ground Metrics for Wasserstein GANscited by 10
  22. 2021Conditional Wasserstein Barycenters and Interpolation/Extrapolation of Distributionscited by 8
  23. 2025OT-Transformer: A Continuous-time Transformer Architecture with Optimal Transport Regularizationcited by 7
  24. 2022GeONet: a neural operator for learning the Wasserstein geodesiccited by 3
  25. 2020Unsupervised Multilingual Alignment using Wasserstein Barycentercited by 2

Built on by

Not cited yet.