mlsanityData to 14 Oct 2026

Optimal transport meets speech: a tutorial review

arXiv 2609.31787 ↗First posted 24 Sep 2026eess.AS cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Optimal Transport (OT) provides a principled framework for comparing and transforming probability distributions while preserving geometric structure. Recently, OT has gained significant attention in machine learning due to its ability to measure discrepancies between distributions, even when their supports do not overlap, making it effective for tasks such as generative modeling, domain adaptation, and transfer learning. Despite its success in fields such as computer vision and natural language processing, OT remains relatively underexplored in speech research. Speech signals present unique challenges, including temporal dynamics, speaker variability, noise, reverberation, and heterogeneous multimodal representations involving audio, text, and visual information. These factors often lead to distribution mismatches, where OT offers a natural framework for alignment and interpretation. This work aims to promote broader adoption of OT in speech processing by: (1) reviewing OT foundations through intuitive physical interpretations and highlighting connections to modern generative models; (2) presenting computational algorithms suitable for deep learning frameworks; and (3) demonstrating OT applications in cross-domain and cross-modal speech tasks, including speech enhancement, automatic speech recognition, language and speaker recognition, and audio spoof detection. We highlight OT's strong potential for addressing distributional variations in real-world speech applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 72 of its 135 references that are in the map. First posted on arXiv 24 Sep 2026.

Builds on

72 of 135 references.

References · 72

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  7. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  8. 2018Neural Ordinary Differential Equationscited by 3,779
  9. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  10. 2015Domain-Adversarial Training of Neural Networkscited by 3,044
  11. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
  12. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
38 more
  1. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
  2. 2019An Introduction to Variational Autoencoderscited by 1,000
  3. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
  4. 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 602
  5. 2015Optimal Transport for Domain Adaptationcited by 463
  6. 2016Input Convex Neural Networkscited by 414
  7. 2013A survey of the Schr"odinger problem and some of its connections with optimal transportcited by 292
  8. 2017Joint Distribution Optimal Transportation for Domain Adaptationcited by 282
  9. 2021Modern Koopman Theory for Dynamical Systemscited by 276
  10. 2016Joint CTC-Attention based End-to-End Speech Recognition using Multi-task Learningcited by 257
  11. 2020Sparse Sinkhorn Attentioncited by 251
  12. 2019Optimal transport mapping via input convex neural networkscited by 206
  13. 2019A review of domain adaptation without target labelscited by 156
  14. 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 140
  15. 2021Sinkformers: Transformers with Doubly Stochastic Attentioncited by 138
  16. 2022Neural Optimal Transportcited by 126
  17. 2014On the relation between optimal transport and Schr"odinger bridges: A stochastic control viewpointcited by 99
  18. 2021Do Neural Optimal Transport Solvers Work? A Continuous Wasserstein-2 Benchmarkcited by 96
  19. 2018Fused Gromov-Wasserstein distance for structured objects: theoretical foundations and mathematical propertiescited by 93
  20. 2017Smooth and Sparse Optimal Transportcited by 83
  21. 2024Optimal Flow Matching: Learning Straight Trajectories in Just One Stepcited by 78
  22. 2021Low-Rank Sinkhorn Factorizationcited by 67
  23. 2023Recent Advances in Optimal Transport for Machine Learningcited by 66
  24. 2020Estimating Generalization under Distribution Shifts via Domain-Invariant Representationscited by 56
  25. 2022Unbalanced Optimal Transport, from Theory to Numericscited by 46
  26. 2021Adversarial Unsupervised Domain Adaptation with Conditional and Label Shift: Infer, Align and Iteratecited by 43
  27. 2022Improving End-to-End Contextual Speech Recognition with Fine-Grained Contextual Knowledge Selectioncited by 39
  28. 2016Scaling Algorithms for Unbalanced Transport Problemscited by 36
  29. 2025An Introduction to Flow Matching and Diffusion Modelscited by 35
  30. 2019Improving Sequence-to-Sequence Learning via Optimal Transportcited by 33
  31. 2020Word Rotator's Distancecited by 32
  32. 2022Sparsity-Constrained Optimal Transportcited by 32
  33. 2021Fast End-to-End Speech Recognition via Non-Autoregressive Models and Cross-Modal Knowledge Transferring from BERTcited by 31
  34. 2017Deep Learning for Environmentally Robust Speech Recognition: An Overview of Recent Developmentscited by 30
  35. 2023Scalable Optimal Transport Methods in Machine Learning: A Contemporary Surveycited by 27
  36. 2024A Survey on Speech Deepfake Detectioncited by 27
  37. 2023Pre-training for Speech Translation: CTC Meets Optimal Transportcited by 25
  38. 2023CMOT: Cross-modal Mixup via Optimal Transport for Speech Translationcited by 22

50 most cited of 72 All 72 (JSON)

Built on by

Not cited yet.