Optimal transport meets speech: a tutorial review
Not on the map. Why?
Abstract (arXiv)
Optimal Transport (OT) provides a principled framework for comparing and transforming probability distributions while preserving geometric structure. Recently, OT has gained significant attention in machine learning due to its ability to measure discrepancies between distributions, even when their supports do not overlap, making it effective for tasks such as generative modeling, domain adaptation, and transfer learning. Despite its success in fields such as computer vision and natural language processing, OT remains relatively underexplored in speech research. Speech signals present unique challenges, including temporal dynamics, speaker variability, noise, reverberation, and heterogeneous multimodal representations involving audio, text, and visual information. These factors often lead to distribution mismatches, where OT offers a natural framework for alignment and interpretation. This work aims to promote broader adoption of OT in speech processing by: (1) reviewing OT foundations through intuitive physical interpretations and highlighting connections to modern generative models; (2) presenting computational algorithms suitable for deep learning frameworks; and (3) demonstrating OT applications in cross-domain and cross-modal speech tasks, including speech enhancement, automatic speech recognition, language and speaker recognition, and audio spoof detection. We highlight OT's strong potential for addressing distributional variations in real-world speech applications.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 72 of its 135 references that are in the map. First posted on arXiv 24 Sep 2026.
Builds on
72 of 135 references.
References · 72
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
38 more
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
- 2019An Introduction to Variational Autoencoderscited by 1,000
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 602
- 2015Optimal Transport for Domain Adaptationcited by 463
- 2016Input Convex Neural Networkscited by 414
- 2013A survey of the Schr"odinger problem and some of its connections with optimal transportcited by 292
- 2017Joint Distribution Optimal Transportation for Domain Adaptationcited by 282
- 2021Modern Koopman Theory for Dynamical Systemscited by 276
- 2016Joint CTC-Attention based End-to-End Speech Recognition using Multi-task Learningcited by 257
- 2020Sparse Sinkhorn Attentioncited by 251
- 2019Optimal transport mapping via input convex neural networkscited by 206
- 2019A review of domain adaptation without target labelscited by 156
- 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 140
- 2021Sinkformers: Transformers with Doubly Stochastic Attentioncited by 138
- 2022Neural Optimal Transportcited by 126
- 2014On the relation between optimal transport and Schr"odinger bridges: A stochastic control viewpointcited by 99
- 2021Do Neural Optimal Transport Solvers Work? A Continuous Wasserstein-2 Benchmarkcited by 96
- 2018Fused Gromov-Wasserstein distance for structured objects: theoretical foundations and mathematical propertiescited by 93
- 2017Smooth and Sparse Optimal Transportcited by 83
- 2024Optimal Flow Matching: Learning Straight Trajectories in Just One Stepcited by 78
- 2021Low-Rank Sinkhorn Factorizationcited by 67
- 2023Recent Advances in Optimal Transport for Machine Learningcited by 66
- 2020Estimating Generalization under Distribution Shifts via Domain-Invariant Representationscited by 56
- 2022Unbalanced Optimal Transport, from Theory to Numericscited by 46
- 2021Adversarial Unsupervised Domain Adaptation with Conditional and Label Shift: Infer, Align and Iteratecited by 43
- 2022Improving End-to-End Contextual Speech Recognition with Fine-Grained Contextual Knowledge Selectioncited by 39
- 2016Scaling Algorithms for Unbalanced Transport Problemscited by 36
- 2025An Introduction to Flow Matching and Diffusion Modelscited by 35
- 2019Improving Sequence-to-Sequence Learning via Optimal Transportcited by 33
- 2020Word Rotator's Distancecited by 32
- 2022Sparsity-Constrained Optimal Transportcited by 32
- 2021Fast End-to-End Speech Recognition via Non-Autoregressive Models and Cross-Modal Knowledge Transferring from BERTcited by 31
- 2017Deep Learning for Environmentally Robust Speech Recognition: An Overview of Recent Developmentscited by 30
- 2023Scalable Optimal Transport Methods in Machine Learning: A Contemporary Surveycited by 27
- 2024A Survey on Speech Deepfake Detectioncited by 27
- 2023Pre-training for Speech Translation: CTC Meets Optimal Transportcited by 25
- 2023CMOT: Cross-modal Mixup via Optimal Transport for Speech Translationcited by 22
50 most cited of 72 All 72 (JSON)
Built on by
Not cited yet.