Phone Features Improve Speech Translation
Not on the map. Why?
Abstract (arXiv)
End-to-end models for speech translation (ST) more tightly couple speech recognition (ASR) and machine translation (MT) than a traditional cascade of separate ASR and MT models, with simpler model architectures and the potential for reduced error propagation. Their performance is often assumed to be superior, though in many conditions this is not yet the case. We compare cascaded and end-to-end models across high, medium, and low-resource conditions, and show that cascades remain stronger baselines. Further, we introduce two methods to incorporate phone features into ST models. We show that these features improve both architectures, closing the gap between end-to-end models and cascades, and outperforming previous academic work -- by up to 9 BLEU on our low-resource setting.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 3; 2023: 1.
11 papers.
- 2021The Multilingual TEDx Corpus for Speech Recognition and Translationcited by 101
- 2021Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Taskcited by 54
- 2021CTC-based Compression for Direct Speech Translationcited by 45
- 2021RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformercited by 39
- 2022M-Adapter: Modality Adaptation for End-to-End Speech-to-Text Translationcited by 15
- 2021Pre-training for Spoken Language Understanding with Joint Textual and Phonetic Representation Learningcited by 6
- 2021Zero-shot Speech Translationcited by 5
- 2022AdaTranS: Adapting with Boundary-based Shrinking for End-to-End Speech Translationcited by 3
- 2021AlloST: Low-resource Speech Translation without Source Transcriptioncited by 2
- 2022RedApt: An Adaptor for wav2vec 2 Encoding Faster and Smaller Speech Translation without Quality Compromisecited by 2
- 2023Bridging the Granularity Gap for Acoustic Modelingcited by 2
- 2023Bridging the Granularity Gap for Acoustic Modeling27 May 2023
- 2022AdaTranS: Adapting with Boundary-based Shrinking for End-to-End Speech Translation17 Dec 2022
- 2022RedApt: An Adaptor for wav2vec 2 Encoding Faster and Smaller Speech Translation without Quality Compromise16 Oct 2022
- 2022M-Adapter: Modality Adaptation for End-to-End Speech-to-Text Translation3 Jul 2022
- 2021Zero-shot Speech Translation13 Jul 2021
- 2021Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task12 Jul 2021
- 2021RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformer9 Jun 2021
- 2021AlloST: Low-resource Speech Translation without Source Transcription1 May 2021
- 2021Pre-training for Spoken Language Understanding with Joint Textual and Phonetic Representation Learning21 Apr 2021
- 2021The Multilingual TEDx Corpus for Speech Recognition and Translation2 Feb 2021
- 2021CTC-based Compression for Direct Speech Translation2 Feb 2021