mlsanityData to 7 Oct 2026

Self-Training for End-to-End Speech Translation

arXiv 2006.02490 ↗First posted 3 Jun 2020cs.CL cs.SD eess.AScited by 36

Not on the map. Why?

Abstract (arXiv)

One of the main challenges for end-to-end speech translation is data scarcity. We leverage pseudo-labels generated from unlabeled audio by a cascade and an end-to-end speech translation model. This provides 8.3 and 5.7 BLEU gains over a strong semi-supervised baseline on the MuST-C English-French and English-German datasets, reaching state-of-the art performance. The effect of the quality of the pseudo-labels is investigated. Our approach is shown to be more effective than simply pre-training the encoder on the speech recognition task. Finally, we demonstrate the effectiveness of self-training by directly generating pseudo-labels with an end-to-end model instead of a cascade model.

Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Jun 2020.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 12; 2022: 9; 2023: 9; 2024: 3; 2025: 3.

36 papers.

Sort:

By area:

  1. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 455
  2. 2022Unified Speech-Text Pre-training for Speech Translation and Recognitioncited by 64
  3. 2022Cross-modal Contrastive Learning for Speech Translationcited by 61
  4. 2022UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Unitscited by 60
  5. 2022STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translationcited by 57
  6. 2021Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Taskcited by 54
  7. 2021Learning Shared Semantic Space for Speech-to-Text Translationcited by 49
  8. 2021Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoderscited by 48
  9. 2021Fused Acoustic and Text Encoding for Multimodal Bilingual Pretraining and Speech Translationcited by 47
  10. 2021End-to-end Speech Translation via Cross-modal Progressive Trainingcited by 47
  11. 2022Enhanced Direct Speech-to-Speech Translation Using Self-supervised Pre-training and Data Augmentationcited by 43
  12. 2021Large-Scale Self- and Semi-Supervised Learning for Speech Translationcited by 36
24 more
  1. 2023Pre-training for Speech Translation: CTC Meets Optimal Transportcited by 25
  2. 2023CMOT: Cross-modal Mixup via Optimal Transport for Speech Translationcited by 22
  3. 2022WACO: Word-Aligned Contrastive Learning for Speech Translationcited by 21
  4. 2023DUB: Discrete Unit Back-translation for Speech Translationcited by 18
  5. 2023Recent Advances in Direct Speech-to-text Translationcited by 15
  6. 2021The USTC-NELSLIP Systems for Simultaneous Speech Translation Task at IWSLT 2021cited by 13
  7. 2022Improving End-to-end Speech Translation by Leveraging Auxiliary Speech and Text Datacited by 9
  8. 2021Back-Training excels Self-Training at Unsupervised Domain Adaptation of Question Generation and Passage Retrievalcited by 8
  9. 2021Kosp2e: Korean Speech to English Translation Corpuscited by 7
  10. 2023Improving Speech Translation by Cross-Modal Multi-Grained Contrastive Learningcited by 7
  11. 2023Duplex Diffusion Models Improve Speech-to-Speech Translationcited by 5
  12. 2023AV-CPL: Continuous Pseudo-Labeling for Audio-Visual Speech Recognitioncited by 5
  13. 2024CoSTA: Code-Switched Speech Translation using Aligned Speech-Text Interleavingcited by 4
  14. 2025When End-to-End is Overkill: Rethinking Cascaded Speech-to-Text Translationcited by 4
  15. 2021The Volctrans Neural Speech Translation System for IWSLT 2021cited by 3
  16. 2022Joint Speech Transcription and Translation: Pseudo-Labeling with Out-of-Distribution Datacited by 3
  17. 2023Improving speech translation by fusing speech and textcited by 3
  18. 2024Representation Purification for End-to-End Speech Translationcited by 3
  19. 2024LLM-Ref: Enhancing Reference Handling in Technical Writing with Large Language Modelscited by 2
  20. 2025Speech Translation Refinement using Large Language Modelscited by 2
  21. 2021Improving Cross-Lingual Reading Comprehension with Self-Trainingcited by 1
  22. 2022Efficient Speech Translation with Pre-trained Modelscited by 1
  23. 2023Improving End-to-End Speech Translation by Imitation-Based Knowledge Distillation with Synthetic Transcriptscited by 1
  24. 2025Interpretable Style Takagi-Sugeno-Kang Fuzzy Clusteringcited by 0