mlsanityData to 7 Oct 2026

Efficient yet Competitive Speech Translation: FBK@IWSLT2022

arXiv 2205.02629 ↗First posted 5 May 2022cs.CLcited by 14

Not on the map. Why?

Abstract (arXiv)

The primary goal of this FBK's systems submission to the IWSLT 2022 offline and simultaneous speech translation tasks is to reduce model training costs without sacrificing translation quality. As such, we first question the need of ASR pre-training, showing that it is not essential to achieve competitive results. Second, we focus on data filtering, showing that a simple method that looks at the ratio between source and target characters yields a quality improvement of 1 BLEU. Third, we compare different methods to reduce the detrimental effect of the audio segmentation mismatch between training data manually segmented at sentence level and inference data that is automatically segmented. Towards the same goal of training cost reduction, we participate in the simultaneous task with the same model trained for offline ST. The effectiveness of our lightweight training strategy is shown by the high score obtained on the MuST-C en-de corpus (26.7 BLEU) and is confirmed in high-resource data conditions by a 1.6 BLEU improvement on the IWSLT2020 test set over last year's winning system.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 34 of its 50 references that are in the map. First posted on arXiv 5 May 2022.

Builds on

34 of 50 references.

References · 34

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  3. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  4. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  5. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  6. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  7. 2016Sequence-Level Knowledge Distillationcited by 761
  8. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 455
  9. 2018TED-LIUM 3: twice as much data and corpus repartition for experiments on speaker adaptationcited by 224
  10. 2020fairseq S2T: Fast Speech-to-Text Modeling with fairseqcited by 174
  11. 2021Primer: Searching for Efficient Transformers for Language Modelingcited by 162
  12. 2019Europarl-ST: A Multilingual Corpus For Speech Translation Of Parliamentary Debatescited by 114
22 more
  1. 2020SimulEval: An Evaluation Toolkit for Simultaneous Translationcited by 94
  2. 2020SimulMT to SimulST: Adapting Simultaneous Text Translation to End-to-End Simultaneous Speech Translationcited by 80
  3. 2018Pre-training on high-resource speech recognition improves low-resource speech-to-text translationcited by 70
  4. 2020CoVoST: A Diverse Multilingual Speech-To-Text Translation Corpuscited by 57
  5. 2021Facebook AI WMT21 News Translation Task Submissioncited by 57
  6. 2021Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Taskcited by 54
  7. 2021Learning Shared Semantic Space for Speech-to-Text Translationcited by 49
  8. 2021Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoderscited by 48
  9. 2021CTC-based Compression for Direct Speech Translationcited by 45
  10. 2019A Comparative Study on End-to-end Speech to Text Translationcited by 40
  11. 2021RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformercited by 39
  12. 2020End-to-End Speech-Translation with Knowledge Distillation: FBK@IWSLT2020cited by 31
  13. 2021Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translationcited by 27
  14. 2022SHAS: Approaching optimal Segmentation for End-to-End Speech Translationcited by 26
  15. 2022Does Simultaneous Speech Translation need Simultaneous Models?cited by 22
  16. 2021Beyond Voice Activity Detection: Hybrid Audio Segmentation for Direct Speech Translationcited by 17
  17. 2021Speechformer: Reducing Information Loss in Direct Speech Translationcited by 15
  18. 2020Tight Integrated End-to-End Training for Cascaded Speech Translationcited by 13
  19. 2020Contextualized Translation of Automatically Segmented Speechcited by 12
  20. 2020On Target Segmentation for Direct Speech Translationcited by 12
  21. 2020On Knowledge Distillation for Direct Speech Translationcited by 11
  22. 2021Dealing with training and test segmentation mismatch: FBK@IWSLT2021cited by 6

Built on by

Cited by year

Citing papers per year: 2022: 5; 2023: 4; 2024: 3; 2025: 2.

14 papers.

Sort: