mlsanityData to 7 Oct 2026

The Multilingual TEDx Corpus for Speech Recognition and Translation

arXiv 2102.01757 ↗First posted 2 Feb 2021cs.CLcited by 101

Not on the map. Why?

Abstract (arXiv)

We present the Multilingual TEDx corpus, built to support speech recognition (ASR) and speech translation (ST) research across many non-English source languages. The corpus is a collection of audio recordings from TEDx talks in 8 source languages. We segment transcripts into sentences and align them to the source-language audio and target-language translations. The corpus is released along with open-sourced code enabling extension to new talks and languages as they become available. Our corpus creation methodology can be applied to more languages than previous work, and creates multi-way parallel evaluation sets. We provide baselines in multiple ASR and ST settings, including multilingual models to improve translation performance for low-resource language pairs.

Key facts. Cited by 101 papers in the map (data through 7 Oct 2026). Builds on 26 of its 51 references that are in the map. First posted on arXiv 2 Feb 2021.

Builds on

26 of 51 references.

References · 26

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  3. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  4. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  5. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  6. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  7. 2020Beyond English-Centric Multilingual Machine Translationcited by 559
  8. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  9. 2019CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEBcited by 177
  10. 2020fairseq S2T: Fast Speech-to-Text Modeling with fairseqcited by 174
  11. 2019CCAligned: A Massive Collection of Cross-Lingual Web-Document Pairscited by 136
  12. 2017Sequence-to-Sequence Models Can Directly Translate Foreign Speechcited by 121
14 more
  1. 2019Europarl-ST: A Multilingual Corpus For Speech Translation Of Parliamentary Debatescited by 114
  2. 2016Listen and Translate: A Proof of Concept for End-to-End Speech-to-Text Translationcited by 113
  3. 2016Toward Multilingual Neural Machine Translation with Universal Encoder and Decodercited by 76
  4. 2020CoVoST 2 and Massively Multilingual Speech-to-Text Translationcited by 73
  5. 2018Pre-training on high-resource speech recognition improves low-resource speech-to-text translationcited by 70
  6. 2020CoVoST: A Diverse Multilingual Speech-To-Text Translation Corpuscited by 57
  7. 2019Multilingual End-to-End Speech Translationcited by 37
  8. 2016Very Deep Convolutional Networks for End-to-End Speech Recognitioncited by 34
  9. 2018Augmenting Librispeech with French Translations: A Multimodal Corpus for Direct Speech Translation Evaluationcited by 34
  10. 2019Attention-Passing Models for Robust and Data-Efficient End-to-End Speech Translationcited by 30
  11. 2019MaSS: A Large and Clean Multilingual Corpus of Sentence-aligned Spoken Utterances Extracted from the Biblecited by 24
  12. 2020Relative Positional Encoding for Speech Recognition and Direct Translationcited by 23
  13. 2019Exploring Phoneme-Level Speech Representations for End-to-End Speech Translationcited by 15
  14. 2020Phone Features Improve Speech Translationcited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 7; 2022: 29; 2023: 23; 2024: 19; 2025: 14; 2026: 9.

101 papers.

Sort:

By area:

  1. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  2. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
  3. 2022Visual Speech Recognition for Multiple Languages in the Wildcited by 94
  4. 2022UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Unitscited by 60
  5. 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 48
  6. 2021LeBenchmark: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speechcited by 46
  7. 2022Enhanced Direct Speech-to-Speech Translation Using Self-supervised Pre-training and Data Augmentationcited by 43
  8. 2023MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translationcited by 39
  9. 2022SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translationscited by 35
  10. 2022SAMU-XLSR: Semantically-Aligned Multimodal Utterance-level Cross-Lingual Speech Representationcited by 32
  11. 2022BibleTTS: a large, high-fidelity, multilingual, and uniquely African speech corpuscited by 31
  12. 2024Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processingcited by 29
38 more
  1. 2022SHAS: Approaching optimal Segmentation for End-to-End Speech Translationcited by 26
  2. 2022CTC Alignments Improve Autoregressive Translationcited by 25
  3. 2024Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing?cited by 23
  4. 2022XTREME-S: Evaluating Cross-lingual Speech Representationscited by 22
  5. 2022GigaST: A 10,000-hour Pseudo Speech Translation Corpuscited by 20
  6. 2024Speech-MASSIVE: A Multilingual Speech Dataset for SLU and Beyondcited by 20
  7. 2023LeBenchmark 2.0: a Standardized, Replicable and Enhanced Framework for Self-supervised Representations of French Speechcited by 17
  8. 2022T-Modules: Translation Modules for Zero-Shot Cross-Modal Machine Translationcited by 16
  9. 2022BLASER: A Text-Free Speech-to-Speech Translation Evaluation Metriccited by 16
  10. 2023Lip Reading for Low-resource Languages by Learning and Combining General Speech Knowledge and Language-specific Knowledgecited by 16
  11. 2022A Study of Gender Impact in Self-supervised Models for Speech-to-Text Systemscited by 14
  12. 2023AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representationcited by 14
  13. 2023Visual Speech Recognition for Languages with Limited Labeled Data using Automatic Labels from Whispercited by 13
  14. 2024MOSEL: 950,000 Hours of Speech Data for Open-Source Speech Foundation Model Training on EU Languagescited by 13
  15. 2023Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translationcited by 11
  16. 2022ASR data augmentation in low-resource settings using cross-lingual multi-speaker TTS and cross-lingual voice conversioncited by 10
  17. 2022LAMASSU: Streaming Language-Agnostic Multilingual Speech Recognition and Translation Using Neural Transducerscited by 10
  18. 2023End-to-End Evaluation for Low-Latency Simultaneous Speech Translationcited by 10
  19. 2023NAVER LABS Europe's Multilingual Speech Translation Systems for the IWSLT 2023 Low-Resource Trackcited by 9
  20. 2023End-to-End Speech-to-Text Translation: A Surveycited by 9
  21. 2024MSR-86K: An Evolving, Multilingual Corpus with 86,300 Hours of Transcribed Audio for Speech Recognition Researchcited by 9
  22. 2025Zero-AVSR: Zero-Shot Audio-Visual Speech Recognition with LLMs by Learning Language-Agnostic Speech Representationscited by 9
  23. 2022Don't Discard Fixed-Window Audio Segmentation in Speech-to-Text Translationcited by 8
  24. 2022Improving Speech-to-Speech Translation Through Unlabeled Textcited by 8
  25. 2024Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representationcited by 8
  26. 2021Scribosermo: Fast Speech-to-Text models for German and other Languagescited by 7
  27. 2021FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Taskcited by 6
  28. 2021CORAA: a large corpus of spontaneous and prepared speech manually validated for speech recognition in Brazilian Portuguesecited by 6
  29. 2022SegAugment: Maximizing the Utility of Speech Translation Data with Segmentation-based Augmentationscited by 6
  30. 2023Automatic Disfluency Detection from Untranscribed Speechcited by 6
  31. 2025SENSE models: an open source solution for multilingual and multimodal semantic-based taskscited by 6
  32. 2021Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modelingcited by 5
  33. 2022Unified Multimodal Punctuation Restoration Framework for Mixed-Modality Corpuscited by 5
  34. 2023Learning Cross-lingual Visual Speech Representationscited by 5
  35. 2023Towards cross-language prosody transfer for dialogcited by 5
  36. 2023On-the-Fly Fusion of Large Language Models and Machine Translationcited by 5
  37. 2023The Interpreter Understands Your Meaning: End-to-end Spoken Language Understanding Aided by Speech Translationcited by 4
  38. 2024Towards Building Large Scale Datasets and State-of-the-Art Automatic Speech Translation Systems for 14 Indian Languagescited by 4

50 most cited of 101 All 101 (JSON)