mlsanityData to 7 Oct 2026

CoVoST 2 and Massively Multilingual Speech-to-Text Translation

arXiv 2007.10310 ↗First posted 20 Jul 2020cs.CL cs.SD eess.AScited by 73

Not on the map. Why?

Abstract (arXiv)

Speech translation has recently become an increasingly popular topic of research, partly due to the development of benchmark datasets. Nevertheless, current datasets cover a limited number of languages. With the aim to foster research in massive multilingual speech translation and speech translation for low resource language pairs, we release CoVoST 2, a large-scale multilingual speech translation corpus covering translations from 21 languages into English and from English into 15 languages. This represents the largest open dataset available to date from total volume and language coverage perspective. Data sanity checks provide evidence about the quality of the data, which is released under CC0 license. We also provide extensive speech recognition, bilingual and multilingual machine translation and speech translation baselines with open-source implementation.

Key facts. Cited by 73 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Jul 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 12; 2022: 8; 2023: 11; 2024: 14; 2025: 16; 2026: 12.

73 papers.

Sort:

By area:

  1. 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 591
  2. 2024Qwen2-Audio Technical Reportcited by 543
  3. 2023AudioPaLM: A Large Language Model That Can Speak and Listencited by 333
  4. 2023On decoder-only architecture for speech-to-text and large language model integrationcited by 144
  5. 2021Textless Speech-to-Speech Translation on Real Datacited by 121
  6. 2021The Multilingual TEDx Corpus for Speech Recognition and Translationcited by 101
  7. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 89
  8. 2022SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilitiescited by 76
  9. 2021Translatotron 2: High-quality direct speech-to-speech translation with voice preservationcited by 69
  10. 2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 62
  11. 2023Prompting the Hidden Talent of Web-Scale Speech Models for Zero-Shot Task Generalizationcited by 43
  12. 2024A Large-Scale Evaluation of Speech Foundation Modelscited by 38
38 more
  1. 2024Distilling an End-to-End Voice Assistant Without Instruction Training Datacited by 35
  2. 2024OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identificationcited by 34
  3. 2021Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translationcited by 27
  4. 2025InteractiveOmni: A Unified Omni-modal Model for Audio-Visual Multi-turn Dialoguecited by 27
  5. 2021Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Taskscited by 24
  6. 2023DecoderLens: Layerwise Interpretation of Encoder-Decoder Transformerscited by 22
  7. 2025Open ASR Leaderboard: Towards Reproducible and Transparent Multilingual and Long-Form Speech Recognition Evaluationcited by 21
  8. 2024StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learningcited by 20
  9. 2024Speech-MASSIVE: A Multilingual Speech Dataset for SLU and Beyondcited by 20
  10. 2025M2-omni: Advancing Omni-MLLM for Comprehensive Modality Support with Competitive Performancecited by 19
  11. 2021BSTC: A Large-Scale Chinese-English Speech Translation Datasetcited by 16
  12. 2021End-to-End Speech Translation with Pre-trained Models and Adapters: UPC at IWSLT 2021cited by 16
  13. 2022T-Modules: Translation Modules for Zero-Shot Cross-Modal Machine Translationcited by 16
  14. 2023Understanding and Bridging the Modality Gap for Speech Translationcited by 15
  15. 2025Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representationcited by 15
  16. 2024Towards Achieving Human Parity on End-to-end Simultaneous Speech Translation via LLM Agentcited by 14
  17. 2023DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translationcited by 9
  18. 2021An Approach to Improve Robustness of NLP Systems against ASR Errorscited by 8
  19. 2022Hierarchical Softmax for End-to-End Low-resource Multilingual Speech Recognitioncited by 7
  20. 2022Direct Speech Translation for Automatic Subtitlingcited by 7
  21. 2023KIT's Multilingual Speech Translation System for IWSLT 2023cited by 7
  22. 2024NeKo: Cross-Modality Post-Recognition Error Correction with Tasks-Guided Mixture-of-Experts Language Modelcited by 7
  23. 2021CORAA: a large corpus of spontaneous and prepared speech manually validated for speech recognition in Brazilian Portuguesecited by 6
  24. 2025Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMscited by 6
  25. 2021Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modelingcited by 5
  26. 2021Zero-shot Speech Translationcited by 5
  27. 2023Duplex Diffusion Models Improve Speech-to-Speech Translationcited by 5
  28. 2025NAVER LABS Europe Submission to the Instruction-following Trackcited by 5
  29. 2026UltraEval-Audio: A Unified Framework for Comprehensive Evaluation of Audio Foundation Modelscited by 5
  30. 2022Tackling data scarcity in speech translation using zero-shot multilingual machine translation techniquescited by 4
  31. 2023Towards Real-World Streaming Speech Translation for Code-Switched Speechcited by 4
  32. 2024Multi-Modal Retrieval For Large Language Model Based Speech Recognitioncited by 4
  33. 2024MathBridge: A Large Corpus Dataset for Translating Spoken Mathematical Expressions into LaTeX Formulas for Improved Readabilitycited by 4
  34. 2025KIT's Offline Speech Translation and Instruction Following Submission for IWSLT 2025cited by 4
  35. 2025Reshaping Representation Space to Balance the Safety and Over-rejection in Large Audio Language Modelscited by 4
  36. 2022The YiTrans End-to-End Speech Translation System for IWSLT 2022 Offline Shared Taskcited by 3
  37. 2022Joint Speech Transcription and Translation: Pseudo-Labeling with Out-of-Distribution Datacited by 3
  38. 2024Representation Purification for End-to-End Speech Translationcited by 3

50 most cited of 73 All 73 (JSON)