Data to 14 Oct 2026

CoVoST: A Diverse Multilingual Speech-To-Text Translation Corpus

arXiv 2002.01320 ↗First posted 4 Feb 2020cs.CLcited by 57

Not on the map. Why?

Abstract (arXiv)

Spoken language translation has recently witnessed a resurgence in popularity, thanks to the development of end-to-end models and the creation of new corpora, such as Augmented LibriSpeech and MuST-C. Existing datasets involve language pairs with English as a source language, involve very specific domains or are low resource. We introduce CoVoST, a multilingual speech-to-text translation corpus from 11 languages into English, diversified with over 11,000 speakers and over 60 accents. We describe the dataset creation methodology and provide empirical evidence of the quality of the data. We also provide initial benchmarks, including, to our knowledge, the first end-to-end many-to-one multilingual models for spoken language translation. CoVoST is released under CC0 license and free to use. We also provide additional evaluation data derived from Tatoeba under CC licenses.

Key facts. Cited by 57 papers in the map (data through 14 Oct 2026). First posted on arXiv 4 Feb 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 9; 2022: 16; 2023: 10; 2024: 7; 2025: 13; 2026: 2.

57 papers.

Sort:

By area:

2026Gemma 4 Technical Reportcited by 259
2024AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehensioncited by 220
2021The Multilingual TEDx Corpus for Speech Recognition and Translationcited by 101
2024WavChat: A Survey of Spoken Dialogue Modelscited by 90
2022CVSS Corpus and Massively Multilingual Speech-to-Speech Translationcited by 71
2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 66
2023MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translationcited by 39
2021Large-Scale Self- and Semi-Supervised Learning for Speech Translationcited by 36
2022SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translationscited by 35
2022SAMU-XLSR: Semantically-Aligned Multimodal Utterance-level Cross-Lingual Speech Representationcited by 32
2025InteractiveOmni: A Unified Omni-modal Model for Audio-Visual Multi-turn Dialoguecited by 29
2022End-to-End Speech Translation for Code Switched Speechcited by 26

38 more

2023Pre-training for Speech Translation: CTC Meets Optimal Transportcited by 25
2025Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representationcited by 17
2021BSTC: A Large-Scale Chinese-English Speech Translation Datasetcited by 16
2022T-Modules: Translation Modules for Zero-Shot Cross-Modal Machine Translationcited by 16
2023Recent Advances in Direct Speech-to-text Translationcited by 15
2022Efficient yet Competitive Speech Translation: FBK@IWSLT2022cited by 14
2024Towards Achieving Human Parity on End-to-end Simultaneous Speech Translation via LLM Agentcited by 14
2025SeqPO-SiMT: Sequential Policy Optimization for Simultaneous Machine Translationcited by 13
2022Non-Parametric Domain Adaptation for End-to-End Speech Translationcited by 12
2021Is "moby dick" a Whale or a Bird? Named Entities and Terminology in Speech Translationcited by 11
2023BIG-C: a Multimodal Multi-Purpose Dataset for Bembacited by 9
2023End-to-End Speech-to-Text Translation: A Surveycited by 9
2025Mind the Gap! Static and Interactive Evaluations of Large Audio Modelscited by 8
2022Hierarchical Softmax for End-to-End Low-resource Multilingual Speech Recognitioncited by 7
2025Reshaping Representation Space to Balance the Safety and Over-rejection in Large Audio Language Modelscited by 7
2021Dealing with training and test segmentation mismatch: FBK@IWSLT2021cited by 6
2021FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Taskcited by 6
2021CORAA: a large corpus of spontaneous and prepared speech manually validated for speech recognition in Brazilian Portuguesecited by 6
2022Discrete Cross-Modal Alignment Enables Zero-Shot Speech Translationcited by 6
2022Make More of Your Data: Minimal Effort Data Augmentation for Automatic Speech Recognition and Translationcited by 6
2022SegAugment: Maximizing the Utility of Speech Translation Data with Segmentation-based Augmentationscited by 6
2023Tagged End-to-End Simultaneous Speech Translation Training using Simultaneous Interpretation Datacited by 6
2024SPES: Spectrogram Perturbation for Explainable Speech-to-Text Generationcited by 6
2022An Analysis of Semantically-Aligned Speech-Text Embeddingscited by 5
2023Jointly Optimizing Translations and Speech Timing to Improve Isochrony in Automatic Dubbingcited by 5
2023Inter-connection: Effective Connection between Pre-trained Encoder and Decoder for Speech Translationcited by 3
2024FFSTC: Fongbe to French Speech Translation Corpuscited by 3
2022Prabhupadavani: A Code-mixed Speech Translation Data for 25 Languagescited by 2
2022A High-Quality and Large-Scale Dataset for English-Vietnamese Speech Translationcited by 2
2023Improved Cross-Lingual Transfer Learning For Automatic Speech Translationcited by 2
2023End-to-End Single-Channel Speaker-Turn Aware Conversational Speech Translationcited by 2
2024LeaPformer: Enabling Linear Transformers for Autoregressive and Simultaneous Tasks via Learned Proportionscited by 2
2025Inclusivity of AI Speech in Healthcare: A Decade Look Backcited by 2
2025CS3-Bench: Evaluating and Enhancing Speech-to-Speech LLMs for Mandarin-English Code-Switchingcited by 2
2022Bringing NURC/SP to Digital Life: the Role of Open-source Automatic Speech Recognition Modelscited by 1
2024NAIST Simultaneous Speech Translation System for IWSLT 2024cited by 1
2025Miipher-2: A Universal Speech Restoration Model for Million-Hour Scale Data Restorationcited by 1
2021The HW-TSC's Offline Speech Translation Systems for IWSLT 2021 Evaluationcited by 0

50 most cited of 57 All 57 (JSON)