MSR-86K: An Evolving, Multilingual Corpus with 86,300 Hours of Transcribed Audio for Speech Recognition Research
Not on the map. Why?
Abstract (arXiv)
Recently, multilingual artificial intelligence assistants, exemplified by ChatGPT, have gained immense popularity. As a crucial gateway to human-computer interaction, multilingual automatic speech recognition (ASR) has also garnered significant attention, as evidenced by systems like Whisper. However, the proprietary nature of the training data has impeded researchers' efforts to study multilingual ASR. This paper introduces MSR-86K, an evolving, large-scale multilingual corpus for speech recognition research. The corpus is derived from publicly accessible videos on YouTube, comprising 15 languages and a total of 86,300 hours of transcribed ASR data. We also introduce how to use the MSR-86K corpus and other open-source corpora to train a robust multilingual ASR model that is competitive with Whisper. MSR-86K will be publicly released on HuggingFace, and we believe that such a large corpus will pave new avenues for research in multilingual ASR.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 25 of its 38 references that are in the map. First posted on arXiv 26 Jun 2024.
Builds on
25 of 38 references.
References · 25
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
- 2015Listen, Attend and Spellcited by 543
- 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 476
- 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 463
- 2023Scaling Speech Technology to 1,000+ Languagescited by 411
- 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 399
- 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 373
- 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 231
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 197
- 2018AISHELL-2: Transforming Mandarin ASR Research Into Industrial Scalecited by 128
13 more
- 2019Europarl-ST: A Multilingual Corpus For Speech Translation Of Parliamentary Debatescited by 114
- 2021The Multilingual TEDx Corpus for Speech Recognition and Translationcited by 101
- 2021The People's Speech: A Large-Scale Diverse English Speech Recognition Dataset for Commercial Usagecited by 101
- 2020CTC-Segmentation of Large Corpora for German End-to-end Speech Recognitioncited by 76
- 2022CVSS Corpus and Massively Multilingual Speech-to-Speech Translationcited by 71
- 2015THCHS-30 : A Free Chinese Speech Corpuscited by 43
- 2021QASR: QCRI Aljazeera Speech Resource -- A Large Scale Annotated Arabic Speech Corpuscited by 38
- 2021JTubeSpeech: corpus of Japanese speech collected from YouTube for speech recognition and speaker verificationcited by 21
- 2022TALCS: An Open-Source Mandarin-English Code-Switching Corpus and a Speech Recognition Baselinecited by 17
- 2021Golos: Russian Dataset for Speech Researchcited by 9
- 2020Exploration of End-to-End ASR for OpenSTT -- Russian Open Speech-to-Text Datasetcited by 6
- 2018Pansori: ASR Corpus Generation from Open Online Video Contentscited by 3
- 2023ASR Bundestag: A Large-Scale political debate dataset in Germancited by 1
Built on by
Citing papers per year: 2025: 4; 2026: 5.
9 papers.
- 2025OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaningcited by 27
- 2025EuroSpeech: A Multilingual Speech Corpuscited by 4
- 2025SHNU Multilingual Conversational Speech Recognition System for INTERSPEECH 2025 MLC-SLM Challengecited by 1
- 2026A Language-Agnostic Hierarchical LoRA-MoE Architecture for CTC-based Multilingual ASRcited by 1
- 2026Zipper-LoRA: Dynamic Parameter Decoupling for Speech-LLM based Multilingual Speech Recognitioncited by 1
- 2026Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMscited by 1
- 2026WorldSpeech: A Multilingual Speech Corpus from Around the Worldcited by 1
- 2025Transsion Multilingual Speech Recognition System for MLC-SLM 2025 Challengecited by 0
- 2026BuzzASR: A Swarm of 100+ Monolingual Speech Recognition Modelscited by 0
- 2026BuzzASR: A Swarm of 100+ Monolingual Speech Recognition Models9 Sep 2026
- 2026WorldSpeech: A Multilingual Speech Corpus from Around the World9 May 2026
- 2026Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMs9 Apr 2026
- 2026Zipper-LoRA: Dynamic Parameter Decoupling for Speech-LLM based Multilingual Speech Recognition18 Mar 2026
- 2026A Language-Agnostic Hierarchical LoRA-MoE Architecture for CTC-based Multilingual ASR2 Jan 2026
- 2025EuroSpeech: A Multilingual Speech Corpus1 Oct 2025
- 2025Transsion Multilingual Speech Recognition System for MLC-SLM 2025 Challenge15 Aug 2025
- 2025SHNU Multilingual Conversational Speech Recognition System for INTERSPEECH 2025 MLC-SLM Challenge4 Jul 2025
- 2025OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaning31 May 2025