mlsanityData to 7 Oct 2026

MLS: A Large-Scale Multilingual Dataset for Speech Research

arXiv 2012.03411 ↗First posted 7 Dec 2020eess.AS cs.CL cs.SDcited by 467

Not on the map. Why?

Abstract (arXiv)

This paper introduces Multilingual LibriSpeech (MLS) dataset, a large multilingual corpus suitable for speech research. The dataset is derived from read audiobooks from LibriVox and consists of 8 languages, including about 44.5K hours of English and a total of about 6K hours for other languages. Additionally, we provide Language Models (LM) and baseline Automatic Speech Recognition (ASR) models and for all the languages in our dataset. We believe such a large transcribed dataset will open new avenues in ASR and Text-To-Speech (TTS) research. The dataset will be made freely available for anyone at http://www.openslr.org.

Key facts. Cited by 467 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Dec 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 24; 2022: 48; 2023: 63; 2024: 111; 2025: 131; 2026: 90.

467 papers.

Sort:

By area:

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  2. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
  3. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  4. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 455
  5. 2023Scaling Speech Technology to 1,000+ Languagescited by 401
  6. 2023AudioPaLM: A Large Language Model That Can Speak and Listencited by 333
  7. 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 277
  8. 2022Self-Supervised Speech Representation Learning: A Reviewcited by 258
  9. 2023NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizerscited by 233
  10. 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 228
  11. 2024AnyGPT: Unified Multimodal LLM with Discrete Sequence Modelingcited by 213
  12. 2025Kimi-Audio Technical Reportcited by 210
38 more
  1. 2024Mini-Omni: Language Models Can Hear, Talk While Thinking in Streamingcited by 204
  2. 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 200
  3. 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 189
  4. 2021A Survey on Neural Speech Synthesiscited by 182
  5. 2022Self-supervised Learning with Random-projection Quantizer for Speech Recognitioncited by 158
  6. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
  7. 2021Unsupervised Speech Recognitioncited by 147
  8. 2023Prompting Large Language Models with Speech Recognition Abilitiescited by 139
  9. 2023Scaling Laws for Generative Mixed-Modal Language Modelscited by 131
  10. 2024Spirit LM: Interleaved Spoken and Written Language Modelcited by 123
  11. 2023Audiobox: Unified Audio Generation with Natural Language Promptscited by 120
  12. 2025Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokenscited by 109
  13. 2022mSLAM: Massively multilingual joint pre-training for speech and textcited by 108
  14. 2023Textually Pretrained Speech Language Modelscited by 99
  15. 2021The People's Speech: A Large-Scale Diverse English Speech Recognition Dataset for Commercial Usagecited by 98
  16. 2022Visual Speech Recognition for Multiple Languages in the Wildcited by 94
  17. 2023EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesiscited by 93
  18. 2024ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scalecited by 88
  19. 2024WavChat: A Survey of Spoken Dialogue Modelscited by 88
  20. 2023SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Modelscited by 85
  21. 2024Recent Advances in Speech Language Models: A Surveycited by 85
  22. 2021Simple and Effective Zero-shot Cross-lingual Phoneme Recognitioncited by 79
  23. 2022MAESTRO: Matched Speech Text Representations through Modality Matchingcited by 79
  24. 2024Croissant: A Metadata Format for ML-Ready Datasetscited by 79
  25. 2024OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformercited by 74
  26. 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 73
  27. 2023Voxtlm: unified decoder-only models for consolidating speech recognition/synthesis and speech/text continuation taskscited by 71
  28. 2023ML-SUPERB: Multilingual Speech Universal PERformance Benchmarkcited by 70
  29. 2025Llasa: Scaling Train-Time and Inference-Time Compute for Llama-based Speech Synthesiscited by 69
  30. 2021Including Signed Languages in Natural Language Processingcited by 67
  31. 2024Natural language guidance of high-fidelity text-to-speech with synthetic annotationscited by 66
  32. 2024mHuBERT-147: A Compact Multilingual HuBERT Modelcited by 64
  33. 2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 62
  34. 2021Scaling End-to-End Models for Large-Scale Multilingual ASRcited by 61
  35. 2022UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Unitscited by 60
  36. 2023AudioChatLlama: Towards General-Purpose Speech Abilities for LLMscited by 59
  37. 2024OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversationcited by 57
  38. 2023Efficient Sequence Transduction by Jointly Predicting Tokens and Durationscited by 56

50 most cited of 467 All 467 (JSON)