mlsanityData to 7 Oct 2026

The People's Speech: A Large-Scale Diverse English Speech Recognition Dataset for Commercial Usage

arXiv 2111.09344 ↗First posted 17 Nov 2021cs.LG stat.MLcited by 98

Not on the map. Why?

Abstract (arXiv)

The People's Speech is a free-to-download 30,000-hour and growing supervised conversational English speech recognition dataset licensed for academic and commercial usage under CC-BY-SA (with a CC-BY subset). The data is collected via searching the Internet for appropriately licensed audio data with existing transcriptions. We describe our data collection methodology and release our data collection system under the Apache 2.0 license. We show that a model trained on this dataset achieves a 9.98% word error rate on Librispeech's test-clean test set.Finally, we discuss the legal and ethical issues surrounding the creation of a sizable machine learning corpora and plans for continued maintenance of the project under MLCommons's sponsorship.

Key facts. Cited by 98 papers in the map (data through 7 Oct 2026). Builds on 11 of its 35 references that are in the map. First posted on arXiv 17 Nov 2021.

Builds on

11 of 35 references.

References · 11

  1. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  2. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 467
  3. 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 462
  4. 2015Deep Speech 2: End-to-End Speech Recognition in English and Mandarincited by 449
  5. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 391
  6. 2019pyannote.audio: neural building blocks for speaker diarizationcited by 175
  7. 2019QuartzNet: Deep Automatic Speech Recognition with 1D Time-Channel Separable Convolutionscited by 93
  8. 2021Earnings-21: A Practical Benchmark for ASR in the Wildcited by 60
  9. 2020Large scale weakly and semi-supervised learning for low-resource video ASRcited by 7
  10. 2021Data Engineering for Everyonecited by 5
  11. 2019GPU-Accelerated Viterbi Exact Lattice Decoder for Batched Online and Offline Speech Recognitioncited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 7; 2023: 13; 2024: 23; 2025: 31; 2026: 23.

98 papers.

Sort:

By area:

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  2. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
  3. 2024AudioBench: A Universal Benchmark for Audio Large Language Modelscited by 124
  4. 2023Textually Pretrained Speech Language Modelscited by 99
  5. 2023EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesiscited by 93
  6. 2023Spoken Question Answering and Speech Continuation Using Spectrogram-Powered LLMcited by 92
  7. 2024WavChat: A Survey of Spoken Dialogue Modelscited by 88
  8. 2023Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labellingcited by 87
  9. 2024Recent Advances in Speech Language Models: A Surveycited by 85
  10. 2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 62
  11. 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 48
  12. 2024Distilling an End-to-End Voice Assistant Without Instruction Training Datacited by 35
38 more
  1. 2024GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinementcited by 34
  2. 2024Scaling Properties of Speech Language Modelscited by 30
  3. 2025VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Modelcited by 30
  4. 2025OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaningcited by 27
  5. 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Datacited by 21
  6. 2022SPIRAL: Self-supervised Perturbation-Invariant Representation Learning for Speech Pre-Trainingcited by 19
  7. 2022Adaptive Sampling Strategies to Construct Equitable Training Datasetscited by 18
  8. 2022ESB: A Benchmark For Multi-Domain End-to-End Speech Recognitioncited by 18
  9. 2022TALCS: An Open-Source Mandarin-English Code-Switching Corpus and a Speech Recognition Baselinecited by 17
  10. 2024Moonshine: Speech Recognition for Live Transcription and Voice Commandscited by 17
  11. 2025Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representationcited by 15
  12. 2024Paralinguistics-Aware Speech-Empowered Large Language Models for Natural Conversationcited by 14
  13. 2025SIFT-50M: A Large-Scale Multilingual Dataset for Speech Instruction Fine-Tuningcited by 14
  14. 2024MOSEL: 950,000 Hours of Speech Data for Open-Source Speech Foundation Model Training on EU Languagescited by 13
  15. 2025Scaling Analysis of Interleaved Speech-Text Language Modelscited by 13
  16. 2025Nexus: An Omni-Perceptive And -Interactive Model for Language, Audio, And Visioncited by 12
  17. 2025Slamming: Training a Speech Language Model on One GPU in a Daycited by 11
  18. 2025Evaluating Robustness of Large Audio Language Models to Audio Injection: An Empirical Studycited by 11
  19. 2022Speech Aware Dialog System Technology Challenge (DSTC11)cited by 10
  20. 2023WSPAlign: Word Alignment Pre-training via Large-Scale Weakly Supervised Span Predictioncited by 10
  21. 2023Speech-to-Text Adapter and Speech-to-Entity Retriever Augmented LLMs for Speech Understandingcited by 9
  22. 2023Pre-trained Speech Processing Models Contain Human-Like Biases that Propagate to Speech Emotion Recognitioncited by 9
  23. 2024MSR-86K: An Evolving, Multilingual Corpus with 86,300 Hours of Transcribed Audio for Speech Recognition Researchcited by 9
  24. 2025Loquacious Set: 25,000 Hours of Transcribed and Diverse English Speech Recognition Data for Research and Commercial Usecited by 9
  25. 2026Omni-Diffusion: Unified Multimodal Understanding and Generation with Masked Discrete Diffusioncited by 9
  26. 2023MASTERKEY: Practical Backdoor Attack Against Speaker Verification Systemscited by 8
  27. 2024Multi-Dialect Vietnamese: Task, Dataset, Baseline Models and Challengescited by 6
  28. 2024VoiceTextBlender: Augmenting Large Language Models with Speech Capabilities via Single-Stage Joint Speech-Text Supervised Fine-Tuningcited by 6
  29. 2023Zero-Shot End-to-End Spoken Language Understanding via Cross-Modal Selective Self-Trainingcited by 5
  30. 2023LanSER: Language-Model Supported Speech Emotion Recognitioncited by 5
  31. 2024Exploring the limits of decoder-only models trained on public speech recognition corporacited by 5
  32. 2025Flow-SLM: Joint Learning of Linguistic and Acoustic Information for Spoken Language Modelingcited by 5
  33. 2026UltraEval-Audio: A Unified Framework for Comprehensive Evaluation of Audio Foundation Modelscited by 5
  34. 2024Exploring the Benefits of Tokenization of Discrete Acoustic Unitscited by 4
  35. 2024Multi-Modal Retrieval For Large Language Model Based Speech Recognitioncited by 4
  36. 2024The Greek podcast corpus: Competitive speech models for low-resourced languages with weakly supervised datacited by 4
  37. 2024MERaLiON-SpeechEncoder: Towards a Speech Foundation Model for Singapore and Beyondcited by 4
  38. 2025OLMoASR: Open Models and Data for Training Robust Speech Recognition Modelscited by 4

50 most cited of 98 All 98 (JSON)