mlsanityData to 14 Oct 2026

YODAS v3: Over 1 Million Hours of High-Bandwidth, Stereophonic, Multilingual Speech

arXiv 2609.29448 ↗First posted 24 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

We present YODAS v3, a weakly-labeled speech corpus containing over 1.1 million hours of 48kHz multi-channel audio in 147 languages, released under a CC BY 3.0 license. YODAS v3 is not only the largest open speech dataset to date, but also the first truly large-scale speech corpus with high-fidelity stereo audio. We first provide the collection methodology for the corpus, where we introduce new techniques for gathering language-balanced speech data. The effectiveness of our approach is shown by the language distribution of the crawled data: 22 languages in YODAS v3 have over 10K hours and 73 languages have over 5K hours of data. We then conduct extensive analyses on the composition of the data, such as the distribution of languages, audio quality, and transcription quality. Finally, we train baseline speech recognition and neural codec models to show the effectiveness of the dataset. Download at https://huggingface.co/datasets/espnet/yodas3.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 45 references that are in the map. First posted on arXiv 24 Sep 2026.

Builds on

42 of 45 references.

References · 42

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  3. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  4. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  5. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 649
  6. 2018Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidatescited by 639
  7. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
  8. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
  9. 2024Qwen2-Audio Technical Reportcited by 560
  10. 2018ESPnet: End-to-End Speech Processing Toolkitcited by 558
  11. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 476
  12. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
30 more
  1. 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 467
  2. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 463
  3. 2023High-Fidelity Audio Compression with Improved RVQGANcited by 431
  4. 2023Scaling Speech Technology to 1,000+ Languagescited by 411
  5. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 399
  6. 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 231
  7. 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 204
  8. 2023Seamless: Multilingual Expressive and Streaming Speech Translationcited by 192
  9. 2023SeamlessM4T: Massively Multilingual & Multimodal Machine Translationcited by 125
  10. 2020VoxLingua107: a Dataset for Spoken Language Recognitioncited by 122
  11. 2024mHuBERT-147: A Compact Multilingual HuBERT Modelcited by 66
  12. 2024YODAS: Youtube-Oriented Dataset for Audio and Speechcited by 60
  13. 2025Canary-1B-v2 & Parakeet-TDT-0.6B-v3: Efficient and High-Performance Models for Multilingual ASR and ASTcited by 60
  14. 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 50
  15. 2023Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Datacited by 42
  16. 2025Discrete Audio Tokens: More Than a Survey!cited by 38
  17. 2024BAT: Learning to Reason about Spatial Sounds with Large Language Modelscited by 36
  18. 2025Omnilingual ASR: Open-Source Multilingual Speech Recognition for 1600+ Languagescited by 34
  19. 2024VERSA: A Versatile Evaluation Toolkit for Speech, Audio, and Musiccited by 30
  20. 2025SAM Audio: Segment Anything in Audiocited by 30
  21. 2025OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaningcited by 27
  22. 2024ESPnet-Codec: Comprehensive Training and Evaluation of Neural Codecs for Audio, Music, and Speechcited by 26
  23. 2023The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarioscited by 22
  24. 2025OWLS: Scaling Laws for Multilingual Speech Recognition and Translation Modelscited by 17
  25. 2025OpusLM: A Family of Open Unified Speech Language Modelscited by 9
  26. 2026Bagpiper: Solving Open-Ended Audio Tasks via Rich Captionscited by 4
  27. 2026AudioChat: Unified Audio Storytelling, Editing, and Understanding with Transfusion Forcingcited by 4
  28. 2025Lessons Learned from the URGENT 2024 Speech Enhancement Challengecited by 3
  29. 2025Recent Trends in Distant Conversational Speech Recognition: A Review of CHiME-7 and 8 DASR Challengescited by 2
  30. 2025SpeakEasy: Enhancing Text-to-Speech Interactions for Expressive Content Creationcited by 1

Built on by

Not cited yet.