mlsanityData to 7 Oct 2026

YODAS: Youtube-Oriented Dataset for Audio and Speech

arXiv 2406.00899 ↗First posted 2 Jun 2024cs.CL cs.SD eess.AScited by 56

Not on the map. Why?

Abstract (arXiv)

In this study, we introduce YODAS (YouTube-Oriented Dataset for Audio and Speech), a large-scale, multilingual dataset comprising currently over 500k hours of speech data in more than 100 languages, sourced from both labeled and unlabeled YouTube speech datasets. The labeled subsets, including manual or automatic subtitles, facilitate supervised model training. Conversely, the unlabeled subsets are apt for self-supervised learning applications. YODAS is distinctive as the first publicly available dataset of its scale, and it is distributed under a Creative Commons license. We introduce the collection methodology utilized for YODAS, which contributes to the large-scale speech dataset construction. Subsequently, we provide a comprehensive analysis of speech, text contained within the dataset. Finally, we describe the speech recognition baselines over the top-15 languages.

Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). Builds on 26 of its 33 references that are in the map. First posted on arXiv 2 Jun 2024.

Builds on

26 of 33 references.

References · 26

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  3. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  4. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  5. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  6. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  7. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  8. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  9. 2013Speech Recognition with Deep Recurrent Neural Networkscited by 666
  10. 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 652
  11. 2018Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidatescited by 632
  12. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
14 more
  1. 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
  2. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 467
  3. 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 462
  4. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  5. 2023Scaling Speech Technology to 1,000+ Languagescited by 401
  6. 2022Self-Supervised Speech Representation Learning: A Reviewcited by 258
  7. 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 228
  8. 2023End-to-End Speech Recognition: A Surveycited by 127
  9. 2020VoxLingua107: a Dataset for Spoken Language Recognitioncited by 118
  10. 2021Scaling Laws for Neural Machine Translationcited by 110
  11. 2020Universal Phone Recognition with a Multilingual Allophone Systemcited by 81
  12. 2020CTC-Segmentation of Large Corpora for German End-to-end Speech Recognitioncited by 75
  13. 2016Wav2Letter: an End-to-End ConvNet-based Speech Recognition Systemcited by 43
  14. 2021JTubeSpeech: corpus of Japanese speech collected from YouTube for speech recognition and speaker verificationcited by 21

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 26; 2026: 24.

56 papers.

Sort:

By area:

  1. 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 48
  2. 2024Consent in Crisis: The Rapid Decline of the AI Data Commonscited by 45
  3. 2024Distilling an End-to-End Voice Assistant Without Instruction Training Datacited by 35
  4. 2024GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinementcited by 34
  5. 2025OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaningcited by 27
  6. 2025Granary: Speech Recognition and Translation Dataset in 25 European Languagescited by 21
  7. 2025Emilia: A Large-Scale, Extensive, Multilingual, and Diverse Dataset for Speech Generationcited by 19
  8. 2025Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Aheadcited by 15
  9. 2025CS-FLEURS: A Massively Multilingual and Code-Switched Speech Datasetcited by 11
  10. 2024Enhancing Low-Resource Language and Instruction Following Capabilities of Audio Language Modelscited by 10
  11. 2025GLAP: General contrastive audio-text pretraining across domains and languagescited by 10
  12. 2026WAXAL: A Large-Scale Multilingual African Language Speech Corpuscited by 10
38 more
  1. 2025ESPnet-SpeechLM: An Open Speech Language Model Toolkitcited by 9
  2. 2025Loquacious Set: 25,000 Hours of Transcribed and Diverse English Speech Recognition Data for Research and Commercial Usecited by 9
  3. 2025OpusLM: A Family of Open Unified Speech Language Modelscited by 9
  4. 2025Dolphin: A Large-Scale Automatic Speech Recognition Model for Eastern Languagescited by 8
  5. 2025SeaLLMs-Audio: Large Audio-Language Models for Southeast Asiacited by 7
  6. 2026The Silent Thought: Modeling Internal Cognition in Full-Duplex Spoken Dialogue Models via Latent Reasoningcited by 5
  7. 2025OLMoASR: Open Models and Data for Training Robust Speech Recognition Modelscited by 4
  8. 2025StableToken: A Noise-Robust Semantic Speech Tokenizer for Resilient SpeechLLMscited by 4
  9. 2025Whale: Large-Scale multilingual ASR model with w2v-BERT and E-Branchformer with large speech datacited by 3
  10. 2025EuroSpeech: A Multilingual Speech Corpuscited by 3
  11. 2026Scaling Open Discrete Audio Foundation Models with Interleaved Semantic, Acoustic, and Text Tokenscited by 3
  12. 2026DuplexChat: Constructing Speaker-Separated Full-Duplex Dialogue Speech at Scale for Spoken Dialogue Language Modelingcited by 3
  13. 2025Grapheme-Coherent Phonemic and Prosodic Annotation of Speech by Implicit and Explicit Grapheme Conditioningcited by 2
  14. 2025CAM~OES: A Comprehensive Automatic Speech Recognition Benchmark for European Portuguesecited by 2
  15. 2025Thai Semantic End-of-Turn Detection for Real-Time Voice Agentscited by 2
  16. 2025Extending Audio Context for Long-Form Understanding in Large Audio-Language Modelscited by 2
  17. 2025NaturalVoices: A Large-Scale, Spontaneous and Emotional Podcast Dataset for Voice Conversioncited by 2
  18. 2024Enhancing Large Language Model-based Speech Recognition by Contextualization for Rare and Ambiguous Wordscited by 1
  19. 2025ILT-Iterative LoRA Training through Focus-Feedback-Fix for Multilingual Speech Recognitioncited by 1
  20. 2026Language-Aware Distillation for Multilingual Instruction-Following Speech LLMs with ASR-Only Supervisioncited by 1
  21. 2026Hierarchical Policy Optimization for Simultaneous Translation of Unbounded Speechcited by 1
  22. 2026How to Recognize New Words: A Comparison Between Context Biasing Methods and Speech LLMscited by 1
  23. 2025TEDI: Trustworthy and Ethical Dataset Indicators to Analyze and Compare Dataset Documentationcited by 0
  24. 2025Context Biasing for Pronunciation-Orthography Mismatch in Automatic Speech Recognitioncited by 0
  25. 2025Whilter: A Whisper-based Data Filter for "In-the-Wild" Speech Corpora Using Utterance-level Multi-Task Classificationcited by 0
  26. 2025BiRQ: Bi-Level Self-Labeling Random Quantization for Self-Supervised Speech Recognitioncited by 0
  27. 2025WolBanking77: Wolof Banking Speech Intent Classification Datasetcited by 0
  28. 2026Measuring the Redundancy of Decoder Layers in SpeechLLMscited by 0
  29. 2026Modeling Overlapped Speech with Shufflescited by 0
  30. 2026Beyond Transcription: Unified Audio Schema for Perception-Aware AudioLLMscited by 0
  31. 2026WorldSpeech: A Multilingual Speech Corpus from Around the Worldcited by 0
  32. 2026FalAR: A Large-scale Speaker-Annotated European Portuguese Speech Corpus of Parliamentary Sessionscited by 0
  33. 2026UniAudio-Token: Empowering Semantic Speech Tokenizers with General Audio Perceptioncited by 0
  34. 2026Improving Large-Scale Weakly Supervised ASR by Filtering and Selectioncited by 0
  35. 2026Empowering Long-form Omni-modal Understanding with Robust Audio Perceptioncited by 0
  36. 2026GigaAM Multilingual: Foundation Model for Underrepresented Languagescited by 0
  37. 2026GigaChat Audio: Time-aware Large Audio Language Modelcited by 0
  38. 2026AfriSwitch: A Benchmark for In-the-Wild African Code-Switched Speech Recognitioncited by 0

50 most cited of 56 All 56 (JSON)