mlsanityData to 7 Oct 2026

MOSEL: 950,000 Hours of Speech Data for Open-Source Speech Foundation Model Training on EU Languages

arXiv 2410.01036 ↗First posted 1 Oct 2024cs.CL cs.AI cs.SDcited by 13

Not on the map. Why?

Abstract (arXiv)

The rise of foundation models (FMs), coupled with regulatory efforts addressing their risks and impacts, has sparked significant interest in open-source models. However, existing speech FMs (SFMs) fall short of full compliance with the open-source principles, even if claimed otherwise, as no existing SFM has model weights, code, and training data publicly available under open-source terms. In this work, we take the first step toward filling this gap by focusing on the 24 official languages of the European Union (EU). We collect suitable training data by surveying automatic speech recognition datasets and unlabeled speech corpora under open-source compliant licenses, for a total of 950k hours. Additionally, we release automatic transcripts for 441k hours of unlabeled data under the permissive CC-BY license, thereby facilitating the creation of open-source SFMs for the EU languages.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 42 of its 83 references that are in the map. First posted on arXiv 1 Oct 2024.

Builds on

42 of 83 references.

References · 42

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  5. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  6. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  7. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  8. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  9. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  10. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  11. 2018Speech Commands: A Dataset for Limited-Vocabulary Speech Recognitioncited by 741
  12. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
30 more
  1. 2018Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidatescited by 632
  2. 2019Green AIcited by 620
  3. 2024OLMo: Accelerating the Science of Language Modelscited by 599
  4. 2019Quantifying the Carbon Emissions of Machine Learningcited by 516
  5. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 467
  6. 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 462
  7. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  8. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 455
  9. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 391
  10. 2018TED-LIUM 3: twice as much data and corpus repartition for experiments on speaker adaptationcited by 224
  11. 2018How2: A Large-scale Dataset for Multimodal Language Understandingcited by 137
  12. 2023The Troubling Emergence of Hallucination in Large Language Models -- An Extensive Definition, Quantification, and Prescriptive Remediationscited by 130
  13. 2020VoxLingua107: a Dataset for Spoken Language Recognitioncited by 118
  14. 2019Europarl-ST: A Multilingual Corpus For Speech Translation Of Parliamentary Debatescited by 114
  15. 2021The Multilingual TEDx Corpus for Speech Recognition and Translationcited by 101
  16. 2021The People's Speech: A Large-Scale Diverse English Speech Recognition Dataset for Commercial Usagecited by 98
  17. 2021SPGISpeech: 5,000 hours of transcribed financial audio for fully formatted end-to-end speech recognitioncited by 77
  18. 2018Leveraging Weakly Supervised Data to Improve End-to-End Speech-to-Text Translationcited by 57
  19. 2019CSS10: A Collection of Single Speaker Speech Datasets for 10 Languagescited by 54
  20. 2023MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translationcited by 39
  21. 2019MaSS: A Large and Clean Multilingual Corpus of Sentence-aligned Spoken Utterances Extracted from the Biblecited by 24
  22. 2024The Model Openness Framework: Promoting Completeness and Openness for Reproducibility, Transparency, and Usability in Artificial Intelligencecited by 21
  23. 2021MediaSpeech: Multilanguage ASR Benchmark and Datasetcited by 17
  24. 2023When Good and Reproducible Results are a Giant with Feet of Clay: The Importance of Software Quality in NLPcited by 14
  25. 2024Risks and Opportunities of Open-Source Generative AIcited by 11
  26. 2020FT Speech: Danish Parliament Speech Corpuscited by 8
  27. 2019LibriVoxDeEn: A Corpus for German-to-English Speech Translation and German Speech Recognitioncited by 7
  28. 2020MASRI-HEADSET: A Maltese Corpus for Speech Recognitioncited by 4
  29. 2022BEA-Base: A Benchmark for ASR of Spontaneous Hungariancited by 2
  30. 2023SpokesBiz -- an Open Corpus of Conversational Polishcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 11; 2026: 2.

13 papers.

Sort:

  1. 2025Canary-1B-v2 & Parakeet-TDT-0.6B-v3: Efficient and High-Performance Models for Multilingual ASR and ASTcited by 51
  2. 2025OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaningcited by 27
  3. 2025Granary: Speech Recognition and Translation Dataset in 25 European Languagescited by 21
  4. 2025Common Corpus: The Largest Collection of Ethical Data for LLM Pre-Trainingcited by 19
  5. 2025Loquacious Set: 25,000 Hours of Transcribed and Diverse English Speech Recognition Data for Research and Commercial Usecited by 9
  6. 2025EuroSpeech: A Multilingual Speech Corpuscited by 3
  7. 2025FAMA: The First Large-Scale Open-Science Speech Foundation Model for English and Italiancited by 2
  8. 2025The German Commons - 154 Billion Tokens of Openly Licensed Text for German Language Modelscited by 2
  9. 2025The Warmup Dilemma: How Learning Rate Strategies Impact Speech-to-Text Model Convergencecited by 1
  10. 2025Cross-Attention is Half Explanation in Speech-to-Text Modelscited by 1
  11. 2025Automatic Speech Recognition for Greek Medical Dictationcited by 0
  12. 2026WorldSpeech: A Multilingual Speech Corpus from Around the Worldcited by 0
1 more
  1. 2026FalAR: A Large-scale Speaker-Annotated European Portuguese Speech Corpus of Parliamentary Sessionscited by 0