mlsanityData to 7 Oct 2026

VoxLingua107: a Dataset for Spoken Language Recognition

arXiv 2011.12998 ↗First posted 25 Nov 2020eess.AScited by 118

Not on the map. Why?

Abstract (arXiv)

This paper investigates the use of automatically collected web audio data for the task of spoken language recognition. We generate semi-random search phrases from language-specific Wikipedia data that are then used to retrieve videos from YouTube for 107 languages. Speech activity detection and speaker diarization are used to extract segments from the videos that contain speech. Post-filtering is used to remove segments from the database that are likely not in the given language, increasing the proportion of correctly labeled segments to 98%, based on crowd-sourced verification. The size of the resulting training set (VoxLingua107) is 6628 hours (62 hours per language on the average) and it is accompanied by an evaluation set of 1609 verified utterances. We use the data to build language recognition models for several spoken language identification tasks. Experiments show that using the automatically retrieved training data gives competitive results to using hand-labeled proprietary datasets. The dataset is publicly available.

Key facts. Cited by 118 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Nov 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 25; 2023: 23; 2024: 22; 2025: 20; 2026: 24.

118 papers.

Sort:

By area:

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  2. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
  3. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  4. 2023Scaling Speech Technology to 1,000+ Languagescited by 401
  5. 2022Self-Supervised Speech Representation Learning: A Reviewcited by 258
  6. 2023Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labelscited by 113
  7. 2022Visual Speech Recognition for Multiple Languages in the Wildcited by 94
  8. 2022MAESTRO: Matched Speech Text Representations through Modality Matchingcited by 79
  9. 2022HEAR: Holistic Evaluation of Audio Representationscited by 77
  10. 2024mHuBERT-147: A Compact Multilingual HuBERT Modelcited by 64
  11. 2022UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Unitscited by 60
  12. 2024YODAS: Youtube-Oriented Dataset for Audio and Speechcited by 56
38 more
  1. 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 48
  2. 2021QASR: QCRI Aljazeera Speech Resource -- A Large Scale Annotated Arabic Speech Corpuscited by 38
  3. 2022NusaCrowd: Open Source Initiative for Indonesian NLP Resourcescited by 38
  4. 2025Towards Holistic Evaluation of Large Audio-Language Models: A Comprehensive Surveycited by 38
  5. 2023AfriSpeech-200: Pan-African Accented Speech Dataset for Clinical and General Domain ASRcited by 34
  6. 2024GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinementcited by 34
  7. 2024Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gapscited by 24
  8. 2022XTREME-S: Evaluating Cross-lingual Speech Representationscited by 22
  9. 2023SynthVSR: Scaling Up Visual Speech Recognition With Synthetic Supervisioncited by 20
  10. 2023N-Shot Benchmarking of Whisper on Diverse Arabic Speech Recognitioncited by 20
  11. 2025ZIPA: A family of efficient models for multilingual phone recognitioncited by 18
  12. 2022Dubbing in Practice: A Large Scale Study of Human Localization With Insights for Automatic Dubbingcited by 17
  13. 2024AfriHuBERT: A self-supervised speech representation model for African languagescited by 17
  14. 2023Understanding and Bridging the Modality Gap for Speech Translationcited by 15
  15. 2025Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Aheadcited by 15
  16. 2023On the Robustness of Arabic Speech Dialect Identificationcited by 13
  17. 2024MOSEL: 950,000 Hours of Speech Data for Open-Source Speech Foundation Model Training on EU Languagescited by 13
  18. 2024The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resourcescited by 11
  19. 2026WAXAL: A Large-Scale Multilingual African Language Speech Corpuscited by 10
  20. 2022BYOL-S: Learning Self-supervised Speech Representations by Bootstrappingcited by 9
  21. 2024The VoxCeleb Speaker Recognition Challenge: A Retrospectivecited by 9
  22. 2024Africa-Centric Self-Supervised Pre-Training for Multilingual Speech Representation in a Sub-Saharan Contextcited by 8
  23. 2024DC-Spin: A Speaker-invariant Speech Tokenizer for Spoken Language Modelscited by 8
  24. 2025USAD: Universal Speech and Audio Representation via Distillationcited by 7
  25. 2025Multilingual Source Tracing of Speech Deepfakes: A First Benchmarkcited by 7
  26. 2025NADI 2025: The First Multidialectal Arabic Speech Processing Shared Taskcited by 7
  27. 2022Attentive Temporal Pooling for Conformer-based Streaming Language Identification in Long-form Speechcited by 6
  28. 2022The Efficacy of Self-Supervised Speech Models for Audio Representationscited by 6
  29. 2025IPA-CHILDES & G2P+: Feature-Rich Resources for Cross-Lingual Phonology and Phonemic Language Modelingcited by 6
  30. 2022Accidental Learners: Spoken Language Identification in Multilingual Self-Supervised Modelscited by 5
  31. 2023Learning Cross-lingual Visual Speech Representationscited by 5
  32. 2024Textless Acoustic Model with Self-Supervised Distillation for Noise-Robust Expressive Speech-to-Speech Translationcited by 5
  33. 2022A Compact End-to-End Model with Local and Global Context for Spoken Language Identificationcited by 4
  34. 2023ivrit.ai: A Comprehensive Dataset of Hebrew Speech for AI Research and Developmentcited by 4
  35. 2023RoDia: A New Dataset for Romanian Dialect Identification from Speechcited by 4
  36. 2023Summary of the DISPLACE Challenge 2023 - DIarization of SPeaker and LAnguage in Conversational Environmentscited by 4
  37. 2024The Second DISPLACE Challenge : DIarization of SPeaker and LAnguage in Conversational Environmentscited by 4
  38. 2025Voice of a Continent: Mapping Africa's Speech Technology Frontiercited by 4

50 most cited of 118 All 118 (JSON)