mlsanityData to 7 Oct 2026

VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretation

arXiv 2101.00390 ↗First posted 2 Jan 2021cs.CL eess.AScited by 455

Not on the map. Why?

Abstract (arXiv)

We introduce VoxPopuli, a large-scale multilingual corpus providing 100K hours of unlabelled speech data in 23 languages. It is the largest open data to date for unsupervised representation learning as well as semi-supervised learning. VoxPopuli also contains 1.8K hours of transcribed speeches in 16 languages and their aligned oral interpretations into 5 other languages totaling 5.1K hours. We provide speech recognition baselines and validate the versatility of VoxPopuli unlabelled data in semi-supervised learning under challenging out-of-domain settings. We will release the corpus at https://github.com/facebookresearch/voxpopuli under an open license.

Key facts. Cited by 455 papers in the map (data through 7 Oct 2026). Builds on 29 of its 50 references that are in the map. First posted on arXiv 2 Jan 2021.

Builds on

29 of 50 references.

References · 29

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  4. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  5. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  6. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  7. 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 496
  8. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 467
  9. 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 462
  10. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  11. 2020Pushing the Limits of Semi-Supervised Learning for Automatic Speech Recognitioncited by 185
  12. 2019pyannote.audio: neural building blocks for speaker diarizationcited by 175
17 more
  1. 2020fairseq S2T: Fast Speech-to-Text Modeling with fairseqcited by 174
  2. 2019Self-Training for End-to-End Speech Recognitioncited by 128
  3. 2019Direct speech-to-speech translation with a sequence-to-sequence modelcited by 118
  4. 2019Europarl-ST: A Multilingual Corpus For Speech Translation Of Parliamentary Debatescited by 114
  5. 2020Unsupervised pretraining transfers well across languagescited by 100
  6. 2020Self-training and Pre-training are Complementary for Speech Recognitioncited by 98
  7. 2020Data Augmenting Contrastive Learning of Speech Representations in the Time Domaincited by 63
  8. 2017The Zero Resource Speech Challenge 2017cited by 45
  9. 2016Wav2Letter: an End-to-End ConvNet-based Speech Recognition Systemcited by 43
  10. 2020UWSpeech: Speech to Speech Translation for Unwritten Languagescited by 43
  11. 2018wav2letter++: The Fastest Open-source Speech Recognition Systemcited by 42
  12. 2020Self-Training for End-to-End Speech Translationcited by 36
  13. 2019Sequence-to-Sequence Speech Recognition with Time-Depth Separable Convolutionscited by 27
  14. 2019Speech-to-speech Translation between Untranscribed Unknown Languagescited by 27
  15. 2019MaSS: A Large and Clean Multilingual Corpus of Sentence-aligned Spoken Utterances Extracted from the Biblecited by 24
  16. 2020Self-Supervised Representations Improve End-to-End Speech Translationcited by 21
  17. 2020Joint Masked CPC and CTC Training for ASRcited by 20

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 21; 2022: 63; 2023: 85; 2024: 88; 2025: 111; 2026: 87.

455 papers.

Sort:

By area:

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  2. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  3. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
  4. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  5. 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
  6. 2023Scaling Speech Technology to 1,000+ Languagescited by 401
  7. 2023AudioPaLM: A Large Language Model That Can Speak and Listencited by 333
  8. 2022Self-Supervised Speech Representation Learning: A Reviewcited by 258
  9. 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 228
  10. 2025Kimi-Audio Technical Reportcited by 210
  11. 2023Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modelingcited by 166
  12. 2022Dawn of the transformer era in speech emotion recognition: closing the valence gapcited by 155
38 more
  1. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
  2. 2021Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Trainingcited by 148
  3. 2021Direct speech-to-speech translation with discrete unitscited by 148
  4. 2023Scaling Laws for Generative Mixed-Modal Language Modelscited by 131
  5. 2024Spirit LM: Interleaved Spoken and Written Language Modelcited by 123
  6. 2021Textless Speech-to-Speech Translation on Real Datacited by 121
  7. 2022mSLAM: Massively multilingual joint pre-training for speech and textcited by 108
  8. 2023SONAR: Sentence-Level Multimodal and Language-Agnostic Representationscited by 105
  9. 2023Textually Pretrained Speech Language Modelscited by 99
  10. 2023EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesiscited by 93
  11. 2023Spoken Question Answering and Speech Continuation Using Spectrogram-Powered LLMcited by 92
  12. 2024WavChat: A Survey of Spoken Dialogue Modelscited by 88
  13. 2023Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labellingcited by 87
  14. 2024An Embarrassingly Simple Approach for LLM with Strong ASR Capacitycited by 86
  15. 2024Recent Advances in Speech Language Models: A Surveycited by 85
  16. 2022MAESTRO: Matched Speech Text Representations through Modality Matchingcited by 79
  17. 2022HEAR: Holistic Evaluation of Audio Representationscited by 77
  18. 2024OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformercited by 74
  19. 2022CVSS Corpus and Massively Multilingual Speech-to-Speech Translationcited by 71
  20. 2023Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Promptingcited by 71
  21. 2021SLUE: New Benchmark Tasks for Spoken Language Understanding Evaluation on Natural Speechcited by 70
  22. 2023ML-SUPERB: Multilingual Speech Universal PERformance Benchmarkcited by 70
  23. 2021Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognitioncited by 68
  24. 2023SLM: Bridge the thin gap between speech and text foundation modelscited by 67
  25. 2024Proactive Detection of Voice Cloning with Localized Watermarkingcited by 67
  26. 2024Natural language guidance of high-fidelity text-to-speech with synthetic annotationscited by 66
  27. 2024mHuBERT-147: A Compact Multilingual HuBERT Modelcited by 64
  28. 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interactioncited by 64
  29. 2022Toward a realistic model of speech processing in the brain with self-supervised learningcited by 63
  30. 2023What Do Self-Supervised Speech Models Know About Words?cited by 62
  31. 2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 62
  32. 2022UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Unitscited by 60
  33. 2024OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversationcited by 57
  34. 2023Efficient Sequence Transduction by Jointly Predicting Tokens and Durationscited by 56
  35. 2025OmniVinci: Enhancing Architecture and Data for Omni-Modal Understanding LLMcited by 53
  36. 2025Canary-1B-v2 & Parakeet-TDT-0.6B-v3: Efficient and High-Performance Models for Multilingual ASR and ASTcited by 51
  37. 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 48
  38. 2021LeBenchmark: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speechcited by 46

50 most cited of 455 All 455 (JSON)