mlsanityData to 7 Oct 2026

GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinement

arXiv 2406.11546 ↗First posted 17 Jun 2024eess.AS cs.CL cs.SDcited by 34

Not on the map. Why?

Abstract (arXiv)

The evolution of speech technology has been spurred by the rapid increase in dataset sizes. Traditional speech models generally depend on a large amount of labeled training data, which is scarce for low-resource languages. This paper presents GigaSpeech 2, a large-scale, multi-domain, multilingual speech recognition corpus. It is designed for low-resource languages and does not rely on paired speech and text data. GigaSpeech 2 comprises about 30,000 hours of automatically transcribed speech, including Thai, Indonesian, and Vietnamese, gathered from unlabeled YouTube videos. We also introduce an automated pipeline for data crawling, transcription, and label refinement. Specifically, this pipeline involves Whisper for initial transcription, MMS for forced alignment, and multi-dimensional filtering for data quality assurance. A modified Noisy Student Training is developed to further refine flawed pseudo labels iteratively, thereby enhancing model performance. Experimental results on our manually transcribed evaluation set and two public test sets from Common Voice and FLEURS confirm our corpus's high quality and broad applicability. Notably, ASR models trained on GigaSpeech 2 can reduce the word error rate for Thai, Indonesian, and Vietnamese on our challenging and realistic YouTube test set by 25% to 40% compared to Whisper large-v3, with merely 10% model parameters. Furthermore, our ASR models trained on GigaSpeech 2 yield superior performance compared to commercial services. We hope that our newly introduced corpus and pipeline will open a new avenue for low-resource speech recognition and significantly facilitate research in this area.

Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). Builds on 46 of its 57 references that are in the map. First posted on arXiv 17 Jun 2024.

Builds on

46 of 57 references.

References · 46

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Scaling Laws for Neural Language Modelscited by 6,411
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  5. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  6. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  7. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  8. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  9. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  10. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  11. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
  12. 2023Scaling Vision Transformers to 22 Billion Parameterscited by 690
34 more
  1. 2013Speech Recognition with Deep Recurrent Neural Networkscited by 666
  2. 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
  3. 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 496
  4. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 467
  5. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  6. 2023Scaling Speech Technology to 1,000+ Languagescited by 401
  7. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 391
  8. 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 364
  9. 2016FastText.zip: Compressing text classification modelscited by 331
  10. 2016Joint CTC-Attention based End-to-End Speech Recognition using Multi-task Learningcited by 254
  11. 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 228
  12. 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 189
  13. 2020Pushing the Limits of Semi-Supervised Learning for Automatic Speech Recognitioncited by 185
  14. 2020Improved Noisy Student Training for Automatic Speech Recognitioncited by 139
  15. 2018AISHELL-2: Transforming Mandarin ASR Research Into Industrial Scalecited by 125
  16. 2020VoxLingua107: a Dataset for Spoken Language Recognitioncited by 118
  17. 2020Massively Multilingual ASR: 50 Languages, 1 Model, 1 Billion Parameterscited by 110
  18. 2021The People's Speech: A Large-Scale Diverse English Speech Recognition Dataset for Commercial Usagecited by 98
  19. 2019Large-Scale Multilingual Speech Recognition with a Streaming End-to-End Modelcited by 92
  20. 2017Multilingual Speech Recognition With A Single End-To-End Modelcited by 87
  21. 2023Libriheavy: a 50,000 hours ASR corpus with punctuation casing and contextcited by 84
  22. 2020Iterative Pseudo-Labeling for Speech Recognitioncited by 81
  23. 2023Zipformer: A faster and better encoder for automatic speech recognitioncited by 77
  24. 2021Scaling End-to-End Models for Large-Scale Multilingual ASRcited by 61
  25. 2024YODAS: Youtube-Oriented Dataset for Audio and Speechcited by 56
  26. 2020SlimIPL: Language-Model-Free Iterative Pseudo-Labelingcited by 54
  27. 2022Pruned RNN-T for fast, memory-efficient ASR trainingcited by 46
  28. 2018Multilingual sequence-to-sequence speech recognition: architecture, transfer learning, and language modelingcited by 34
  29. 2023TorchAudio 2.1: Advancing speech recognition, self-supervised learning, and audio processing components for PyTorchcited by 25
  30. 2021Pseudo-Labeling for Massively Multilingual Speech Recognitioncited by 23
  31. 2022Massively Multilingual ASR on 70 Languages: Tokenization, Architecture, and Generalization Capabilitiescited by 16
  32. 2024Anatomy of Industrial Scale Multilingual ASRcited by 14
  33. 2024VietMed: A Dataset and Benchmark for Automatic Speech Recognition of Vietnamese in the Medical Domaincited by 9
  34. 2022Improving Noisy Student Training on Non-target Domain Data for Automatic Speech Recognitioncited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 13; 2026: 20.

34 papers.

Sort:

By area:

  1. 2025OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaningcited by 27
  2. 2026OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Modelscited by 22
  3. 2025Pseudo-Autoregressive Neural Codec Language Models for Efficient Zero-Shot Text-to-Speech Synthesiscited by 10
  4. 2026WAXAL: A Large-Scale Multilingual African Language Speech Corpuscited by 10
  5. 2025Dolphin: A Large-Scale Automatic Speech Recognition Model for Eastern Languagescited by 8
  6. 2025SeaLLMs-Audio: Large Audio-Language Models for Southeast Asiacited by 7
  7. 2026SLAM-LLM: A Modular, Open-Source Multimodal Large Language Model Framework and Best Practice for Speech, Language, Audio and Music Processingcited by 7
  8. 2026Fish Audio S2 Technical Reportcited by 7
  9. 2026Uni-ASR: Unified LLM-Based Architecture for Non-Streaming and Streaming Automatic Speech Recognitioncited by 5
  10. 2026X-Voice: Enabling Everyone to Speak 30 Languages via Zero-Shot Cross-Lingual Voice Cloningcited by 4
  11. 2025VietASR: Achieving Industry-level Vietnamese ASR with 50-hour labeled data and Large-Scale Speech Pretrainingcited by 3
  12. 2025EuroSpeech: A Multilingual Speech Corpuscited by 3
22 more
  1. 2025UDDETTS: Unifying Discrete and Dimensional Emotions for Controllable Emotional Text-to-Speechcited by 2
  2. 2026Enhancing Multilingual LLM-based ASR with Mixture of Experts and Dynamic Downsamplingcited by 2
  3. 2024A Comparative Study of LLM-based ASR and Whisper in Low Resource and Code Switching Scenariocited by 1
  4. 2025ILT-Iterative LoRA Training through Focus-Feedback-Fix for Multilingual Speech Recognitioncited by 1
  5. 2025Triple X: A LLM-Based Multilingual Speech Recognition System for the INTERSPEECH2025 MLC-SLM Challengecited by 1
  6. 2025Flavors of Moonshine: Tiny Specialized ASR Models for Edge Devicescited by 1
  7. 2026JaiTTS: A Thai Voice Cloning Modelcited by 1
  8. 2025Empowering Global Voices: A Data-Efficient, Phoneme-Tone Adaptive Approach to High-Fidelity Speech Synthesiscited by 0
  9. 2025NTU Speechlab LLM-Based Multilingual ASR System for Interspeech MLC-SLM Challenge 2025cited by 0
  10. 2025Transsion Multilingual Speech Recognition System for MLC-SLM 2025 Challengecited by 0
  11. 2026VietNormalizer: An Open-Source, Dependency-Free Python Library for Vietnamese Text Normalization in TTS and NLP Applicationscited by 0
  12. 2026Sommelier: Scalable Open Multi-turn Audio Pre-processing for Full-duplex Speech Language Modelscited by 0
  13. 2026AfriVox-v2: A Domain-Verticalized Benchmark for In-the-Wild African Speech Recognitioncited by 0
  14. 2026WorldSpeech: A Multilingual Speech Corpus from Around the Worldcited by 0
  15. 2026PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialectscited by 0
  16. 2026Optimality of FSQ Tokens for Continuous Diffusion for Categorical Data with Application to Text-to-Speechcited by 0
  17. 2026GigaAM Multilingual: Foundation Model for Underrepresented Languagescited by 0
  18. 2026Building and Evaluating Fixed-Voice Thai TTS from Synthetic Speechcited by 0
  19. 2026Typhoon ASR Streaming: Steerable Low-Latency Thai Speech Recognition with Real-Time Shallow Fusioncited by 0
  20. 2026Vimarsha: Faithful ASR Evaluation for Indian Languages with Demographic Diversity, In-the-Wild Audio and Spelling Variationscited by 0
  21. 2026VietPrism: A large-scale Vietnamese speech and deepfake corpus with diverse dialects and code-switchingcited by 0
  22. 2026FuseAlign: Forced Alignment in the Wildcited by 0