mlsanityData to 7 Oct 2026

WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognition

arXiv 2110.03370 ↗First posted 7 Oct 2021cs.SD cs.CLcited by 189

Not on the map. Why?

Abstract (arXiv)

In this paper, we present WenetSpeech, a multi-domain Mandarin corpus consisting of 10000+ hours high-quality labeled speech, 2400+ hours weakly labeled speech, and about 10000 hours unlabeled speech, with 22400+ hours in total. We collect the data from YouTube and Podcast, which covers a variety of speaking styles, scenarios, domains, topics, and noisy conditions. An optical character recognition (OCR) based method is introduced to generate the audio/text segmentation candidates for the YouTube data on its corresponding video captions, while a high-quality ASR transcription system is used to generate audio/text pair candidates for the Podcast data. Then we propose a novel end-to-end label error detection approach to further validate and filter the candidates. We also provide three manually labelled high-quality test sets along with WenetSpeech for evaluation -- Dev for cross-validation purpose in training, TestNet, collected from Internet for matched test, and TestMeeting, recorded from real meetings for more challenging mismatched test. Baseline systems trained with WenetSpeech are provided for three popular speech recognition toolkits, namely Kaldi, ESPnet, and WeNet, and recognition results on the three test sets are also provided as benchmarks. To the best of our knowledge, WenetSpeech is the current largest open-sourced Mandarin speech corpus with transcriptions, which benefits research on production-level speech recognition.

Key facts. Cited by 189 papers in the map (data through 7 Oct 2026). Builds on 25 of its 43 references that are in the map. First posted on arXiv 7 Oct 2021.

Builds on

25 of 43 references.

References · 25

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  3. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  4. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  5. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  6. 2013Speech Recognition with Deep Recurrent Neural Networkscited by 666
  7. 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
  8. 2015Listen, Attend and Spellcited by 542
  9. 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 519
  10. 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 496
  11. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 467
  12. 2015Deep Speech 2: End-to-End Speech Recognition in English and Mandarincited by 449
13 more
  1. 2015Attention-Based Models for Speech Recognitioncited by 400
  2. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 391
  3. 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 364
  4. 2016Joint CTC-Attention based End-to-End Speech Recognition using Multi-task Learningcited by 254
  5. 2021Unsupervised Speech Recognitioncited by 147
  6. 2020Recent Developments on ESPnet Toolkit Boosted by Conformercited by 132
  7. 2018AISHELL-2: Transforming Mandarin ASR Research Into Industrial Scalecited by 125
  8. 2021WeNet: Production oriented Streaming and Non-streaming End-to-End Speech Recognition Toolkitcited by 123
  9. 2016Detecting Text in Natural Image with Connectionist Text Proposal Networkcited by 85
  10. 2015EESEN: End-to-End Speech Recognition using Deep RNN Models and WFST-based Decodingcited by 73
  11. 2020The ASRU 2019 Mandarin-English Code-Switching Speech Recognition Challenge: Open Datasets, Tracks, Methods and Resultscited by 43
  12. 2020Cascade RNN-Transducer: Syllable Based Streaming On-device Mandarin Speech Recognition with a Syllable-to-Character Convertercited by 16
  13. 2021Efficient Conformer with Prob-Sparse Attention Mechanism for End-to-EndSpeech Recognitioncited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 16; 2023: 26; 2024: 45; 2025: 52; 2026: 50.

189 papers.

Sort:

By area:

  1. 2025Kimi-Audio Technical Reportcited by 210
  2. 2025VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interactioncited by 191
  3. 2024VITA: Towards Open-Source Interactive Omni Multimodal LLMcited by 172
  4. 2023Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modelingcited by 166
  5. 2026Qwen3.5-Omni Technical Reportcited by 146
  6. 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 135
  7. 2024FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMscited by 118
  8. 2026Qwen3-ASR Technical Reportcited by 105
  9. 2025Step-Audio 2 Technical Reportcited by 101
  10. 2023FunASR: A Fundamental End-to-End Speech Recognition Toolkitcited by 92
  11. 2023VioLA: Unified Codec Language Models for Speech Recognition, Synthesis, and Translationcited by 87
  12. 2024Recent Advances in Speech Language Models: A Surveycited by 85
38 more
  1. 2023LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPTcited by 77
  2. 2023Zipformer: A faster and better encoder for automatic speech recognitioncited by 77
  3. 2024OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformercited by 74
  4. 2025Baichuan-Audio: A Unified Framework for End-to-End Speech Interactioncited by 68
  5. 2024SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Wordscited by 67
  6. 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interactioncited by 64
  7. 2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 62
  8. 2025HumanOmni: A Large Vision-Speech Language Model for Human-Centric Video Understandingcited by 58
  9. 2024OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversationcited by 57
  10. 2023Mega-TTS: Zero-Shot Text-to-Speech at Scale with Intrinsic Inductive Biascited by 51
  11. 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 48
  12. 2022WeNet 2.0: More Productive End-to-End Speech Recognition Toolkitcited by 46
  13. 2023FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codeccited by 44
  14. 2024EMOVA: Empowering Language Models to See, Hear and Speak with Vivid Emotionscited by 44
  15. 2023Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Datacited by 42
  16. 2025MegaTTS 3: Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesiscited by 39
  17. 2022Open Source MagicData-RAMC: A Rich Annotated Mandarin Conversational(RAMC) Speech Datasetcited by 36
  18. 2024BLSP-Emo: Towards Empathetic Large Speech-Language Modelscited by 36
  19. 2024OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identificationcited by 34
  20. 2024GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinementcited by 34
  21. 2024HiCMAE: Hierarchical Contrastive Masked Autoencoder for Self-Supervised Audio-Visual Emotion Recognitioncited by 30
  22. 2025VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Modelcited by 30
  23. 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokenscited by 30
  24. 2023Speech Translation with Large Language Models: An Industrial Practicecited by 28
  25. 2025InteractiveOmni: A Unified Omni-modal Model for Audio-Visual Multi-turn Dialoguecited by 27
  26. 2022Speech-to-Speech Translation For A Real-world Unwritten Languagecited by 25
  27. 2024Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing?cited by 23
  28. 2025LongCat-Flash-Omni Technical Reportcited by 23
  29. 2024FlashSpeech: Efficient Zero-Shot Speech Synthesiscited by 22
  30. 2024From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalitiescited by 22
  31. 2025Ming-Flash-Omni: A Sparse, Unified Architecture for Multimodal Perception and Generationcited by 21
  32. 2023PolyVoice: Language Models for Speech to Speech Translationcited by 19
  33. 2025Emilia: A Large-Scale, Extensive, Multilingual, and Diverse Dataset for Speech Generationcited by 19
  34. 2025M2-omni: Advancing Omni-MLLM for Comprehensive Modality Support with Competitive Performancecited by 19
  35. 2025NExT-OMNI: Towards Any-to-Any Omnimodal Foundation Models with Discrete Flow Matchingcited by 19
  36. 2022TALCS: An Open-Source Mandarin-English Code-Switching Corpus and a Speech Recognition Baselinecited by 17
  37. 2024SimpleSpeech 2: Towards Simple and Efficient Text-to-Speech with Flow-based Scalar Latent Transformer Diffusion Modelscited by 17
  38. 2025Stream-Omni: Simultaneous Multimodal Interactions with Large Language-Vision-Speech Modelcited by 17

50 most cited of 189 All 189 (JSON)