AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baseline
Not on the map. Why?
Abstract (arXiv)
An open-source Mandarin speech corpus called AISHELL-1 is released. It is by far the largest corpus which is suitable for conducting the speech recognition research and building speech recognition systems for Mandarin. The recording procedure, including audio capturing devices and environments are presented in details. The preparation of the related resources, including transcriptions and lexicon are described. The corpus is released with a Kaldi recipe. Experimental results implies that the quality of audio recordings and transcriptions are promising.
Key facts. Cited by 364 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Sep 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 51; 2022: 53; 2023: 62; 2024: 69; 2025: 76; 2026: 53.
364 papers.
Sort:
By area:
- 2023A Survey on Multimodal Large Language Modelscited by 898
- 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 591
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 258
- 2025Kimi-Audio Technical Reportcited by 210
- 2025VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interactioncited by 191
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 189
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2022Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognitioncited by 139
- 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 135
- 2021DistilHuBERT: Speech Representation Learning by Layer-wise Distillation of Hidden-unit BERTcited by 129
- 2023X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languagescited by 127
38 more
- 2021WeNet: Production oriented Streaming and Non-streaming End-to-End Speech Recognition Toolkitcited by 123
- 2024FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMscited by 118
- 2024OmniBench: Towards The Future of Universal Omni-Language Modelscited by 100
- 2021Intermediate Loss Regularization for CTC-based Speech Recognitioncited by 95
- 2022ADD 2022: the First Audio Deep Synthesis Detection Challengecited by 94
- 2023FunASR: A Fundamental End-to-End Speech Recognition Toolkitcited by 92
- 2022Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understandingcited by 90
- 2025IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speechcited by 85
- 2023LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPTcited by 77
- 2023Zipformer: A faster and better encoder for automatic speech recognitioncited by 77
- 2024OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformercited by 74
- 2024mHuBERT-147: A Compact Multilingual HuBERT Modelcited by 64
- 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interactioncited by 64
- 2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 62
- 2021Relaxing the Conditional Independence Assumption of CTC-based ASR by Conditioning on Intermediate Predictionscited by 61
- 2025MiMo-Audio: Audio Language Models are Few-Shot Learnerscited by 58
- 2023LLaSM: Large Language and Speech Modelcited by 56
- 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 48
- 2024InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactionscited by 48
- 2022WeNet 2.0: More Productive End-to-End Speech Recognition Toolkitcited by 46
- 2023FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codeccited by 44
- 2024EMOVA: Empowering Language Models to See, Hear and Speak with Vivid Emotionscited by 44
- 2021Interspeech 2021 Deep Noise Suppression Challengecited by 43
- 2021FastCorrect: Fast Error Correction with Edit Alignment for Automatic Speech Recognitioncited by 43
- 2021ASCEND: A Spontaneous Chinese-English Dataset for Code-switching in Multi-turn Conversationcited by 43
- 2023Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Datacited by 42
- 2023Exploring Speech Recognition, Translation, and Understanding with Discrete Speech Units: A Comparative Studycited by 42
- 2023HyPoradise: An Open Baseline for Generative Speech Recognition with Large Language Modelscited by 41
- 2021An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognitioncited by 39
- 2025Towards Holistic Evaluation of Large Audio-Language Models: A Comprehensive Surveycited by 38
- 2022Open Source MagicData-RAMC: A Rich Annotated Mandarin Conversational(RAMC) Speech Datasetcited by 36
- 2024OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identificationcited by 34
- 2024GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinementcited by 34
- 2021Fast End-to-End Speech Recognition via Non-Autoregressive Models and Cross-Modal Knowledge Transferring from BERTcited by 31
- 2025VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Modelcited by 30
- 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokenscited by 30
- 2021U2++: Unified Two-pass Bidirectional End-to-end Model for Speech Recognitioncited by 28
- 2021FastCorrect 2: Fast Error Correction on Multiple Candidates for Automatic Speech Recognitioncited by 27
50 most cited of 364 All 364 (JSON)
- 2026Tacit-TTS: From Autoregressive Decoding to Masked Prediction for Efficient Transcript-Free Voice Cloning29 Sep 2026
- 2026Discrete vs. Continuous: A Comprehensive Study of Unified Audio Understanding in LALMs19 Sep 2026
- 2026HearInContext: A Benchmark for Implicit Context in Speech Recognition16 Sep 2026
- 2026T-SANDHI: Tone Sandhi-aware Adaptive Network with Decoupled Hybrid Injection for Low-resource Taiwanese Hokkien Speech Recognition16 Sep 2026
- 2026Correlation-Guided Encoder Selection for Multi-Encoder Large Audio-Language Models16 Sep 2026
- 2026X-AuT: Progressive Audio-Encoder Compression for Speech LLMs with Cross-Scale Distillation10 Sep 2026
- 2026Xiaomi-CocktailASR-1 Technical Report10 Sep 2026
- 2026SEA-SpeechBench: A Large-Scale Multitask Benchmark for Speech Understanding Across Southeast Asia9 Sep 2026
- 2026X2Streaming-ASR: wait when uncertain, emit when ready for streaming ASR8 Sep 2026
- 2026Qwen-Audio-3.0-ASR Technical Report7 Sep 2026
- 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generation25 Aug 2026
- 2026Relative Time Intervals Representation for Word-level Timestamping with Masked Training25 Aug 2026
38 more
- 2026X2-Turn: Frame-Synchronous Dual-Head Modeling for Joint Streaming ASR and Turn State Prediction11 Aug 2026
- 2026Whisper-Aware LLM: Self-Supervised Uncertainty Learning for Robust Whispered Speech Recognition11 Aug 2026
- 2026Latent Softmax for Data-Efficient Phoneme-Based Multilingual ASR Across Tonal and Non-Tonal Languages2 Aug 2026
- 2026Dissecting Sensitivity to Training Language in Self-Supervised Speech Learning Using Neural Audio Codec Tokens28 Jul 2026
- 2026Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videos17 Jul 2026
- 2026Does Translation-Enhanced Speech Encoder Pre-training Affect Speech LLMs?24 Jun 2026
- 2026Massive Open-Vocabulary Keyword Spotting9 Jun 2026
- 2026Ethical and Technical Limits of Deepfake Speech Datasets9 Jun 2026
- 2026ANCHOR: Autoregressive Non-intrusive Chunk-Ordered Refinement for Joint Multi-Resolution Speech Quality Modeling8 Jun 2026
- 2026Whisper Hallucination Detection and Mitigation via Hidden Representation Steering and Sparse AutoEncoders5 Jun 2026
- 2026USAD 2.0: Scaling Representation Distillation for Universal Audio Understanding4 Jun 2026
- 2026Beyond Waveform Robustness: Robust Feature-Vocoder Adversarial Attacks on Automatic Speech Recognition4 Jun 2026
- 2026SB-RF: Schr"odinger Bridge Rectified Flow for One-Step Robust Speech Enhancement4 Jun 2026
- 2026PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialects31 May 2026
- 2026UniAudio-Token: Empowering Semantic Speech Tokenizers with General Audio Perception29 May 2026
- 2026HoliTok: A Continuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding28 May 2026
- 2026Towards Human-Like Interactive Speech Recognition With Agentic Correction and Semantic Evaluation28 May 2026
- 2026Data-Efficient On-Policy Distillation for Automatic Speech Recognition27 May 2026
- 2026Mega-ASR: Towards In-the-wild^2 Speech Recognition via Scaling up Real-world Acoustic Simulation19 May 2026
- 2026JSPG: Dynamic Dictionary Filtering via Joint Semantic-Pinyin-Glyph Retrieval for Chinese Contextual ASR16 May 2026
- 2026VITA-QinYu: Expressive Spoken Language Model for Role-Playing and Singing7 May 2026
- 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interaction30 Apr 2026
- 2026UAF: A Unified Audio Front-end LLM for Full-Duplex Speech Interaction21 Apr 2026
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASR20 Apr 2026
- 2026Beyond Transcription: Unified Audio Schema for Perception-Aware AudioLLMs14 Apr 2026
- 2026Efficient Training for Cross-lingual Speech Language Models13 Apr 2026
- 2026Audio Flamingo Next: Next-Generation Open Audio-Language Models for Speech, Sound, and Music13 Apr 2026
- 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokens29 Mar 2026
- 2026Introducing MELI: the Mandarin-English Language Interview Corpus27 Mar 2026
- 2026Polyglot-Lion: Efficient Multilingual ASR for Singapore via Balanced Fine-Tuning of Qwen3-ASR17 Mar 2026
- 2026Uni-ASR: Unified LLM-Based Architecture for Non-Streaming and Streaming Automatic Speech Recognition11 Mar 2026
- 2026UniWhisper: Efficient Continual Multi-task Training for Robust Universal Audio Representation25 Feb 2026
- 2026Eureka-Audio: Triggering Audio Intelligence in Compact Language Models15 Feb 2026
- 2026Lamer-SSL: Layer-aware Mixture of LoRA Experts for Continual Multilingual Expansion of Self-supervised Models without Forgetting13 Feb 2026
- 2026ERNIE 5.0 Technical Report4 Feb 2026
- 2026BBPE16: UTF-16-based byte-level byte-pair encoding for improved multilingual speech recognition2 Feb 2026
- 2026MiLorE-SSL: Scaling Multilingual Capabilities in Self-Supervised Models without Forgetting28 Jan 2026
- 2026Unifying Speech Recognition, Synthesis and Conversion with Autoregressive Transformers15 Jan 2026
50 newest of 364 All 364 (JSON)
- 2023Language-Routing Mixture of Experts for Multilingual and Code-Switching Speech Recognitioncited by 26
- 2025LongCat-Flash-Omni Technical Reportcited by 23
- 2025Ming-Flash-Omni: A Sparse, Unified Architecture for Multimodal Perception and Generationcited by 21
- 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Datacited by 21
- 2024Boosting Code-Switching ASR with Mixture of Experts Enhanced Speech-Conditioned LLMcited by 9
- 2026ERNIE 5.0 Technical Reportcited by 9
- 2024An Effective Mixture-Of-Experts Approach For Code-Switching Speech Recognition Leveraging Encoder Disentanglementcited by 8
- 2022Parameter-Efficient Conformers via Sharing Sparsely-Gated Experts for End-to-End Speech Recognitioncited by 3
- 2025BLR-MoE: Boosted Language-Routing Mixture of Experts for Domain-Robust Multilingual E2E ASRcited by 2
- 2026Qwen-Audio-3.0-ASR Technical Reportcited by 1
- 2024Enhancing Code-Switching ASR Leveraging Non-Peaky CTC Loss and Deep Language Posterior Injectioncited by 0
- 2026MiLorE-SSL: Scaling Multilingual Capabilities in Self-Supervised Models without Forgettingcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Qwen-Audio-3.0-ASR Technical Report7 Sep 2026
- 2026Eureka-Audio: Triggering Audio Intelligence in Compact Language Models15 Feb 2026
- 2026ERNIE 5.0 Technical Report4 Feb 2026
- 2026MiLorE-SSL: Scaling Multilingual Capabilities in Self-Supervised Models without Forgetting28 Jan 2026
- 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Data16 Nov 2025
- 2025LongCat-Flash-Omni Technical Report31 Oct 2025
- 2025Ming-Flash-Omni: A Sparse, Unified Architecture for Multimodal Perception and Generation28 Oct 2025
- 2025BLR-MoE: Boosted Language-Routing Mixture of Experts for Domain-Robust Multilingual E2E ASR22 Jan 2025
- 2024Enhancing Code-Switching ASR Leveraging Non-Peaky CTC Loss and Deep Language Posterior Injection26 Nov 2024
- 2024Boosting Code-Switching ASR with Mixture of Experts Enhanced Speech-Conditioned LLM24 Sep 2024
- 2024An Effective Mixture-Of-Experts Approach For Code-Switching Speech Recognition Leveraging Encoder Disentanglement27 Feb 2024
- 2023Language-Routing Mixture of Experts for Multilingual and Code-Switching Speech Recognition12 Jul 2023
12 newest of 13 All 13 (JSON)
- 2023A Survey on Multimodal Large Language Modelscited by 898
- 2025VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interactioncited by 191
- 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 135
- 2024OmniBench: Towards The Future of Universal Omni-Language Modelscited by 100
- 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interactioncited by 64
- 2023LLaSM: Large Language and Speech Modelcited by 56
- 2024InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactionscited by 48
- 2025Capybara-OMNI: An Efficient Paradigm for Building Omni-Modal Language Modelscited by 0
- 2025OrdMoE: Preference Alignment via Hierarchical Expert Group Ranking in Multimodal Mixture-of-Experts LLMscited by 0
- 2026SEA-SpeechBench: A Large-Scale Multitask Benchmark for Speech Understanding Across Southeast Asiacited by 0
- 2026SEA-SpeechBench: A Large-Scale Multitask Benchmark for Speech Understanding Across Southeast Asia9 Sep 2026
- 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interaction30 Apr 2026
- 2025OrdMoE: Preference Alignment via Hierarchical Expert Group Ranking in Multimodal Mixture-of-Experts LLMs24 Nov 2025
- 2025Capybara-OMNI: An Efficient Paradigm for Building Omni-Modal Language Models10 Apr 2025
- 2025VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction3 Jan 2025
- 2024InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions12 Dec 2024
- 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM1 Nov 2024
- 2024OmniBench: Towards The Future of Universal Omni-Language Models23 Sep 2024
- 2023LLaSM: Large Language and Speech Model30 Aug 2023
- 2023A Survey on Multimodal Large Language Models23 Jun 2023
- 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 591
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 258
- 2025Kimi-Audio Technical Reportcited by 210
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 189
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2022Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognitioncited by 139
- 2021DistilHuBERT: Speech Representation Learning by Layer-wise Distillation of Hidden-unit BERTcited by 129
- 2021WeNet: Production oriented Streaming and Non-streaming End-to-End Speech Recognition Toolkitcited by 123
- 2024FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMscited by 118
- 2021Intermediate Loss Regularization for CTC-based Speech Recognitioncited by 95
- 2022ADD 2022: the First Audio Deep Synthesis Detection Challengecited by 94
12 most cited of 329 All 329 (JSON)
- 2026Tacit-TTS: From Autoregressive Decoding to Masked Prediction for Efficient Transcript-Free Voice Cloning29 Sep 2026
- 2026Discrete vs. Continuous: A Comprehensive Study of Unified Audio Understanding in LALMs19 Sep 2026
- 2026HearInContext: A Benchmark for Implicit Context in Speech Recognition16 Sep 2026
- 2026T-SANDHI: Tone Sandhi-aware Adaptive Network with Decoupled Hybrid Injection for Low-resource Taiwanese Hokkien Speech Recognition16 Sep 2026
- 2026Correlation-Guided Encoder Selection for Multi-Encoder Large Audio-Language Models16 Sep 2026
- 2026X-AuT: Progressive Audio-Encoder Compression for Speech LLMs with Cross-Scale Distillation10 Sep 2026
- 2026Xiaomi-CocktailASR-1 Technical Report10 Sep 2026
- 2026X2Streaming-ASR: wait when uncertain, emit when ready for streaming ASR8 Sep 2026
- 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generation25 Aug 2026
- 2026Relative Time Intervals Representation for Word-level Timestamping with Masked Training25 Aug 2026
- 2026X2-Turn: Frame-Synchronous Dual-Head Modeling for Joint Streaming ASR and Turn State Prediction11 Aug 2026
- 2026Whisper-Aware LLM: Self-Supervised Uncertainty Learning for Robust Whispered Speech Recognition11 Aug 2026
12 newest of 329 All 329 (JSON)