AISHELL-2: Transforming Mandarin ASR Research Into Industrial Scale
Not on the map. Why?
Abstract (arXiv)
AISHELL-1 is by far the largest open-source speech corpus available for Mandarin speech recognition research. It was released with a baseline system containing solid training and testing pipelines for Mandarin ASR. In AISHELL-2, 1000 hours of clean read-speech data from iOS is published, which is free for academic usage. On top of AISHELL-2 corpus, an improved recipe is developed and released, containing key components for industrial applications, such as Chinese word segmentation, flexible vocabulary expension and phone set transformation etc. Pipelines support various state-of-the-art techniques, such as time-delayed neural networks and Lattic-Free MMI objective funciton. In addition, we also release dev and test data from other channels(Android and Mic). For research community, we hope that AISHELL-2 corpus can be a solid resource for topics like transfer learning and robust ASR. For industry, we hope AISHELL-2 recipe can be a helpful reference for building meaningful industrial systems and products.
Key facts. Cited by 125 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 12; 2023: 18; 2024: 26; 2025: 33; 2026: 23.
125 papers.
Sort:
By area:
- 2023A Survey on Multimodal Large Language Modelscited by 898
- 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 591
- 2024Qwen2-Audio Technical Reportcited by 543
- 2025Kimi-Audio Technical Reportcited by 210
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 189
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2022Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognitioncited by 139
- 2023X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languagescited by 127
- 2024FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMscited by 118
- 2024OmniBench: Towards The Future of Universal Omni-Language Modelscited by 100
- 2023FunASR: A Fundamental End-to-End Speech Recognition Toolkitcited by 92
- 2024WavChat: A Survey of Spoken Dialogue Modelscited by 88
38 more
- 2025MinMo: A Multimodal Large Language Model for Seamless Voice Interactioncited by 79
- 2023LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPTcited by 77
- 2024A Survey of Multimodal Large Language Model from A Data-centric Perspectivecited by 73
- 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interactioncited by 64
- 2022WeNet 2.0: More Productive End-to-End Speech Recognition Toolkitcited by 46
- 2023FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codeccited by 44
- 2024EMOVA: Empowering Language Models to See, Hear and Speak with Vivid Emotionscited by 44
- 2021Deep Spoken Keyword Spotting: An Overviewcited by 43
- 2024GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinementcited by 34
- 2021Fast End-to-End Speech Recognition via Non-Autoregressive Models and Cross-Modal Knowledge Transferring from BERTcited by 31
- 2025VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Modelcited by 30
- 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokenscited by 30
- 2023Visual Instruction Tuning towards General-Purpose Multimodal Model: A Surveycited by 28
- 2025InteractiveOmni: A Unified Omni-modal Model for Audio-Visual Multi-turn Dialoguecited by 27
- 2024Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing?cited by 23
- 2025LongCat-Flash-Omni Technical Reportcited by 23
- 2024Encoding of lexical tone in self-supervised models of spoken languagecited by 22
- 2024From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalitiescited by 22
- 2022Language-specific Characteristic Assistance for Code-switching Speech Recognitioncited by 20
- 2025Fun-ASR Technical Reportcited by 19
- 2024Survey of Large Multimodal Model Datasets, Application Categories and Taxonomycited by 17
- 2021Improving Hybrid CTC/Attention End-to-end Speech Recognition with Pretrained Acoustic and Language Modelcited by 14
- 2022Improving CTC-based speech recognition via knowledge transferring from pre-trained language modelscited by 14
- 2025OmniCharacter: Towards Immersive Role-Playing Agents with Seamless Speech-Language Personality Interactioncited by 14
- 2025ContextASR-Bench: A Massive Contextual Speech Recognition Benchmarkcited by 14
- 2025SpeakerLM: End-to-End Versatile Speaker Diarization and Recognition with Multimodal Large Language Modelscited by 14
- 2021BAGUA: Scaling up Distributed Learning with System Relaxationscited by 13
- 2021VisualTTS: TTS with Accurate Lip-Speech Synchronization for Automatic Voice Overcited by 13
- 2024Unveiling the Potential of LLM-Based ASR on Chinese Open-Source Datasetscited by 13
- 2025OSUM: Advancing Open Speech Understanding Models with Limited Resources in Academiacited by 13
- 2022A context-aware knowledge transferring strategy for CTC-based ASRcited by 12
- 2022Bayes risk CTC: Controllable CTC alignment in Sequence-to-Sequence taskscited by 12
- 2025Nexus: An Omni-Perceptive And -Interactive Model for Language, Audio, And Visioncited by 12
- 2025Easy Turn: Integrating Acoustic and Linguistic Modalities for Robust Turn-Taking in Full-Duplex Spoken Dialogue Systemscited by 11
- 2021LipSound2: Self-Supervised Pre-Training for Lip-to-Speech Reconstruction and Lip Readingcited by 10
- 2024Generative Pre-trained Speech Language Model with Efficient Hierarchical Transformercited by 10
- 2025GLAP: General contrastive audio-text pretraining across domains and languagescited by 10
- 2026MOSS-TTS Technical Reportcited by 10
50 most cited of 125 All 125 (JSON)
- 2026Pretrained ASR Pseudo-labeling for Noisy Police Audio24 Sep 2026
- 2026X2Streaming-ASR: wait when uncertain, emit when ready for streaming ASR8 Sep 2026
- 2026Qwen-Audio-3.0-ASR Technical Report7 Sep 2026
- 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generation25 Aug 2026
- 2026Relative Time Intervals Representation for Word-level Timestamping with Masked Training25 Aug 2026
- 2026X2-Turn: Frame-Synchronous Dual-Head Modeling for Joint Streaming ASR and Turn State Prediction11 Aug 2026
- 2026PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialects31 May 2026
- 2026HoliTok: A Continuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding28 May 2026
- 2026VITA-QinYu: Expressive Spoken Language Model for Role-Playing and Singing7 May 2026
- 2026GaMMA: Towards Joint Global-Temporal Music Understanding in Large Multimodal Models1 May 2026
- 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interaction30 Apr 2026
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASR20 Apr 2026
38 more
- 2026Efficient Training for Cross-lingual Speech Language Models13 Apr 2026
- 2026Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMs9 Apr 2026
- 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokens29 Mar 2026
- 2026MOSS-TTS Technical Report18 Mar 2026
- 2026Uni-ASR: Unified LLM-Based Architecture for Non-Streaming and Streaming Automatic Speech Recognition11 Mar 2026
- 2026Eureka-Audio: Triggering Audio Intelligence in Compact Language Models15 Feb 2026
- 2026ERNIE 5.0 Technical Report4 Feb 2026
- 2026VoxPrivacy: A Benchmark for Evaluating Interactional Privacy of Speech Language Models27 Jan 2026
- 2026SonicBench: Dissecting the Physical Perception Bottleneck in Large Audio Language Models16 Jan 2026
- 2026DSA-Tokenizer: Disentangled Semantic-Acoustic Tokenization via Flow Matching-based Hierarchical Fusion14 Jan 2026
- 2026Towards Comprehensive Semantic Speech Embeddings for Chinese Dialects12 Jan 2026
- 2025AnyExperts: On-Demand Expert Allocation for Multimodal Language Models with Mixture of Expert23 Nov 2025
- 2025VoiceCraft-X: Unifying Multilingual, Voice-Cloning Speech Synthesis and Speech Editing15 Nov 2025
- 2025LongCat-Flash-Omni Technical Report31 Oct 2025
- 2025InteractiveOmni: A Unified Omni-modal Model for Audio-Visual Multi-turn Dialogue15 Oct 2025
- 2025Steer-MoE: Efficient Audio-Language Alignment with a Mixture-of-Experts Steering Module15 Oct 2025
- 2025End-to-end Speech Recognition with similar length speech and text12 Oct 2025
- 2025MGM-Omni: Scaling Omni LLMs to Personalized Long-Horizon Speech29 Sep 2025
- 2025Easy Turn: Integrating Acoustic and Linguistic Modalities for Robust Turn-Taking in Full-Duplex Spoken Dialogue Systems28 Sep 2025
- 2025WEST: LLM based Speech Toolkit for Speech Understanding, Generation, and Interaction24 Sep 2025
- 2025Fun-ASR Technical Report15 Sep 2025
- 2025CabinSep: IR-Augmented Mask-Based MVDR for Real-Time In-Car Speech Separation with Distributed Heterogeneous Arrays1 Sep 2025
- 2025Cross-Learning Fine-Tuning Strategy for Dysarthric Speech Recognition Via CDSD database26 Aug 2025
- 2025Attention2Probability: Attention-Driven Terminology Probability Estimation for Robust Speech-to-Text System26 Aug 2025
- 2025A Survey of Threats Against Voice Authentication and Anti-Spoofing Systems22 Aug 2025
- 2025Leveraging Zipformer Model for Effective Language Identification in Code-Switched Child-Directed Speech13 Aug 2025
- 2025UniFlow: Unifying Speech Front-End Tasks via Continuous Generative Modeling11 Aug 2025
- 2025SpeakerLM: End-to-End Versatile Speaker Diarization and Recognition with Multimodal Large Language Models8 Aug 2025
- 2025ContextASR-Bench: A Massive Contextual Speech Recognition Benchmark8 Jul 2025
- 2025GLAP: General contrastive audio-text pretraining across domains and languages12 Jun 2025
- 2025DEBATE: A Dataset for Disentangling Textual Ambiguity in Mandarin Through Speech9 Jun 2025
- 2025LESS: Large Language Model Enhanced Semi-Supervised Learning for Speech Foundational Models Using in-the-wild Data5 Jun 2025
- 2025Fewer Hallucinations, More Verification: A Three-Stage LLM-Based Framework for ASR Error Correction30 May 2025
- 2025OmniCharacter: Towards Immersive Role-Playing Agents with Seamless Speech-Language Personality Interaction26 May 2025
- 2025Impact of Frame Rates on Speech Tokenizer: A Case Study on Mandarin and English20 May 2025
- 2025Inclusivity of AI Speech in Healthcare: A Decade Look Back15 May 2025
- 2025VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Model6 May 2025
- 2025Voice Cloning: Comprehensive Survey1 May 2025
50 newest of 125 All 125 (JSON)
- 2023A Survey on Multimodal Large Language Modelscited by 898
- 2024OmniBench: Towards The Future of Universal Omni-Language Modelscited by 100
- 2025MinMo: A Multimodal Large Language Model for Seamless Voice Interactioncited by 79
- 2024A Survey of Multimodal Large Language Model from A Data-centric Perspectivecited by 73
- 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interactioncited by 64
- 2024Survey of Large Multimodal Model Datasets, Application Categories and Taxonomycited by 17
- 2025SpeakerLM: End-to-End Versatile Speaker Diarization and Recognition with Multimodal Large Language Modelscited by 14
- 2025AnyExperts: On-Demand Expert Allocation for Multimodal Language Models with Mixture of Expertcited by 0
- 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interaction30 Apr 2026
- 2025AnyExperts: On-Demand Expert Allocation for Multimodal Language Models with Mixture of Expert23 Nov 2025
- 2025SpeakerLM: End-to-End Versatile Speaker Diarization and Recognition with Multimodal Large Language Models8 Aug 2025
- 2025MinMo: A Multimodal Large Language Model for Seamless Voice Interaction10 Jan 2025
- 2024Survey of Large Multimodal Model Datasets, Application Categories and Taxonomy23 Dec 2024
- 2024OmniBench: Towards The Future of Universal Omni-Language Models23 Sep 2024
- 2024A Survey of Multimodal Large Language Model from A Data-centric Perspective26 May 2024
- 2023A Survey on Multimodal Large Language Models23 Jun 2023
- 2025LongCat-Flash-Omni Technical Reportcited by 23
- 2026ERNIE 5.0 Technical Reportcited by 9
- 2025Steer-MoE: Efficient Audio-Language Alignment with a Mixture-of-Experts Steering Modulecited by 2
- 2026Qwen-Audio-3.0-ASR Technical Reportcited by 1
- 2026Eureka-Audio: Triggering Audio Intelligence in Compact Language Modelscited by 0
- 2026Qwen-Audio-3.0-ASR Technical Report7 Sep 2026
- 2026Eureka-Audio: Triggering Audio Intelligence in Compact Language Models15 Feb 2026
- 2026ERNIE 5.0 Technical Report4 Feb 2026
- 2025LongCat-Flash-Omni Technical Report31 Oct 2025
- 2025Steer-MoE: Efficient Audio-Language Alignment with a Mixture-of-Experts Steering Module15 Oct 2025
- 2024Mamba for Streaming ASR Combined with Unimodal Aggregation30 Sep 2024
- 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 591
- 2024Qwen2-Audio Technical Reportcited by 543
- 2025Kimi-Audio Technical Reportcited by 210
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 189
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2022Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognitioncited by 139
- 2024FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMscited by 118
- 2023FunASR: A Fundamental End-to-End Speech Recognition Toolkitcited by 92
- 2024WavChat: A Survey of Spoken Dialogue Modelscited by 88
- 2023LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPTcited by 77
- 2022WeNet 2.0: More Productive End-to-End Speech Recognition Toolkitcited by 46
- 2023FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codeccited by 44
12 most cited of 105 All 105 (JSON)
- 2026Pretrained ASR Pseudo-labeling for Noisy Police Audio24 Sep 2026
- 2026X2Streaming-ASR: wait when uncertain, emit when ready for streaming ASR8 Sep 2026
- 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generation25 Aug 2026
- 2026Relative Time Intervals Representation for Word-level Timestamping with Masked Training25 Aug 2026
- 2026X2-Turn: Frame-Synchronous Dual-Head Modeling for Joint Streaming ASR and Turn State Prediction11 Aug 2026
- 2026PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialects31 May 2026
- 2026HoliTok: A Continuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding28 May 2026
- 2026VITA-QinYu: Expressive Spoken Language Model for Role-Playing and Singing7 May 2026
- 2026GaMMA: Towards Joint Global-Temporal Music Understanding in Large Multimodal Models1 May 2026
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASR20 Apr 2026
- 2026Efficient Training for Cross-lingual Speech Language Models13 Apr 2026
- 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokens29 Mar 2026
12 newest of 105 All 105 (JSON)