The ASRU 2019 Mandarin-English Code-Switching Speech Recognition Challenge: Open Datasets, Tracks, Methods and Results
Not on the map. Why?
Abstract (arXiv)
Code-switching (CS) is a common phenomenon and recognizing CS speech is challenging. But CS speech data is scarce and there' s no common testbed in relevant research. This paper describes the design and main outcomes of the ASRU 2019 Mandarin-English code-switching speech recognition challenge, which aims to improve the ASR performance in Mandarin-English code-switching situation. 500 hours Mandarin speech data and 240 hours Mandarin-English intra-sentencial CS data are released to the participants. Three tracks were set for advancing the AM and LM part in traditional DNN-HMM ASR system, as well as exploring the E2E models' performance. The paper then presents an overview of the results and system performance in the three tracks. It turns out that traditional ASR system benefits from pronunciation lexicon, CS text generating and data augmentation. In E2E track, however, the results highlight the importance of using language identification, building-up a rational set of modeling units and spec-augment. The other details in model training and method comparsion are discussed.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 9; 2023: 7; 2024: 10; 2025: 4; 2026: 10.
43 papers.
Sort:
By area:
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 189
- 2024Mamba in Speech: Towards an Alternative to Self-Attentioncited by 58
- 2021ASCEND: A Spontaneous Chinese-English Dataset for Code-switching in Multi-turn Conversationcited by 43
- 2023HyPoradise: An Open Baseline for Generative Speech Recognition with Large Language Modelscited by 41
- 2022End-to-End Speech Translation for Code Switched Speechcited by 26
- 2023Language-Routing Mixture of Experts for Multilingual and Code-Switching Speech Recognitioncited by 26
- 2022LAE: Language-Aware Encoder for Monolingual and Multilingual ASRcited by 21
- 2021Joint Modeling of Code-Switched and Monolingual ASR via Conditional Factorizationcited by 17
- 2022TALCS: An Open-Source Mandarin-English Code-Switching Corpus and a Speech Recognition Baselinecited by 17
- 2022Towards Zero-Shot Code-Switched Speech Recognitioncited by 15
- 2025ContextASR-Bench: A Massive Contextual Speech Recognition Benchmarkcited by 14
- 2025CS-Dialogue: A 104-Hour Dataset of Spontaneous Mandarin-English Code-Switching Dialogues for Speech Recognitioncited by 10
31 more
- 2024Boosting Code-Switching ASR with Mixture of Experts Enhanced Speech-Conditioned LLMcited by 9
- 2023BA-MoE: Boundary-Aware Mixture-of-Experts Adapter for Code-Switching Speech Recognitioncited by 8
- 2024An Effective Mixture-Of-Experts Approach For Code-Switching Speech Recognition Leveraging Encoder Disentanglementcited by 8
- 2023Leveraging Data Collection and Unsupervised Learning for Code-switched Tunisian Arabic Automatic Speech Recognitioncited by 7
- 2023Generative error correction for code-switching speech recognition using large language modelscited by 7
- 2026SLAM-LLM: A Modular, Open-Source Multimodal Large Language Model Framework and Best Practice for Speech, Language, Audio and Music Processingcited by 7
- 2022Reducing language context confusion for end-to-end code-switching automatic speech recognitioncited by 6
- 2023LAE-ST-MoE: Boosted Language-Aware Encoder Using Speech Translation Auxiliary Task for E2E Code-switching ASRcited by 6
- 2024SC-MoE: Switch Conformer Mixture of Experts for Unified Streaming and Non-streaming Code-Switching ASRcited by 6
- 2022Internal Language Model Estimation based Language Model Fusion for Cross-Domain Code-Switching Speech Recognitioncited by 5
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Reviewcited by 4
- 2025HiKE: Hierarchical Evaluation Framework for Korean-English Code-Switching Speech Recognitioncited by 4
- 2024CAMEL: Cross-Attention Enhanced Mixture-of-Experts and Language Bias for Code-Switching Speech Recognitioncited by 3
- 2026ViMedCSS: A Vietnamese Medical Code-Switching Speech Dataset & Benchmarkcited by 3
- 2022Monolingual Recognizers Fusion for Code-switching Speech Recognitioncited by 2
- 2023Improving Code-Switching and Named Entity Recognition in ASR with Speech Editing based Data Augmentationcited by 2
- 2024Improving Zero-Shot Chinese-English Code-Switching ASR with kNN-CTC and Gated Monolingual Datastorescited by 2
- 2024Dynamic Language Group-Based MoE: Enhancing Code-Switching Speech Recognition with Hierarchical Routingcited by 2
- 2024Enhancing Code-Switching Speech Recognition with LID-Based Collaborative Mixture of Experts Modelcited by 2
- 2026Towards Human-Like Interactive Speech Recognition With Agentic Correction and Semantic Evaluationcited by 2
- 2022Adversarial synthesis based data-augmentation for code-switched spoken language identificationcited by 1
- 2022Summary on the ISCSLP 2022 Chinese-English Code-Switching ASR Challengecited by 1
- 2024A Comparative Study of LLM-based ASR and Whisper in Low Resource and Code Switching Scenariocited by 1
- 2026Interactive ASR: Towards Human-Like Interaction and Semantic Coherence Evaluation for Agentic Speech Recognitioncited by 1
- 2024Enhancing Code-Switching ASR Leveraging Non-Peaky CTC Loss and Deep Language Posterior Injectioncited by 0
- 2026PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialectscited by 0
- 2026Read What You Hear: Reference-Free Hypotheses Evaluation with Acoustic Discrepancycited by 0
- 2026Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairscited by 0
- 2026Latent Softmax for Data-Efficient Phoneme-Based Multilingual ASR Across Tonal and Non-Tonal Languagescited by 0
- 2026AfriSwitch: A Benchmark for In-the-Wild African Code-Switched Speech Recognitioncited by 0
- 2026Pretrained ASR Pseudo-labeling for Noisy Police Audiocited by 0
- 2026Pretrained ASR Pseudo-labeling for Noisy Police Audio24 Sep 2026
- 2026AfriSwitch: A Benchmark for In-the-Wild African Code-Switched Speech Recognition26 Aug 2026
- 2026Latent Softmax for Data-Efficient Phoneme-Based Multilingual ASR Across Tonal and Non-Tonal Languages2 Aug 2026
- 2026Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairs4 Jun 2026
- 2026Read What You Hear: Reference-Free Hypotheses Evaluation with Acoustic Discrepancy3 Jun 2026
- 2026PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialects31 May 2026
- 2026Towards Human-Like Interactive Speech Recognition With Agentic Correction and Semantic Evaluation28 May 2026
- 2026Interactive ASR: Towards Human-Like Interaction and Semantic Coherence Evaluation for Agentic Speech Recognition10 Apr 2026
- 2026ViMedCSS: A Vietnamese Medical Code-Switching Speech Dataset & Benchmark13 Feb 2026
- 2026SLAM-LLM: A Modular, Open-Source Multimodal Large Language Model Framework and Best Practice for Speech, Language, Audio and Music Processing14 Jan 2026
- 2025HiKE: Hierarchical Evaluation Framework for Korean-English Code-Switching Speech Recognition29 Sep 2025
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Review10 Jul 2025
31 more
- 2025ContextASR-Bench: A Massive Contextual Speech Recognition Benchmark8 Jul 2025
- 2025CS-Dialogue: A 104-Hour Dataset of Spontaneous Mandarin-English Code-Switching Dialogues for Speech Recognition26 Feb 2025
- 2024CAMEL: Cross-Attention Enhanced Mixture-of-Experts and Language Bias for Code-Switching Speech Recognition17 Dec 2024
- 2024A Comparative Study of LLM-based ASR and Whisper in Low Resource and Code Switching Scenario1 Dec 2024
- 2024Enhancing Code-Switching ASR Leveraging Non-Peaky CTC Loss and Deep Language Posterior Injection26 Nov 2024
- 2024Boosting Code-Switching ASR with Mixture of Experts Enhanced Speech-Conditioned LLM24 Sep 2024
- 2024Enhancing Code-Switching Speech Recognition with LID-Based Collaborative Mixture of Experts Model3 Sep 2024
- 2024Dynamic Language Group-Based MoE: Enhancing Code-Switching Speech Recognition with Hierarchical Routing26 Jul 2024
- 2024SC-MoE: Switch Conformer Mixture of Experts for Unified Streaming and Non-streaming Code-Switching ASR26 Jun 2024
- 2024Improving Zero-Shot Chinese-English Code-Switching ASR with kNN-CTC and Gated Monolingual Datastores6 Jun 2024
- 2024Mamba in Speech: Towards an Alternative to Self-Attention21 May 2024
- 2024An Effective Mixture-Of-Experts Approach For Code-Switching Speech Recognition Leveraging Encoder Disentanglement27 Feb 2024
- 2023Generative error correction for code-switching speech recognition using large language models17 Oct 2023
- 2023BA-MoE: Boundary-Aware Mixture-of-Experts Adapter for Code-Switching Speech Recognition4 Oct 2023
- 2023LAE-ST-MoE: Boosted Language-Aware Encoder Using Speech Translation Auxiliary Task for E2E Code-switching ASR28 Sep 2023
- 2023HyPoradise: An Open Baseline for Generative Speech Recognition with Large Language Models27 Sep 2023
- 2023Leveraging Data Collection and Unsupervised Learning for Code-switched Tunisian Arabic Automatic Speech Recognition20 Sep 2023
- 2023Language-Routing Mixture of Experts for Multilingual and Code-Switching Speech Recognition12 Jul 2023
- 2023Improving Code-Switching and Named Entity Recognition in ASR with Speech Editing based Data Augmentation14 Jun 2023
- 2022Towards Zero-Shot Code-Switched Speech Recognition2 Nov 2022
- 2022Monolingual Recognizers Fusion for Code-switching Speech Recognition2 Nov 2022
- 2022Summary on the ISCSLP 2022 Chinese-English Code-Switching ASR Challenge12 Oct 2022
- 2022Internal Language Model Estimation based Language Model Fusion for Cross-Domain Code-Switching Speech Recognition9 Jul 2022
- 2022TALCS: An Open-Source Mandarin-English Code-Switching Corpus and a Speech Recognition Baseline27 Jun 2022
- 2022LAE: Language-Aware Encoder for Monolingual and Multilingual ASR5 Jun 2022
- 2022Adversarial synthesis based data-augmentation for code-switched spoken language identification30 May 2022
- 2022End-to-End Speech Translation for Code Switched Speech11 Apr 2022
- 2022Reducing language context confusion for end-to-end code-switching automatic speech recognition28 Jan 2022
- 2021ASCEND: A Spontaneous Chinese-English Dataset for Code-switching in Multi-turn Conversation12 Dec 2021
- 2021Joint Modeling of Code-Switched and Monolingual ASR via Conditional Factorization29 Nov 2021
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognition7 Oct 2021
- 2023Language-Routing Mixture of Experts for Multilingual and Code-Switching Speech Recognitioncited by 26
- 2024Boosting Code-Switching ASR with Mixture of Experts Enhanced Speech-Conditioned LLMcited by 9
- 2023BA-MoE: Boundary-Aware Mixture-of-Experts Adapter for Code-Switching Speech Recognitioncited by 8
- 2024An Effective Mixture-Of-Experts Approach For Code-Switching Speech Recognition Leveraging Encoder Disentanglementcited by 8
- 2023LAE-ST-MoE: Boosted Language-Aware Encoder Using Speech Translation Auxiliary Task for E2E Code-switching ASRcited by 6
- 2024SC-MoE: Switch Conformer Mixture of Experts for Unified Streaming and Non-streaming Code-Switching ASRcited by 6
- 2024CAMEL: Cross-Attention Enhanced Mixture-of-Experts and Language Bias for Code-Switching Speech Recognitioncited by 3
- 2024Dynamic Language Group-Based MoE: Enhancing Code-Switching Speech Recognition with Hierarchical Routingcited by 2
- 2024Enhancing Code-Switching Speech Recognition with LID-Based Collaborative Mixture of Experts Modelcited by 2
- 2024Enhancing Code-Switching ASR Leveraging Non-Peaky CTC Loss and Deep Language Posterior Injectioncited by 0
- 2024CAMEL: Cross-Attention Enhanced Mixture-of-Experts and Language Bias for Code-Switching Speech Recognition17 Dec 2024
- 2024Enhancing Code-Switching ASR Leveraging Non-Peaky CTC Loss and Deep Language Posterior Injection26 Nov 2024
- 2024Boosting Code-Switching ASR with Mixture of Experts Enhanced Speech-Conditioned LLM24 Sep 2024
- 2024Enhancing Code-Switching Speech Recognition with LID-Based Collaborative Mixture of Experts Model3 Sep 2024
- 2024Dynamic Language Group-Based MoE: Enhancing Code-Switching Speech Recognition with Hierarchical Routing26 Jul 2024
- 2024SC-MoE: Switch Conformer Mixture of Experts for Unified Streaming and Non-streaming Code-Switching ASR26 Jun 2024
- 2024An Effective Mixture-Of-Experts Approach For Code-Switching Speech Recognition Leveraging Encoder Disentanglement27 Feb 2024
- 2023BA-MoE: Boundary-Aware Mixture-of-Experts Adapter for Code-Switching Speech Recognition4 Oct 2023
- 2023LAE-ST-MoE: Boosted Language-Aware Encoder Using Speech Translation Auxiliary Task for E2E Code-switching ASR28 Sep 2023
- 2023Language-Routing Mixture of Experts for Multilingual and Code-Switching Speech Recognition12 Jul 2023
- 2024Mamba in Speech: Towards an Alternative to Self-Attentioncited by 58
- 2024Mamba in Speech: Towards an Alternative to Self-Attention21 May 2024
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 189
- 2021ASCEND: A Spontaneous Chinese-English Dataset for Code-switching in Multi-turn Conversationcited by 43
- 2023HyPoradise: An Open Baseline for Generative Speech Recognition with Large Language Modelscited by 41
- 2022End-to-End Speech Translation for Code Switched Speechcited by 26
- 2022LAE: Language-Aware Encoder for Monolingual and Multilingual ASRcited by 21
- 2021Joint Modeling of Code-Switched and Monolingual ASR via Conditional Factorizationcited by 17
- 2022TALCS: An Open-Source Mandarin-English Code-Switching Corpus and a Speech Recognition Baselinecited by 17
- 2022Towards Zero-Shot Code-Switched Speech Recognitioncited by 15
- 2025ContextASR-Bench: A Massive Contextual Speech Recognition Benchmarkcited by 14
- 2025CS-Dialogue: A 104-Hour Dataset of Spontaneous Mandarin-English Code-Switching Dialogues for Speech Recognitioncited by 10
- 2023Leveraging Data Collection and Unsupervised Learning for Code-switched Tunisian Arabic Automatic Speech Recognitioncited by 7
- 2023Generative error correction for code-switching speech recognition using large language modelscited by 7
12 most cited of 29 All 29 (JSON)
- 2026Pretrained ASR Pseudo-labeling for Noisy Police Audio24 Sep 2026
- 2026AfriSwitch: A Benchmark for In-the-Wild African Code-Switched Speech Recognition26 Aug 2026
- 2026Latent Softmax for Data-Efficient Phoneme-Based Multilingual ASR Across Tonal and Non-Tonal Languages2 Aug 2026
- 2026Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairs4 Jun 2026
- 2026Read What You Hear: Reference-Free Hypotheses Evaluation with Acoustic Discrepancy3 Jun 2026
- 2026PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialects31 May 2026
- 2026ViMedCSS: A Vietnamese Medical Code-Switching Speech Dataset & Benchmark13 Feb 2026
- 2025HiKE: Hierarchical Evaluation Framework for Korean-English Code-Switching Speech Recognition29 Sep 2025
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Review10 Jul 2025
- 2025ContextASR-Bench: A Massive Contextual Speech Recognition Benchmark8 Jul 2025
- 2025CS-Dialogue: A 104-Hour Dataset of Spontaneous Mandarin-English Code-Switching Dialogues for Speech Recognition26 Feb 2025
- 2024A Comparative Study of LLM-based ASR and Whisper in Low Resource and Code Switching Scenario1 Dec 2024
12 newest of 29 All 29 (JSON)