On the End-to-End Solution to Mandarin-English Code-switching Speech Recognition
Not on the map. Why?
Abstract (arXiv)
Code-switching (CS) refers to a linguistic phenomenon where a speaker uses different languages in an utterance or between alternating utterances. In this work, we study end-to-end (E2E) approaches to the Mandarin-English code-switching speech recognition (CSSR) task. We first examine the effectiveness of using data augmentation and byte-pair encoding (BPE) subword units. More importantly, we propose a multitask learning recipe, where a language identification task is explicitly learned in addition to the E2E speech recognition task. Furthermore, we introduce an efficient word vocabulary expansion method for language modeling to alleviate data sparsity issues under the code-switching scenario. Experimental results on the SEAME data, a Mandarin-English CS corpus, demonstrate the effectiveness of the proposed methods.
Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 10; 2023: 4; 2024: 4; 2025: 3; 2026: 3.
30 papers.
Sort:
By area:
- 2024Mamba in Speech: Towards an Alternative to Self-Attentioncited by 60
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2022End-to-End Speech Translation for Code Switched Speechcited by 26
- 2022Streaming End-to-End Multilingual Speech Recognition with Joint Language Identificationcited by 24
- 2022Language-specific Characteristic Assistance for Code-switching Speech Recognitioncited by 20
- 2021Investigations on Speech Recognition Systems for Low-Resource Dialectal Arabic-English Code-Switching Speechcited by 15
- 2022Towards Zero-Shot Code-Switched Speech Recognitioncited by 15
- 2023Code-Switching Text Generation and Injection in Mandarin-English ASRcited by 11
- 2023Multilingual self-supervised speech representations improve the speech recognition of low-resource African languages with codeswitchingcited by 11
- 2021Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation Modelscited by 9
- 2022A Language Agnostic Multilingual Streaming On-Device ASR Systemcited by 9
- 2021Non-autoregressive Mandarin-English Code-switching Speech Recognitioncited by 8
18 more
- 2024An Effective Mixture-Of-Experts Approach For Code-Switching Speech Recognition Leveraging Encoder Disentanglementcited by 8
- 2022Language-agnostic Code-Switching in Sequence-To-Sequence Speech Recognitioncited by 7
- 2021ATCSpeechNet: A multilingual end-to-end speech recognition framework for air traffic control systemscited by 6
- 2022Attentive Temporal Pooling for Conformer-based Streaming Language Identification in Long-form Speechcited by 6
- 2023LAE-ST-MoE: Boosted Language-Aware Encoder Using Speech Translation Auxiliary Task for E2E Code-switching ASRcited by 6
- 2022Internal Language Model Estimation based Language Model Fusion for Cross-Domain Code-Switching Speech Recognitioncited by 5
- 2024Leave No Knowledge Behind During Knowledge Distillation: Towards Practical and Effective Knowledge Distillation for Code-Switching ASR Using Realistic Datacited by 5
- 2021A Study of Multilingual End-to-End Speech Recognition for Kazakh, Russian, and Englishcited by 4
- 2021Integrating Knowledge in End-to-End Automatic Speech Recognition for Mandarin-English Code-Switchingcited by 4
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Reviewcited by 4
- 2023UML: A Universal Monolingual Output Layer for Multilingual ASRcited by 3
- 2022Monolingual Recognizers Fusion for Code-switching Speech Recognitioncited by 2
- 2025AdaCS: Adaptive Normalization for Enhanced Code-Switching ASRcited by 2
- 2026Direct Preference Optimization for English-Mandarin Code-Switching Speech Recognition in Audio LLMscited by 2
- 2024Romanization Encoding For Multilingual ASRcited by 1
- 2025TSPC: A Two-Stage Phoneme-Centric Architecture for code-switching Vietnamese-English Speech Recognitioncited by 0
- 2026Contrastive Training with LLM-generated Near-Misses for Robust Code-Switching Speech Recognitioncited by 0
- 2026The Exact Worst-Case Tail Probability under Bounded Kurtosiscited by 0
- 2026The Exact Worst-Case Tail Probability under Bounded Kurtosis6 Jul 2026
- 2026Contrastive Training with LLM-generated Near-Misses for Robust Code-Switching Speech Recognition5 Jun 2026
- 2026Direct Preference Optimization for English-Mandarin Code-Switching Speech Recognition in Audio LLMs13 May 2026
- 2025TSPC: A Two-Stage Phoneme-Centric Architecture for code-switching Vietnamese-English Speech Recognition7 Sep 2025
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Review10 Jul 2025
- 2025AdaCS: Adaptive Normalization for Enhanced Code-Switching ASR13 Jan 2025
- 2024Leave No Knowledge Behind During Knowledge Distillation: Towards Practical and Effective Knowledge Distillation for Code-Switching ASR Using Realistic Data15 Jul 2024
- 2024Romanization Encoding For Multilingual ASR5 Jul 2024
- 2024Mamba in Speech: Towards an Alternative to Self-Attention21 May 2024
- 2024An Effective Mixture-Of-Experts Approach For Code-Switching Speech Recognition Leveraging Encoder Disentanglement27 Feb 2024
- 2023Multilingual self-supervised speech representations improve the speech recognition of low-resource African languages with codeswitching25 Nov 2023
- 2023LAE-ST-MoE: Boosted Language-Aware Encoder Using Speech Translation Auxiliary Task for E2E Code-switching ASR28 Sep 2023
18 more
- 2023Code-Switching Text Generation and Injection in Mandarin-English ASR20 Mar 2023
- 2023UML: A Universal Monolingual Output Layer for Multilingual ASR22 Feb 2023
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges19 Dec 2022
- 2022Towards Zero-Shot Code-Switched Speech Recognition2 Nov 2022
- 2022Monolingual Recognizers Fusion for Code-switching Speech Recognition2 Nov 2022
- 2022Language-agnostic Code-Switching in Sequence-To-Sequence Speech Recognition17 Oct 2022
- 2022Streaming End-to-End Multilingual Speech Recognition with Joint Language Identification13 Sep 2022
- 2022A Language Agnostic Multilingual Streaming On-Device ASR System29 Aug 2022
- 2022Internal Language Model Estimation based Language Model Fusion for Cross-Domain Code-Switching Speech Recognition9 Jul 2022
- 2022Language-specific Characteristic Assistance for Code-switching Speech Recognition29 Jun 2022
- 2022End-to-End Speech Translation for Code Switched Speech11 Apr 2022
- 2022Attentive Temporal Pooling for Conformer-based Streaming Language Identification in Long-form Speech24 Feb 2022
- 2021Integrating Knowledge in End-to-End Automatic Speech Recognition for Mandarin-English Code-Switching19 Dec 2021
- 2021Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation Models7 Oct 2021
- 2021Investigations on Speech Recognition Systems for Low-Resource Dialectal Arabic-English Code-Switching Speech29 Aug 2021
- 2021A Study of Multilingual End-to-End Speech Recognition for Kazakh, Russian, and English3 Aug 2021
- 2021Non-autoregressive Mandarin-English Code-switching Speech Recognition6 Apr 2021
- 2021ATCSpeechNet: A multilingual end-to-end speech recognition framework for air traffic control systems17 Feb 2021
- 2024Mamba in Speech: Towards an Alternative to Self-Attentioncited by 60
- 2024Mamba in Speech: Towards an Alternative to Self-Attention21 May 2024
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2022End-to-End Speech Translation for Code Switched Speechcited by 26
- 2022Streaming End-to-End Multilingual Speech Recognition with Joint Language Identificationcited by 24
- 2022Language-specific Characteristic Assistance for Code-switching Speech Recognitioncited by 20
- 2021Investigations on Speech Recognition Systems for Low-Resource Dialectal Arabic-English Code-Switching Speechcited by 15
- 2022Towards Zero-Shot Code-Switched Speech Recognitioncited by 15
- 2023Code-Switching Text Generation and Injection in Mandarin-English ASRcited by 11
- 2023Multilingual self-supervised speech representations improve the speech recognition of low-resource African languages with codeswitchingcited by 11
- 2021Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation Modelscited by 9
- 2022A Language Agnostic Multilingual Streaming On-Device ASR Systemcited by 9
- 2021Non-autoregressive Mandarin-English Code-switching Speech Recognitioncited by 8
- 2022Language-agnostic Code-Switching in Sequence-To-Sequence Speech Recognitioncited by 7
12 most cited of 25 All 25 (JSON)
- 2026The Exact Worst-Case Tail Probability under Bounded Kurtosis6 Jul 2026
- 2026Contrastive Training with LLM-generated Near-Misses for Robust Code-Switching Speech Recognition5 Jun 2026
- 2025TSPC: A Two-Stage Phoneme-Centric Architecture for code-switching Vietnamese-English Speech Recognition7 Sep 2025
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Review10 Jul 2025
- 2025AdaCS: Adaptive Normalization for Enhanced Code-Switching ASR13 Jan 2025
- 2024Romanization Encoding For Multilingual ASR5 Jul 2024
- 2023Multilingual self-supervised speech representations improve the speech recognition of low-resource African languages with codeswitching25 Nov 2023
- 2023Code-Switching Text Generation and Injection in Mandarin-English ASR20 Mar 2023
- 2023UML: A Universal Monolingual Output Layer for Multilingual ASR22 Feb 2023
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges19 Dec 2022
- 2022Towards Zero-Shot Code-Switched Speech Recognition2 Nov 2022
- 2022Monolingual Recognizers Fusion for Code-switching Speech Recognition2 Nov 2022
12 newest of 25 All 25 (JSON)