Towards End-to-End Code-Switching Speech Recognition
Not on the map. Why?
Abstract (arXiv)
Code-switching speech recognition has attracted an increasing interest recently, but the need for expert linguistic knowledge has always been a big issue. End-to-end automatic speech recognition (ASR) simplifies the building of ASR systems considerably by predicting graphemes or characters directly from acoustic input. In the mean time, the need of expert linguistic knowledge is also eliminated, which makes it an attractive choice for code-switching ASR. This paper presents a hybrid CTC-Attention based end-to-end Mandarin-English code-switching (CS) speech recognition system and studies the effect of hybrid CTC-Attention based models, different modeling units, the inclusion of language identification and different decoding strategies on the task of code-switching ASR. On the SEAME corpus, our system achieves a mixed error rate (MER) of 34.24%.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 5; 2023: 4; 2024: 3; 2025: 1; 2026: 1.
17 papers.
Sort:
By area:
- 2022End-to-End Speech Translation for Code Switched Speechcited by 26
- 2023Language-Routing Mixture of Experts for Multilingual and Code-Switching Speech Recognitioncited by 26
- 2022Streaming End-to-End Multilingual Speech Recognition with Joint Language Identificationcited by 24
- 2021Joint Modeling of Code-Switched and Monolingual ASR via Conditional Factorizationcited by 17
- 2022TALCS: An Open-Source Mandarin-English Code-Switching Corpus and a Speech Recognition Baselinecited by 17
- 2021Investigations on Speech Recognition Systems for Low-Resource Dialectal Arabic-English Code-Switching Speechcited by 15
- 2023Multilingual self-supervised speech representations improve the speech recognition of low-resource African languages with codeswitchingcited by 11
- 2023Code-Switching Text Generation and Injection in Mandarin-English ASRcited by 10
- 2024An Effective Mixture-Of-Experts Approach For Code-Switching Speech Recognition Leveraging Encoder Disentanglementcited by 8
- 2022Language-agnostic Code-Switching in Sequence-To-Sequence Speech Recognitioncited by 7
- 2023Generative error correction for code-switching speech recognition using large language modelscited by 7
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translationcited by 5
5 more
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Reviewcited by 4
- 2021Balanced End-to-End Monolingual pre-training for Low-Resourced Indic Languages Code-Switching Speech Recognitioncited by 1
- 2022Summary on the ISCSLP 2022 Chinese-English Code-Switching ASR Challengecited by 1
- 2024The evaluation of a code-switched Sepedi-English automatic speech recognition systemcited by 0
- 2026The Exact Worst-Case Tail Probability under Bounded Kurtosiscited by 0
- 2026The Exact Worst-Case Tail Probability under Bounded Kurtosis6 Jul 2026
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Review10 Jul 2025
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translation25 Mar 2024
- 2024The evaluation of a code-switched Sepedi-English automatic speech recognition system11 Mar 2024
- 2024An Effective Mixture-Of-Experts Approach For Code-Switching Speech Recognition Leveraging Encoder Disentanglement27 Feb 2024
- 2023Multilingual self-supervised speech representations improve the speech recognition of low-resource African languages with codeswitching25 Nov 2023
- 2023Generative error correction for code-switching speech recognition using large language models17 Oct 2023
- 2023Language-Routing Mixture of Experts for Multilingual and Code-Switching Speech Recognition12 Jul 2023
- 2023Code-Switching Text Generation and Injection in Mandarin-English ASR20 Mar 2023
- 2022Language-agnostic Code-Switching in Sequence-To-Sequence Speech Recognition17 Oct 2022
- 2022Summary on the ISCSLP 2022 Chinese-English Code-Switching ASR Challenge12 Oct 2022
- 2022Streaming End-to-End Multilingual Speech Recognition with Joint Language Identification13 Sep 2022
5 more
- 2022TALCS: An Open-Source Mandarin-English Code-Switching Corpus and a Speech Recognition Baseline27 Jun 2022
- 2022End-to-End Speech Translation for Code Switched Speech11 Apr 2022
- 2021Joint Modeling of Code-Switched and Monolingual ASR via Conditional Factorization29 Nov 2021
- 2021Investigations on Speech Recognition Systems for Low-Resource Dialectal Arabic-English Code-Switching Speech29 Aug 2021
- 2021Balanced End-to-End Monolingual pre-training for Low-Resourced Indic Languages Code-Switching Speech Recognition10 Jun 2021
- 2022End-to-End Speech Translation for Code Switched Speechcited by 26
- 2022Streaming End-to-End Multilingual Speech Recognition with Joint Language Identificationcited by 24
- 2021Joint Modeling of Code-Switched and Monolingual ASR via Conditional Factorizationcited by 17
- 2022TALCS: An Open-Source Mandarin-English Code-Switching Corpus and a Speech Recognition Baselinecited by 17
- 2021Investigations on Speech Recognition Systems for Low-Resource Dialectal Arabic-English Code-Switching Speechcited by 15
- 2023Multilingual self-supervised speech representations improve the speech recognition of low-resource African languages with codeswitchingcited by 11
- 2023Code-Switching Text Generation and Injection in Mandarin-English ASRcited by 10
- 2022Language-agnostic Code-Switching in Sequence-To-Sequence Speech Recognitioncited by 7
- 2023Generative error correction for code-switching speech recognition using large language modelscited by 7
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translationcited by 5
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Reviewcited by 4
- 2021Balanced End-to-End Monolingual pre-training for Low-Resourced Indic Languages Code-Switching Speech Recognitioncited by 1
12 most cited of 15 All 15 (JSON)
- 2026The Exact Worst-Case Tail Probability under Bounded Kurtosis6 Jul 2026
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Review10 Jul 2025
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translation25 Mar 2024
- 2024The evaluation of a code-switched Sepedi-English automatic speech recognition system11 Mar 2024
- 2023Multilingual self-supervised speech representations improve the speech recognition of low-resource African languages with codeswitching25 Nov 2023
- 2023Generative error correction for code-switching speech recognition using large language models17 Oct 2023
- 2023Code-Switching Text Generation and Injection in Mandarin-English ASR20 Mar 2023
- 2022Language-agnostic Code-Switching in Sequence-To-Sequence Speech Recognition17 Oct 2022
- 2022Summary on the ISCSLP 2022 Chinese-English Code-Switching ASR Challenge12 Oct 2022
- 2022Streaming End-to-End Multilingual Speech Recognition with Joint Language Identification13 Sep 2022
- 2022TALCS: An Open-Source Mandarin-English Code-Switching Corpus and a Speech Recognition Baseline27 Jun 2022
- 2022End-to-End Speech Translation for Code Switched Speech11 Apr 2022
12 newest of 15 All 15 (JSON)