Data Augmentation for End-to-end Code-switching Speech Recognition
Not on the map. Why?
Abstract (arXiv)
Training a code-switching end-to-end automatic speech recognition (ASR) model normally requires a large amount of data, while code-switching data is often limited. In this paper, three novel approaches are proposed for code-switching data augmentation. Specifically, they are audio splicing with the existing code-switching data, and TTS with new code-switching texts generated by word translation or word insertion. Our experiments on 200 hours Mandarin-English code-switching dataset show that all the three proposed approaches yield significant improvements on code-switching ASR individually. Moreover, all the proposed approaches can be combined with recent popular SpecAugment, and an addition gain can be obtained. WER is significantly reduced by relative 24.0% compared to the system without any data augmentation, and still relative 13.0% gain compared to the system with only SpecAugment
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 3; 2023: 3; 2024: 3; 2025: 5; 2026: 1.
20 papers.
Sort:
By area:
- 2021QASR: QCRI Aljazeera Speech Resource -- A Large Scale Annotated Arabic Speech Corpuscited by 38
- 2022End-to-End Speech Translation for Code Switched Speechcited by 26
- 2021On-the-Fly Aligned Data Augmentation for Sequence-to-Sequence ASRcited by 9
- 2021Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation Modelscited by 9
- 2021Non-autoregressive Mandarin-English Code-switching Speech Recognitioncited by 8
- 2022Language-agnostic Code-Switching in Sequence-To-Sequence Speech Recognitioncited by 7
- 2023LAE-ST-MoE: Boosted Language-Aware Encoder Using Speech Translation Auxiliary Task for E2E Code-switching ASRcited by 6
- 2024SC-MoE: Switch Conformer Mixture of Experts for Unified Streaming and Non-streaming Code-Switching ASRcited by 6
- 2022Internal Language Model Estimation based Language Model Fusion for Cross-Domain Code-Switching Speech Recognitioncited by 5
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Reviewcited by 4
- 2023Cross-Corpora Spoken Language Identification with Domain Diversification and Generalizationcited by 3
- 2024CAMEL: Cross-Attention Enhanced Mixture-of-Experts and Language Bias for Code-Switching Speech Recognitioncited by 3
8 more
- 2023Improving Code-Switching and Named Entity Recognition in ASR with Speech Editing based Data Augmentationcited by 2
- 2025SAGE: Spliced-Audio Generated Data for Enhancing Foundational Models in Low-Resource Arabic-English Code-Switched Speech Recognitioncited by 2
- 2025Adapting Language Balance in Code-Switching Speechcited by 2
- 2021Global Structure-Aware Drum Transcription Based on Self-Attention Mechanismscited by 1
- 2025AsyncSwitch: Asynchronous Text-Speech Adaptation for Code-Switched ASRcited by 1
- 2025Bayesian Low-Rank Factorization for Robust Model Adaptationcited by 1
- 2024Enhancing Code-switched Text-to-Speech Synthesis Capability in Large Language Models with only Monolingual Corporacited by 0
- 2026Adding Robust Code-Switching Capabilities to High Performance Multilingual ASRcited by 0
- 2026Adding Robust Code-Switching Capabilities to High Performance Multilingual ASR20 Jun 2026
- 2025Adapting Language Balance in Code-Switching Speech21 Oct 2025
- 2025Bayesian Low-Rank Factorization for Robust Model Adaptation21 Oct 2025
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Review10 Jul 2025
- 2025SAGE: Spliced-Audio Generated Data for Enhancing Foundational Models in Low-Resource Arabic-English Code-Switched Speech Recognition27 Jun 2025
- 2025AsyncSwitch: Asynchronous Text-Speech Adaptation for Code-Switched ASR17 Jun 2025
- 2024CAMEL: Cross-Attention Enhanced Mixture-of-Experts and Language Bias for Code-Switching Speech Recognition17 Dec 2024
- 2024Enhancing Code-switched Text-to-Speech Synthesis Capability in Large Language Models with only Monolingual Corpora17 Sep 2024
- 2024SC-MoE: Switch Conformer Mixture of Experts for Unified Streaming and Non-streaming Code-Switching ASR26 Jun 2024
- 2023LAE-ST-MoE: Boosted Language-Aware Encoder Using Speech Translation Auxiliary Task for E2E Code-switching ASR28 Sep 2023
- 2023Improving Code-Switching and Named Entity Recognition in ASR with Speech Editing based Data Augmentation14 Jun 2023
- 2023Cross-Corpora Spoken Language Identification with Domain Diversification and Generalization10 Feb 2023
8 more
- 2022Language-agnostic Code-Switching in Sequence-To-Sequence Speech Recognition17 Oct 2022
- 2022Internal Language Model Estimation based Language Model Fusion for Cross-Domain Code-Switching Speech Recognition9 Jul 2022
- 2022End-to-End Speech Translation for Code Switched Speech11 Apr 2022
- 2021Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation Models7 Oct 2021
- 2021QASR: QCRI Aljazeera Speech Resource -- A Large Scale Annotated Arabic Speech Corpus24 Jun 2021
- 2021Global Structure-Aware Drum Transcription Based on Self-Attention Mechanisms12 May 2021
- 2021Non-autoregressive Mandarin-English Code-switching Speech Recognition6 Apr 2021
- 2021On-the-Fly Aligned Data Augmentation for Sequence-to-Sequence ASR3 Apr 2021
- 2023LAE-ST-MoE: Boosted Language-Aware Encoder Using Speech Translation Auxiliary Task for E2E Code-switching ASRcited by 6
- 2024SC-MoE: Switch Conformer Mixture of Experts for Unified Streaming and Non-streaming Code-Switching ASRcited by 6
- 2024CAMEL: Cross-Attention Enhanced Mixture-of-Experts and Language Bias for Code-Switching Speech Recognitioncited by 3
- 2024CAMEL: Cross-Attention Enhanced Mixture-of-Experts and Language Bias for Code-Switching Speech Recognition17 Dec 2024
- 2024SC-MoE: Switch Conformer Mixture of Experts for Unified Streaming and Non-streaming Code-Switching ASR26 Jun 2024
- 2023LAE-ST-MoE: Boosted Language-Aware Encoder Using Speech Translation Auxiliary Task for E2E Code-switching ASR28 Sep 2023
- 2021QASR: QCRI Aljazeera Speech Resource -- A Large Scale Annotated Arabic Speech Corpuscited by 38
- 2022End-to-End Speech Translation for Code Switched Speechcited by 26
- 2021On-the-Fly Aligned Data Augmentation for Sequence-to-Sequence ASRcited by 9
- 2021Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation Modelscited by 9
- 2021Non-autoregressive Mandarin-English Code-switching Speech Recognitioncited by 8
- 2022Language-agnostic Code-Switching in Sequence-To-Sequence Speech Recognitioncited by 7
- 2022Internal Language Model Estimation based Language Model Fusion for Cross-Domain Code-Switching Speech Recognitioncited by 5
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Reviewcited by 4
- 2023Cross-Corpora Spoken Language Identification with Domain Diversification and Generalizationcited by 3
- 2023Improving Code-Switching and Named Entity Recognition in ASR with Speech Editing based Data Augmentationcited by 2
- 2025SAGE: Spliced-Audio Generated Data for Enhancing Foundational Models in Low-Resource Arabic-English Code-Switched Speech Recognitioncited by 2
- 2025Adapting Language Balance in Code-Switching Speechcited by 2
12 most cited of 17 All 17 (JSON)
- 2026Adding Robust Code-Switching Capabilities to High Performance Multilingual ASR20 Jun 2026
- 2025Adapting Language Balance in Code-Switching Speech21 Oct 2025
- 2025Bayesian Low-Rank Factorization for Robust Model Adaptation21 Oct 2025
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Review10 Jul 2025
- 2025SAGE: Spliced-Audio Generated Data for Enhancing Foundational Models in Low-Resource Arabic-English Code-Switched Speech Recognition27 Jun 2025
- 2025AsyncSwitch: Asynchronous Text-Speech Adaptation for Code-Switched ASR17 Jun 2025
- 2024Enhancing Code-switched Text-to-Speech Synthesis Capability in Large Language Models with only Monolingual Corpora17 Sep 2024
- 2023Improving Code-Switching and Named Entity Recognition in ASR with Speech Editing based Data Augmentation14 Jun 2023
- 2023Cross-Corpora Spoken Language Identification with Domain Diversification and Generalization10 Feb 2023
- 2022Language-agnostic Code-Switching in Sequence-To-Sequence Speech Recognition17 Oct 2022
- 2022Internal Language Model Estimation based Language Model Fusion for Cross-Domain Code-Switching Speech Recognition9 Jul 2022
- 2022End-to-End Speech Translation for Code Switched Speech11 Apr 2022
12 newest of 17 All 17 (JSON)