Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairs
Not on the map. Why?
Abstract (arXiv)
Automatic Speech Recognition (ASR) has become a key technology for human--AI interaction. However, code-switching ASR (CS-ASR) remains particularly challenging due to the severe scarcity of multilingual CS speech resources across diverse language pairs. Existing approaches primarily improve CS-ASR performance through synthetic CS speech generation or pair-specific fine-tuning on limited bilingual datasets. Nevertheless, these approaches face an inherent scalability limitation, as support for CS must be developed separately for language pairs whose number grows combinatorially with the number of supported languages. In this work, we investigate whether CS capabilities learned from a limited set of seen language pairs can generalize to unseen language pairs through model merging and domain generalization methods. Our experiments show that merged bilingual CS-ASR models modestly generalize to unseen language pairs, suggesting limited transfer of bilingual CS capabilities across language pairs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 36 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
27 of 36 references.
References · 27
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2022Editing Models with Task Arithmeticcited by 1,120
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
- 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 694
- 2021Gradient Matching for Domain Generalizationcited by 258
- 2024Arcee's MergeKit: A Toolkit for Merging Large Language Modelscited by 194
- 2020The ASRU 2019 Mandarin-English Code-Switching Speech Recognition Challenge: Open Datasets, Tracks, Methods and Resultscited by 44
- 2025Bring Reason to Vision: Understanding Perception and Reasoning through Model Mergingcited by 40
- 2024Layer Swapping for Zero-Shot Cross-Lingual Transfer in Large Language Modelscited by 21
- 2024Unlocking the Potential of Model Merging for Low-Resource Languagescited by 19
- 2022TALCS: An Open-Source Mandarin-English Code-Switching Corpus and a Speech Recognition Baselinecited by 17
15 more
- 2020Improving Low Resource Code-switched ASR using Augmented Code-switched TTScited by 15
- 2025OptMerge: Unifying Multimodal LLM Capabilities and Modalities via Model Mergingcited by 13
- 2025CS-FLEURS: A Massively Multilingual and Code-Switched Speech Datasetcited by 12
- 2023Code-Switching Text Generation and Injection in Mandarin-English ASRcited by 11
- 2025CS-Dialogue: A 104-Hour Dataset of Spontaneous Mandarin-English Code-Switching Dialogues for Speech Recognitioncited by 10
- 2024Boosting Code-Switching ASR with Mixture of Experts Enhanced Speech-Conditioned LLMcited by 9
- 2025Gradient-Guided Annealing for Domain Generalizationcited by 9
- 2023Adapting the adapters for code-switching in multilingual ASRcited by 6
- 2025HiKE: Hierarchical Evaluation Framework for Korean-English Code-Switching Speech Recognitioncited by 4
- 2025Robust fine-tuning of speech recognition models via model merging: application to disordered speechcited by 3
- 2025DOTA-ME-CS: Daily Oriented Text Audio-Mandarin English-Code Switching Datasetcited by 2
- 2025AsyncSwitch: Asynchronous Text-Speech Adaptation for Code-Switched ASRcited by 2
- 2025UniCoM: A Universal Code-Switching Speech Generatorcited by 2
- 2025Group-Aware Partial Model Merging for Children's Automatic Speech Recognitioncited by 2
- 2026Layer-wise Swapping for Generalizable Multilingual Safetycited by 2
Built on by
Not cited yet.