mlsanityData to 14 Oct 2026

Can we train ASR systems on Code-switch without real code-switch data? Case study for Singapore's languages

arXiv 2506.14177 ↗First posted 17 Jun 2025cs.CL cs.AI cs.SDcited by 5

Not on the map. Why?

Abstract (arXiv)

Code-switching (CS), common in multilingual settings, presents challenges for ASR due to scarce and costly transcribed data caused by linguistic complexity. This study investigates building CS-ASR using synthetic CS data. We propose a phrase-level mixing method to generate synthetic CS data that mimics natural patterns. Utilizing monolingual augmented with synthetic phrase-mixed CS data to fine-tune large pretrained ASR models (Whisper, MMS, SeamlessM4T). This paper focuses on three under-resourced Southeast Asian language pairs: Malay-English (BM-EN), Mandarin-Malay (ZH-BM), and Tamil-English (TA-EN), establishing a new comprehensive benchmark for CS-ASR to evaluate the performance of leading ASR models. Experimental results show that the proposed training strategy enhances ASR performance on monolingual and CS tests, with BM-EN showing highest gains, then TA-EN and ZH-BM. This finding offers a cost-effective approach for CS-ASR development, benefiting research and industry.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 23 of its 38 references that are in the map. First posted on arXiv 17 Jun 2025.

Builds on

23 of 38 references.

References · 23

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  3. 2023Scaling Speech Technology to 1,000+ Languagescited by 411
  4. 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 373
  5. 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 197
  6. 2023Seamless: Multilingual Expressive and Streaming Speech Translationcited by 192
  7. 2019pyannote.audio: neural building blocks for speaker diarizationcited by 181
  8. 2021Multilingual and code-switching ASR challenges for low resource Indian languagescited by 53
  9. 2021Towards One Model to Rule All: Multilingual Strategy for Dialectal Code-Switching Arabic ASRcited by 41
  10. 2022Reducing Language confusion for Code-switching Speech Recognition with Token-level Language Diarizationcited by 29
  11. 2024ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasetscited by 27
  12. 2023Language-Routing Mixture of Experts for Multilingual and Code-Switching Speech Recognitioncited by 26
11 more
  1. 2023Enhancing Code-switching Speech Recognition with Interactive Language Biasescited by 21
  2. 2024Tradition or Innovation: A Comparison of Modern ASR Methods for Forced Alignmentcited by 21
  3. 2022Language-specific Characteristic Assistance for Code-switching Speech Recognitioncited by 20
  4. 2022Effectiveness of Mining Audio and Text Pairs from Public Data for Improving ASR Systems for Low-Resource Languagescited by 16
  5. 2022Subword Dictionary Learning and Segmentation Techniques for Automatic Speech Recognition in Tamil and Kannadacited by 10
  6. 2023Speech collage: code-switched audio generation by collaging monolingual corporacited by 10
  7. 2023Adapting OpenAI's Whisper for Speech Recognition on Code-Switch Mandarin-English SEAME and ASRU2019 Datasetscited by 8
  8. 2024An Effective Mixture-Of-Experts Approach For Code-Switching Speech Recognition Leveraging Encoder Disentanglementcited by 8
  9. 2022Reducing language context confusion for end-to-end code-switching automatic speech recognitioncited by 6
  10. 2023LAE-ST-MoE: Boosted Language-Aware Encoder Using Speech Translation Auxiliary Task for E2E Code-switching ASRcited by 6
  11. 2024CAMEL: Cross-Attention Enhanced Mixture-of-Experts and Language Bias for Code-Switching Speech Recognitioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

  1. 2026Improving Code-Switching Speech Recognition with TTS Data Augmentationcited by 2
  2. 2026Direct Preference Optimization for English-Mandarin Code-Switching Speech Recognition in Audio LLMscited by 2
  3. 2026Improving Code-Switching ASR with Code-Mixing Guided Synthetic Speechcited by 1
  4. 2026Contrastive Training with LLM-generated Near-Misses for Robust Code-Switching Speech Recognitioncited by 0
  5. 2026Adding Robust Code-Switching Capabilities to High Performance Multilingual ASRcited by 0