mlsanityData to 7 Oct 2026

Code-Switching Spoken Language Identification as Multi-Label Set Prediction

arXiv 2610.01450 ↗First posted 1 Oct 2026eess.AS cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Code-switched (CS) speech leaks through the monolingual language identification (LID) filters used to curate massive speech corpora, calling for CS-aware LID (CS-LID). We formulate utterance-level CS-LID as multi-label language-set prediction and propose a set generator that directly outputs the languages in an utterance, comparing it against atomic-pair and score-based classification baselines. Oracle Top-k is the strongest baseline, but thresholding fails because no single threshold separates CS from monolingual speech. Our set generator predicts the correct language count on unseen pairs without assuming the number of languages, but underperforms oracle Top-k in exact set accuracy. Our analysis identifies the key obstacles to robust CS-LID: oracle cardinality, threshold instability, language bias in CS training data, and the synthetic-to-real gap.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 27 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

21 of 27 references.

References · 21

  1. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  2. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 455
  3. 2023Scaling Speech Technology to 1,000+ Languagescited by 401
  4. 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 200
  5. 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 174
  6. 2020VoxLingua107: a Dataset for Spoken Language Recognitioncited by 118
  7. 2024OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformercited by 74
  8. 2023A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologiescited by 59
  9. 2024YODAS: Youtube-Oriented Dataset for Audio and Speechcited by 56
  10. 2022Reducing Language confusion for Code-switching Speech Recognition with Token-level Language Diarizationcited by 28
  11. 2025OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaningcited by 27
  12. 2024Aligning Speech to Languages to Enhance Code-switching Speech Recognitioncited by 13
9 more
  1. 2025CS-FLEURS: A Massively Multilingual and Code-Switched Speech Datasetcited by 11
  2. 2022Improving Language Identification of Accented Speechcited by 10
  3. 2023MERLIon CCS Challenge: A English-Mandarin code-switching child-directed speech corpus for language identification and diarizationcited by 9
  4. 2023Unified model for code-switching speech recognition and language identification based on a concatenated tokenizercited by 8
  5. 2023Fine-Tuned Self-Supervised Speech Representations for Language Diarization in Multilingual Code-Switched Speechcited by 3
  6. 2024Code-Switched Language Identification is Harder Than You Thinkcited by 3
  7. 2019Joint Language Identification of Code-Switching Speech using Attention based E2E Networkcited by 2
  8. 2022Adversarial synthesis based data-augmentation for code-switched spoken language identificationcited by 1
  9. 2026CS-YODAS: A Mined Dataset of In-the-Wild Code-Switched Speechcited by 1

Built on by

Not cited yet.