mlsanityData to 14 Oct 2026

CoSE-E: A Benchmark for Code-switched Speech Evaluation in Enterprise Settings

arXiv 2609.35645 ↗First posted 28 Sep 2026cs.SD cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Code-switching (CS), a seamless alternation between languages within a single utterance, remains a critical challenge in automatic speech recognition (ASR). While prior works focus on conversational CS-ASR, enterprise settings demand evaluation of operational impact beyond edit-distance errors: how code-switching transcription errors propagate to downstream voice agent task failures. In this work, we propose (1) a CS-ASR synthetic benchmark and multidimensional evaluation framework tailored to enterprise domains, (2) systematic evaluation of frontier ASR systems across 5 language pairs, (3) diagnostic analysis of the additional transcription errors that code-switching introduces across language pairs and models. We release COSE-E to support enterprise-focused CSASR evaluation for multilingual voice agents in enterprise deployment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

13 of 27 references.

References · 13

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2018Spoken SQuAD: A Study of Mitigating the Impact of Speech Recognition Errors on Listening Comprehensioncited by 74
  3. 2025Canary-1B-v2 & Parakeet-TDT-0.6B-v3: Efficient and High-Performance Models for Multilingual ASR and ASTcited by 60
  4. 2023A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologiescited by 59
  5. 2021ASCEND: A Spontaneous Chinese-English Dataset for Code-switching in Multi-turn Conversationcited by 44
  6. 2020Joint Contextual Modeling for ASR Correction and Language Understandingcited by 30
  7. 2026EVA-Bench: A New End-to-end Framework for Evaluating Voice Agentscited by 18
  8. 2025SwitchLingua: The First Large-Scale Multilingual and Multi-Ethnic Code-Switching Datasetcited by 14
  9. 2024A Principled Framework for Evaluating on Typologically Diverse Languagescited by 12
  10. 2025Measuring the Effect of Transcription Noise on Downstream Language Understanding Taskscited by 7
  11. 2024Prompting with Phonemes: Enhancing LLMs' Multilinguality for Non-Latin Script Languagescited by 6
  12. 2024CORI: CJKV Benchmark with Romanization Integration -- A step towards Cross-lingual Transfer Beyond Textual Scriptscited by 4
1 more
  1. 2025Code-switching Speech Recognition Under the Lens: Model- and Data-Centric Perspectivescited by 3

Built on by

Not cited yet.