TALCS: An Open-Source Mandarin-English Code-Switching Corpus and a Speech Recognition Baseline
Not on the map. Why?
Abstract (arXiv)
This paper introduces a new corpus of Mandarin-English code-switching speech recognition--TALCS corpus, suitable for training and evaluating code-switching speech recognition systems. TALCS corpus is derived from real online one-to-one English teaching scenes in TAL education group, which contains roughly 587 hours of speech sampled at 16 kHz. To our best knowledge, TALCS corpus is the largest well labeled Mandarin-English code-switching open source automatic speech recognition (ASR) dataset in the world. In this paper, we will introduce the recording procedure in detail, including audio capturing devices and corpus environments. And the TALCS corpus is freely available for download under the permissive license1. Using TALCS corpus, we conduct ASR experiments in two popular speech recognition toolkits to make a baseline system, including ESPnet and Wenet. The Mixture Error Rate (MER) performance in the two speech recognition toolkits is compared in TALCS corpus. The experimental results implies that the quality of audio recordings and transcriptions are promising and the baseline system is workable.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 13 of its 23 references that are in the map. First posted on arXiv 27 Jun 2022.
Builds on
13 of 23 references.
References · 13
- 2017Attention Is All You Needcited by 60,361
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
- 2018ESPnet: End-to-End Speech Processing Toolkitcited by 558
- 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 373
- 2019Attention Augmented Convolutional Networkscited by 363
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 197
- 2021WeNet: Production oriented Streaming and Non-streaming End-to-End Speech Recognition Toolkitcited by 125
- 2021The People's Speech: A Large-Scale Diverse English Speech Recognition Dataset for Commercial Usagecited by 101
- 2020The ASRU 2019 Mandarin-English Code-Switching Speech Recognition Challenge: Open Datasets, Tracks, Methods and Resultscited by 44
- 2018Towards End-to-End Code-Switching Speech Recognitioncited by 17
- 2018Learn to Code-Switch: Data Augmentation using Copy Mechanism on Language Modelingcited by 9
- 2017Syntactic and Semantic Features For Code-Switching Factored Language Modelscited by 8
Built on by
Citing papers per year: 2022: 2; 2023: 2; 2024: 2; 2025: 5; 2026: 6.
17 papers.
Sort:
By area:
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2024Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual Understandingcited by 34
- 2024MSR-86K: An Evolving, Multilingual Corpus with 86,300 Hours of Transcribed Audio for Speech Recognition Researchcited by 9
- 2023CroCoSum: A Benchmark Dataset for Cross-Lingual Code-Switched Summarizationcited by 8
- 2025Weight Factorization and Centralization for Continual Learning in Speech Recognitioncited by 6
- 2023A Multitask Training Approach to Enhance Whisper with Contextual Biasing and Open-Vocabulary Keyword Spottingcited by 5
- 2025Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalitiescited by 5
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Reviewcited by 4
- 2025HiKE: Hierarchical Evaluation Framework for Korean-English Code-Switching Speech Recognitioncited by 4
- 2022Summary on the ISCSLP 2022 Chinese-English Code-Switching ASR Challengecited by 1
- 2026Towards Comprehensive Semantic Speech Embeddings for Chinese Dialectscited by 1
- 2026MultiTalk: Scaling Full-Duplex Speech Models to Long, Multi-Party, Bilingual Conversationcited by 1
5 more
- 2025Leveraging Zipformer Model for Effective Language Identification in Code-Switched Child-Directed Speechcited by 0
- 2026Introducing MELI: the Mandarin-English Language Interview Corpuscited by 0
- 2026RAS: a Reliability Oriented Metric for Automatic Speech Recognitioncited by 0
- 2026Read What You Hear: Reference-Free Hypotheses Evaluation with Acoustic Discrepancycited by 0
- 2026Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairscited by 0
- 2026MultiTalk: Scaling Full-Duplex Speech Models to Long, Multi-Party, Bilingual Conversation29 Sep 2026
- 2026Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairs4 Jun 2026
- 2026Read What You Hear: Reference-Free Hypotheses Evaluation with Acoustic Discrepancy3 Jun 2026
- 2026RAS: a Reliability Oriented Metric for Automatic Speech Recognition27 Apr 2026
- 2026Introducing MELI: the Mandarin-English Language Interview Corpus27 Mar 2026
- 2026Towards Comprehensive Semantic Speech Embeddings for Chinese Dialects12 Jan 2026
- 2025Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalities8 Oct 2025
- 2025HiKE: Hierarchical Evaluation Framework for Korean-English Code-Switching Speech Recognition29 Sep 2025
- 2025Leveraging Zipformer Model for Effective Language Identification in Code-Switched Child-Directed Speech13 Aug 2025
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Review10 Jul 2025
- 2025Weight Factorization and Centralization for Continual Learning in Speech Recognition19 Jun 2025
- 2024MSR-86K: An Evolving, Multilingual Corpus with 86,300 Hours of Transcribed Audio for Speech Recognition Research26 Jun 2024
5 more
- 2024Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual Understanding17 Jun 2024
- 2023A Multitask Training Approach to Enhance Whisper with Contextual Biasing and Open-Vocabulary Keyword Spotting18 Sep 2023
- 2023CroCoSum: A Benchmark Dataset for Cross-Lingual Code-Switched Summarization7 Mar 2023
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges19 Dec 2022
- 2022Summary on the ISCSLP 2022 Chinese-English Code-Switching ASR Challenge12 Oct 2022
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2024MSR-86K: An Evolving, Multilingual Corpus with 86,300 Hours of Transcribed Audio for Speech Recognition Researchcited by 9
- 2023CroCoSum: A Benchmark Dataset for Cross-Lingual Code-Switched Summarizationcited by 8
- 2025Weight Factorization and Centralization for Continual Learning in Speech Recognitioncited by 6
- 2023A Multitask Training Approach to Enhance Whisper with Contextual Biasing and Open-Vocabulary Keyword Spottingcited by 5
- 2025Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalitiescited by 5
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Reviewcited by 4
- 2025HiKE: Hierarchical Evaluation Framework for Korean-English Code-Switching Speech Recognitioncited by 4
- 2022Summary on the ISCSLP 2022 Chinese-English Code-Switching ASR Challengecited by 1
- 2026Towards Comprehensive Semantic Speech Embeddings for Chinese Dialectscited by 1
- 2026MultiTalk: Scaling Full-Duplex Speech Models to Long, Multi-Party, Bilingual Conversationcited by 1
- 2025Leveraging Zipformer Model for Effective Language Identification in Code-Switched Child-Directed Speechcited by 0
12 most cited of 16 All 16 (JSON)
- 2026MultiTalk: Scaling Full-Duplex Speech Models to Long, Multi-Party, Bilingual Conversation29 Sep 2026
- 2026Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairs4 Jun 2026
- 2026Read What You Hear: Reference-Free Hypotheses Evaluation with Acoustic Discrepancy3 Jun 2026
- 2026RAS: a Reliability Oriented Metric for Automatic Speech Recognition27 Apr 2026
- 2026Introducing MELI: the Mandarin-English Language Interview Corpus27 Mar 2026
- 2026Towards Comprehensive Semantic Speech Embeddings for Chinese Dialects12 Jan 2026
- 2025Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalities8 Oct 2025
- 2025HiKE: Hierarchical Evaluation Framework for Korean-English Code-Switching Speech Recognition29 Sep 2025
- 2025Leveraging Zipformer Model for Effective Language Identification in Code-Switched Child-Directed Speech13 Aug 2025
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Review10 Jul 2025
- 2025Weight Factorization and Centralization for Continual Learning in Speech Recognition19 Jun 2025
- 2024MSR-86K: An Evolving, Multilingual Corpus with 86,300 Hours of Transcribed Audio for Speech Recognition Research26 Jun 2024
12 newest of 16 All 16 (JSON)