ASCEND: A Spontaneous Chinese-English Dataset for Code-switching in Multi-turn Conversation
Not on the map. Why?
Abstract (arXiv)
Code-switching is a speech phenomenon occurring when a speaker switches language during a conversation. Despite the spontaneous nature of code-switching in conversational spoken language, most existing works collect code-switching data from read speech instead of spontaneous speech. ASCEND (A Spontaneous Chinese-English Dataset) is a high-quality Mandarin Chinese-English code-switching corpus built on spontaneous multi-turn conversational dialogue sources collected in Hong Kong. We report ASCEND's design and procedure for collecting the speech data, including annotations. ASCEND consists of 10.62 hours of clean speech, collected from 23 bilingual speakers of Chinese and English. Furthermore, we conduct baseline experiments using pre-trained wav2vec 2.0 models, achieving a best performance of 22.69% character error rate and 27.05% mixed error rate.
Key facts. Cited by 44 papers in the map (data through 14 Oct 2026). Builds on 17 of its 54 references that are in the map. First posted on arXiv 12 Dec 2021.
Builds on
17 of 54 references.
References · 17
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
- 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 373
- 2020CoSDA-ML: Multi-Lingual Code-Switching Data Augmentation for Zero-Shot Cross-Lingual NLPcited by 79
- 2021Are Multilingual Models Effective in Code-Switching?cited by 56
- 2021BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modelingcited by 56
- 2019Code-Switched Language Models Using Neural Based Synthetic Data from Parallel Sentencescited by 55
- 2020The ASRU 2019 Mandarin-English Code-Switching Speech Recognition Challenge: Open Datasets, Tracks, Methods and Resultscited by 44
- 2021Towards One Model to Rule All: Multilingual Strategy for Dialectal Code-Switching Arabic ASRcited by 41
- 2020Unified Streaming and Non-streaming Two-pass End-to-end Model for Speech Recognitioncited by 39
5 more
- 2020Meta-Transfer Learning for Code-Switched Speech Recognitioncited by 22
- 2018A Dataset for Building Code-Mixed Goal Oriented Conversation Systemscited by 16
- 2018Code-Switching Language Modeling using Syntax-Aware Multi-Task Learningcited by 15
- 2016OC16-CE80: A Chinese-English Mixlingual Database and A Speech Recognition Baselinecited by 4
- 2021Multilingual Transfer Learning for Code-Switched Language and Speech Neural Modelingcited by 4
Built on by
Citing papers per year: 2022: 7; 2023: 8; 2024: 9; 2025: 11; 2026: 9.
44 papers.
Sort:
By area:
- 2023Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languagescited by 51
- 2024InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactionscited by 48
- 2023Prompting the Hidden Talent of Web-Scale Speech Models for Zero-Shot Task Generalizationcited by 43
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2024Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual Understandingcited by 34
- 2023Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparationcited by 16
- 2025SwitchLingua: The First Large-Scale Multilingual and Multi-Ethnic Code-Switching Datasetcited by 14
- 2023Investigating Zero-Shot Generalizability on Mandarin-English Code-Switched ASR and Speech-to-text Translation of Recent Foundation Models with Self-Supervision and Weak Supervisioncited by 13
- 2022Automatic Speech Recognition Datasets in Cantonese: A Survey and New Datasetcited by 12
- 2024Do Prompts Really Prompt? Exploring the Prompt Understanding Capability of Whispercited by 12
- 2024MaskLID: Code-Switching Language Identification through Iterative Maskingcited by 11
- 2022CI-AVSR: A Cantonese Audio-Visual Speech Dataset for In-car Command Recognitioncited by 10
32 more
- 2025CS-Dialogue: A 104-Hour Dataset of Spontaneous Mandarin-English Code-Switching Dialogues for Speech Recognitioncited by 10
- 2022EntityCS: Improving Zero-Shot Cross-lingual Transfer with Entity-Centric Code Switchingcited by 8
- 2023CroCoSum: A Benchmark Dataset for Cross-Lingual Code-Switched Summarizationcited by 8
- 2025Minimal Pair-Based Evaluation of Code-Switchingcited by 8
- 2025A Self-Refining Framework for Enhancing ASR Using TTS-Synthesized Datacited by 7
- 2023Adapting the adapters for code-switching in multilingual ASRcited by 6
- 2025Weight Factorization and Centralization for Continual Learning in Speech Recognitioncited by 6
- 2022Optimizing Bilingual Neural Transducer with Synthetic Code-switching Text Generationcited by 5
- 2023IndoRobusta: Towards Robustness Against Diverse Code-Mixed Indonesian Local Languagescited by 5
- 2024Leave No Knowledge Behind During Knowledge Distillation: Towards Practical and Effective Knowledge Distillation for Code-Switching ASR Using Realistic Datacited by 5
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Reviewcited by 4
- 2025HiKE: Hierarchical Evaluation Framework for Korean-English Code-Switching Speech Recognitioncited by 4
- 2024Code-Switched Language Identification is Harder Than You Thinkcited by 3
- 2025DIVERS-Bench: Evaluating Language Identification Across Domain Shifts and Code-Switchingcited by 3
- 2024Gated Low-rank Adaptation for personalized Code-Switching Automatic Speech Recognition on the low-spec devicescited by 2
- 2024Improving Zero-Shot Chinese-English Code-Switching ASR with kNN-CTC and Gated Monolingual Datastorescited by 2
- 2025UniCoM: A Universal Code-Switching Speech Generatorcited by 2
- 2025From Construction to Injection: Edit-Based Fingerprints for Large Language Modelscited by 2
- 2025Adapting Language Balance in Code-Switching Speechcited by 2
- 2022Effective Transfer Learning for Low-Resource Natural Language Understandingcited by 1
- 2023Cross-Lingual Cross-Age Group Adaptation for Low-Resource Elderly Speech Emotion Recognitioncited by 1
- 2026PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialoguescited by 1
- 2026ALARM: Audio-Language Alignment for Reasoning Modelscited by 1
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASRcited by 1
- 2026SPEARBench: A Benchmark for Naturalness Evaluation in Streaming Speech-to-Speech Language Modelscited by 1
- 2026MultiTalk: Scaling Full-Duplex Speech Models to Long, Multi-Party, Bilingual Conversationcited by 1
- 2022Kaggle Competition: Cantonese Audio-Visual Speech Recognition for In-car Commandscited by 0
- 2024Enhancing Code-switched Text-to-Speech Synthesis Capability in Large Language Models with only Monolingual Corporacited by 0
- 2026Introducing MELI: the Mandarin-English Language Interview Corpuscited by 0
- 2026Beyond Word Error Rate: A Switch Aware Evaluation of ASR and Audio Language Models on English Yoruba Code-Switched Speechcited by 0
- 2026CoSE-E: A Benchmark for Code-switched Speech Evaluation in Enterprise Settingscited by 0
- 2026CSWBench: Evaluating Context-Sensitive Code-Switching in Creative Writingcited by 0
- 2026CSWBench: Evaluating Context-Sensitive Code-Switching in Creative Writing14 Oct 2026
- 2026MultiTalk: Scaling Full-Duplex Speech Models to Long, Multi-Party, Bilingual Conversation29 Sep 2026
- 2026CoSE-E: A Benchmark for Code-switched Speech Evaluation in Enterprise Settings28 Sep 2026
- 2026Beyond Word Error Rate: A Switch Aware Evaluation of ASR and Audio Language Models on English Yoruba Code-Switched Speech10 Sep 2026
- 2026SPEARBench: A Benchmark for Naturalness Evaluation in Streaming Speech-to-Speech Language Models6 Jul 2026
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASR20 Apr 2026
- 2026Introducing MELI: the Mandarin-English Language Interview Corpus27 Mar 2026
- 2026ALARM: Audio-Language Alignment for Reasoning Models10 Mar 2026
- 2026PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialogues24 Jan 2026
- 2025Adapting Language Balance in Code-Switching Speech21 Oct 2025
- 2025HiKE: Hierarchical Evaluation Framework for Korean-English Code-Switching Speech Recognition29 Sep 2025
- 2025DIVERS-Bench: Evaluating Language Identification Across Domain Shifts and Code-Switching22 Sep 2025
32 more
- 2025From Construction to Injection: Edit-Based Fingerprints for Large Language Models3 Sep 2025
- 2025UniCoM: A Universal Code-Switching Speech Generator21 Aug 2025
- 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Review10 Jul 2025
- 2025Weight Factorization and Centralization for Continual Learning in Speech Recognition19 Jun 2025
- 2025A Self-Refining Framework for Enhancing ASR Using TTS-Synthesized Data10 Jun 2025
- 2025Minimal Pair-Based Evaluation of Code-Switching2 Jun 2025
- 2025SwitchLingua: The First Large-Scale Multilingual and Multi-Ethnic Code-Switching Dataset30 May 2025
- 2025CS-Dialogue: A 104-Hour Dataset of Spontaneous Mandarin-English Code-Switching Dialogues for Speech Recognition26 Feb 2025
- 2024InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions12 Dec 2024
- 2024Enhancing Code-switched Text-to-Speech Synthesis Capability in Large Language Models with only Monolingual Corpora17 Sep 2024
- 2024Leave No Knowledge Behind During Knowledge Distillation: Towards Practical and Effective Knowledge Distillation for Code-Switching ASR Using Realistic Data15 Jul 2024
- 2024Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual Understanding17 Jun 2024
- 2024MaskLID: Code-Switching Language Identification through Iterative Masking10 Jun 2024
- 2024Do Prompts Really Prompt? Exploring the Prompt Understanding Capability of Whisper9 Jun 2024
- 2024Improving Zero-Shot Chinese-English Code-Switching ASR with kNN-CTC and Gated Monolingual Datastores6 Jun 2024
- 2024Gated Low-rank Adaptation for personalized Code-Switching Automatic Speech Recognition on the low-spec devices24 Apr 2024
- 2024Code-Switched Language Identification is Harder Than You Think2 Feb 2024
- 2023Investigating Zero-Shot Generalizability on Mandarin-English Code-Switched ASR and Speech-to-text Translation of Recent Foundation Models with Self-Supervision and Weak Supervision30 Dec 2023
- 2023IndoRobusta: Towards Robustness Against Diverse Code-Mixed Indonesian Local Languages21 Nov 2023
- 2023Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparation31 Oct 2023
- 2023Adapting the adapters for code-switching in multilingual ASR11 Oct 2023
- 2023Cross-Lingual Cross-Age Group Adaptation for Low-Resource Elderly Speech Emotion Recognition26 Jun 2023
- 2023Prompting the Hidden Talent of Web-Scale Speech Models for Zero-Shot Task Generalization18 May 2023
- 2023Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languages23 Mar 2023
- 2023CroCoSum: A Benchmark Dataset for Cross-Lingual Code-Switched Summarization7 Mar 2023
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges19 Dec 2022
- 2022EntityCS: Improving Zero-Shot Cross-lingual Transfer with Entity-Centric Code Switching22 Oct 2022
- 2022Optimizing Bilingual Neural Transducer with Synthetic Code-switching Text Generation21 Oct 2022
- 2022Effective Transfer Learning for Low-Resource Natural Language Understanding19 Aug 2022
- 2022Kaggle Competition: Cantonese Audio-Visual Speech Recognition for In-car Commands6 Jul 2022
- 2022CI-AVSR: A Cantonese Audio-Visual Speech Dataset for In-car Command Recognition11 Jan 2022
- 2022Automatic Speech Recognition Datasets in Cantonese: A Survey and New Dataset7 Jan 2022
- 2026ALARM: Audio-Language Alignment for Reasoning Modelscited by 1
- 2026ALARM: Audio-Language Alignment for Reasoning Models10 Mar 2026
- 2023Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languagescited by 51
- 2023Prompting the Hidden Talent of Web-Scale Speech Models for Zero-Shot Task Generalizationcited by 43
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2023Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparationcited by 16
- 2025SwitchLingua: The First Large-Scale Multilingual and Multi-Ethnic Code-Switching Datasetcited by 14
- 2023Investigating Zero-Shot Generalizability on Mandarin-English Code-Switched ASR and Speech-to-text Translation of Recent Foundation Models with Self-Supervision and Weak Supervisioncited by 13
- 2022Automatic Speech Recognition Datasets in Cantonese: A Survey and New Datasetcited by 12
- 2024Do Prompts Really Prompt? Exploring the Prompt Understanding Capability of Whispercited by 12
- 2024MaskLID: Code-Switching Language Identification through Iterative Maskingcited by 11
- 2022CI-AVSR: A Cantonese Audio-Visual Speech Dataset for In-car Command Recognitioncited by 10
- 2025CS-Dialogue: A 104-Hour Dataset of Spontaneous Mandarin-English Code-Switching Dialogues for Speech Recognitioncited by 10
- 2022EntityCS: Improving Zero-Shot Cross-lingual Transfer with Entity-Centric Code Switchingcited by 8
12 most cited of 40 All 40 (JSON)
- 2026CSWBench: Evaluating Context-Sensitive Code-Switching in Creative Writing14 Oct 2026
- 2026MultiTalk: Scaling Full-Duplex Speech Models to Long, Multi-Party, Bilingual Conversation29 Sep 2026
- 2026CoSE-E: A Benchmark for Code-switched Speech Evaluation in Enterprise Settings28 Sep 2026
- 2026Beyond Word Error Rate: A Switch Aware Evaluation of ASR and Audio Language Models on English Yoruba Code-Switched Speech10 Sep 2026
- 2026SPEARBench: A Benchmark for Naturalness Evaluation in Streaming Speech-to-Speech Language Models6 Jul 2026
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASR20 Apr 2026
- 2026Introducing MELI: the Mandarin-English Language Interview Corpus27 Mar 2026
- 2026PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialogues24 Jan 2026
- 2025Adapting Language Balance in Code-Switching Speech21 Oct 2025
- 2025HiKE: Hierarchical Evaluation Framework for Korean-English Code-Switching Speech Recognition29 Sep 2025
- 2025DIVERS-Bench: Evaluating Language Identification Across Domain Shifts and Code-Switching22 Sep 2025
- 2025From Construction to Injection: Edit-Based Fingerprints for Large Language Models3 Sep 2025
12 newest of 40 All 40 (JSON)