Open Source MagicData-RAMC: A Rich Annotated Mandarin Conversational(RAMC) Speech Dataset
Not on the map. Why?
Abstract (arXiv)
This paper introduces a high-quality rich annotated Mandarin conversational (RAMC) speech dataset called MagicData-RAMC. The MagicData-RAMC corpus contains 180 hours of conversational speech data recorded from native speakers of Mandarin Chinese over mobile phones with a sampling rate of 16 kHz. The dialogs in MagicData-RAMC are classified into 15 diversified domains and tagged with topic labels, ranging from science and technology to ordinary life. Accurate transcription and precise speaker voice activity timestamps are manually labeled for each sample. Speakers' detailed information is also provided. As a Mandarin speech dataset designed for dialog scenarios with high quality and rich annotations, MagicData-RAMC enriches the data diversity in the Mandarin speech community and allows extensive research on a series of speech-related tasks, including automatic speech recognition, speaker diarization, topic detection, keyword search, text-to-speech, etc. We also conduct several relevant tasks and provide experimental results to help evaluate the dataset.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Builds on 18 of its 37 references that are in the map. First posted on arXiv 31 Mar 2022.
Builds on
18 of 37 references.
References · 18
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
- 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
- 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
- 2015Listen, Attend and Spellcited by 542
- 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 391
- 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 364
- 2018Additive Margin Softmax for Face Verificationcited by 275
- 2016Joint CTC-Attention based End-to-End Speech Recognition using Multi-task Learningcited by 254
- 2018TED-LIUM 3: twice as much data and corpus repartition for experiments on speaker adaptationcited by 224
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 189
6 more
- 2020CHiME-6 Challenge:Tackling Multispeaker Speech Recognition for Unsegmented Recordingscited by 129
- 2020Bayesian HMM clustering of x-vector sequences (VBx) in speaker diarization: theory, implementation and analysis on standard taskscited by 69
- 2021AISHELL-4: An Open Source Dataset for Speech Enhancement, Separation, Recognition and Speaker Diarization in Conference Scenariocited by 58
- 2019CN-CELEB: a challenging Chinese speaker recognition datasetcited by 47
- 2015THCHS-30 : A Free Chinese Speech Corpuscited by 43
- 2018Dialog-context aware end-to-end speech recognitioncited by 27
Built on by
Citing papers per year: 2022: 3; 2023: 3; 2024: 9; 2025: 13; 2026: 8.
36 papers.
Sort:
By area:
- 2025Kimi-Audio Technical Reportcited by 210
- 2024OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformercited by 74
- 2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 62
- 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 48
- 2024InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactionscited by 48
- 2023Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Datacited by 42
- 2025M2-omni: Advancing Omni-MLLM for Comprehensive Modality Support with Competitive Performancecited by 19
- 2025Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representationcited by 15
- 2025NVSpeech: An Integrated and Scalable Pipeline for Human-Like Speech Modeling with Paralinguistic Vocalizationscited by 14
- 2025Easy Turn: Integrating Acoustic and Linguistic Modalities for Robust Turn-Taking in Full-Duplex Spoken Dialogue Systemscited by 11
- 2024On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Modelscited by 10
- 2025C3: A Bilingual Benchmark for Spoken Dialogue Models Exploring Challenges in Complex Conversationscited by 9
24 more
- 2025ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matchingcited by 7
- 2024Emphasis Rendering for Conversational Text-to-Speech with Multi-modal Multi-scale Context Modelingcited by 6
- 2025SynParaSpeech: Automated Synthesis of Paralinguistic Datasets for Speech Generation and Understandingcited by 6
- 2023Towards Spontaneous Style Modeling with Semi-supervised Pre-training for Conversational Text-to-Speech Synthesiscited by 4
- 2023Conversational Speech Recognition by Learning Audio-textual Cross-modal Contextual Representationcited by 4
- 2024Target conversation extraction: Source separation using turn-taking dynamicscited by 4
- 2025The Esethu Framework: Reimagining Sustainable Dataset Governance and Curation for Low-Resource Languagescited by 4
- 2022The Conversational Short-phrase Speaker Diarization (CSSD) Task: Dataset, Evaluation Metric and Baselinescited by 3
- 2024Mamba-based Segmentation Model for Speaker Diarizationcited by 3
- 2024Qifusion-Net: Layer-adapted Stream/Non-stream Model for End-to-End Multi-Accent Speech Recognitioncited by 2
- 2025Inclusivity of AI Speech in Healthcare: A Decade Look Backcited by 2
- 2026Qwen3.8-Omni: Towards Native Omni-Modal Agentscited by 2
- 2022Summary on the ISCSLP 2022 Chinese-English Code-Switching ASR Challengecited by 1
- 2022TSUP Speaker Diarization System for Conversational Short-phrase Speaker Diarization Challengecited by 1
- 2024On the calibration of powerset speaker diarization modelscited by 1
- 2025SpeechDialogueFactory: Generating High-Quality Speech Dialogue Data to Accelerate Your Speech-LLM Developmentcited by 1
- 2025Proactive Hearing Assistants that Isolate Egocentric Conversationscited by 1
- 2026Human or Machine? A Preliminary Turing Test for Speech-to-Speech Interactioncited by 1
- 2026StyleBench: Evaluating Speech Language Models on Conversational Speaking Style Controlcited by 1
- 2026Ontology Memory-Augmented ASR Correction for Long Text-Speech Interleaved Conversationscited by 1
- 2026Eureka-Audio: Triggering Audio Intelligence in Compact Language Modelscited by 0
- 2026Introducing MELI: the Mandarin-English Language Interview Corpuscited by 0
- 2026Let Me Look at You: Advanced Facial Expression Modeling for Conversational Speech Synthesiscited by 0
- 2026Transsion's Speaker-Attributed Multilingual ASR System for the MLC-SLM 2026 Challengecited by 0
- 2026Qwen3.8-Omni: Towards Native Omni-Modal Agents22 Sep 2026
- 2026Let Me Look at You: Advanced Facial Expression Modeling for Conversational Speech Synthesis27 Jul 2026
- 2026Transsion's Speaker-Attributed Multilingual ASR System for the MLC-SLM 2026 Challenge24 Jul 2026
- 2026Ontology Memory-Augmented ASR Correction for Long Text-Speech Interleaved Conversations11 Jun 2026
- 2026Introducing MELI: the Mandarin-English Language Interview Corpus27 Mar 2026
- 2026StyleBench: Evaluating Speech Language Models on Conversational Speaking Style Control8 Mar 2026
- 2026Human or Machine? A Preliminary Turing Test for Speech-to-Speech Interaction27 Feb 2026
- 2026Eureka-Audio: Triggering Audio Intelligence in Compact Language Models15 Feb 2026
- 2025Proactive Hearing Assistants that Isolate Egocentric Conversations14 Nov 2025
- 2025Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representation26 Oct 2025
- 2025Easy Turn: Integrating Acoustic and Linguistic Modalities for Robust Turn-Taking in Full-Duplex Spoken Dialogue Systems28 Sep 2025
- 2025SynParaSpeech: Automated Synthesis of Paralinguistic Datasets for Speech Generation and Understanding18 Sep 2025
24 more
- 2025NVSpeech: An Integrated and Scalable Pipeline for Human-Like Speech Modeling with Paralinguistic Vocalizations6 Aug 2025
- 2025C3: A Bilingual Benchmark for Spoken Dialogue Models Exploring Challenges in Complex Conversations30 Jul 2025
- 2025ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matching12 Jul 2025
- 2025Ming-Omni: A Unified Multimodal Model for Perception and Generation11 Jun 2025
- 2025Inclusivity of AI Speech in Healthcare: A Decade Look Back15 May 2025
- 2025Kimi-Audio Technical Report25 Apr 2025
- 2025SpeechDialogueFactory: Generating High-Quality Speech Dialogue Data to Accelerate Your Speech-LLM Development31 Mar 2025
- 2025M2-omni: Advancing Omni-MLLM for Comprehensive Modality Support with Competitive Performance26 Feb 2025
- 2025The Esethu Framework: Reimagining Sustainable Dataset Governance and Curation for Low-Resource Languages21 Feb 2025
- 2024InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions12 Dec 2024
- 2024Emphasis Rendering for Conversational Text-to-Speech with Multi-modal Multi-scale Context Modeling12 Oct 2024
- 2024Mamba-based Segmentation Model for Speaker Diarization9 Oct 2024
- 2024On the calibration of powerset speaker diarization models24 Sep 2024
- 2024Target conversation extraction: Source separation using turn-taking dynamics15 Jul 2024
- 2024Qifusion-Net: Layer-adapted Stream/Non-stream Model for End-to-End Multi-Accent Speech Recognition3 Jul 2024
- 2024Towards Robust Speech Representation Learning for Thousands of Languages30 Jun 2024
- 2024On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Models13 Jun 2024
- 2024OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer30 Jan 2024
- 2023Conversational Speech Recognition by Learning Audio-textual Cross-modal Contextual Representation22 Oct 2023
- 2023Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Data25 Sep 2023
- 2023Towards Spontaneous Style Modeling with Semi-supervised Pre-training for Conversational Text-to-Speech Synthesis31 Aug 2023
- 2022TSUP Speaker Diarization System for Conversational Short-phrase Speaker Diarization Challenge26 Oct 2022
- 2022Summary on the ISCSLP 2022 Chinese-English Code-Switching ASR Challenge12 Oct 2022
- 2022The Conversational Short-phrase Speaker Diarization (CSSD) Task: Dataset, Evaluation Metric and Baselines17 Aug 2022
- 2026Qwen3.8-Omni: Towards Native Omni-Modal Agentscited by 2
- 2026Qwen3.8-Omni: Towards Native Omni-Modal Agents22 Sep 2026
- 2024Mamba-based Segmentation Model for Speaker Diarizationcited by 3
- 2024Mamba-based Segmentation Model for Speaker Diarization9 Oct 2024
- 2025Kimi-Audio Technical Reportcited by 210
- 2024OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformercited by 74
- 2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 62
- 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 48
- 2023Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Datacited by 42
- 2025M2-omni: Advancing Omni-MLLM for Comprehensive Modality Support with Competitive Performancecited by 19
- 2025Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representationcited by 15
- 2025NVSpeech: An Integrated and Scalable Pipeline for Human-Like Speech Modeling with Paralinguistic Vocalizationscited by 14
- 2025Easy Turn: Integrating Acoustic and Linguistic Modalities for Robust Turn-Taking in Full-Duplex Spoken Dialogue Systemscited by 11
- 2024On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Modelscited by 10
- 2025C3: A Bilingual Benchmark for Spoken Dialogue Models Exploring Challenges in Complex Conversationscited by 9
- 2024Emphasis Rendering for Conversational Text-to-Speech with Multi-modal Multi-scale Context Modelingcited by 6
12 most cited of 31 All 31 (JSON)
- 2026Let Me Look at You: Advanced Facial Expression Modeling for Conversational Speech Synthesis27 Jul 2026
- 2026Transsion's Speaker-Attributed Multilingual ASR System for the MLC-SLM 2026 Challenge24 Jul 2026
- 2026Ontology Memory-Augmented ASR Correction for Long Text-Speech Interleaved Conversations11 Jun 2026
- 2026Introducing MELI: the Mandarin-English Language Interview Corpus27 Mar 2026
- 2026StyleBench: Evaluating Speech Language Models on Conversational Speaking Style Control8 Mar 2026
- 2026Human or Machine? A Preliminary Turing Test for Speech-to-Speech Interaction27 Feb 2026
- 2025Proactive Hearing Assistants that Isolate Egocentric Conversations14 Nov 2025
- 2025Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representation26 Oct 2025
- 2025Easy Turn: Integrating Acoustic and Linguistic Modalities for Robust Turn-Taking in Full-Duplex Spoken Dialogue Systems28 Sep 2025
- 2025SynParaSpeech: Automated Synthesis of Paralinguistic Datasets for Speech Generation and Understanding18 Sep 2025
- 2025NVSpeech: An Integrated and Scalable Pipeline for Human-Like Speech Modeling with Paralinguistic Vocalizations6 Aug 2025
- 2025C3: A Bilingual Benchmark for Spoken Dialogue Models Exploring Challenges in Complex Conversations30 Jul 2025
12 newest of 31 All 31 (JSON)