A Large-Scale Chinese Short-Text Conversation Dataset
Not on the map. Why?
Abstract (arXiv)
The advancements of neural dialogue generation models show promising results on modeling short-text conversations. However, training such models usually needs a large-scale high-quality dialogue corpus, which is hard to access. In this paper, we present a large-scale cleaned Chinese conversation dataset, LCCC, which contains a base version (6.8million dialogues) and a large version (12.0 million dialogues). The quality of our dataset is ensured by a rigorous data cleaning pipeline, which is built based on a set of rules and a classifier that is trained on manually annotated 110K dialogue pairs. We also release pre-training dialogue models which are trained on LCCC-base and LCCC-large respectively. The cleaned dataset and the pre-training models will facilitate the research of short-text conversation modeling. All the models and datasets are available at https://github.com/thu-coai/CDial-GPT.
Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 20; 2023: 19; 2024: 12; 2025: 6; 2026: 4.
77 papers.
Sort:
By area:
- 2021Pre-Trained Models: Past, Present and Futurecited by 319
- 2022A Contrastive Framework for Neural Text Generationcited by 224
- 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 74
- 2021On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmarkcited by 73
- 2023PanGu-Sigma: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computingcited by 55
- 2021PLATO-XL: Exploring the Large-scale Pre-training of Dialogue Generationcited by 37
- 2022Towards Identifying Social Bias in Dialog Systems: Frame, Datasets, and Benchmarkscited by 36
- 2021Yuan 1.0: Large-Scale Pre-trained Language Model in Zero-Shot and Few-Shot Learningcited by 35
- 2021EVA: An Open-Domain Chinese Dialogue System with Large-Scale Generative Pre-Trainingcited by 34
- 2021ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generationcited by 31
- 2022EVA2.0: Investigating Open-Domain Chinese Dialogue Systems with Large-Scale Pre-Trainingcited by 31
- 2021MMChat: Multi-Modal Chat Dataset on Social Mediacited by 30
38 more
- 2022Rethinking and Refining the Distinct Metriccited by 27
- 2023LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streamingcited by 27
- 2021Diversifying Dialog Generation via Adaptive Label Smoothingcited by 25
- 2022CPED: A Large-Scale Chinese Personalized and Emotional Dialogue Dataset for Conversational AIcited by 25
- 2023CHBias: Bias Evaluation and Mitigation of Chinese Conversational Language Modelscited by 25
- 2021TSQA: Tabular Scenario Based Question Answeringcited by 21
- 2021Towards an Online Empathetic Chatbot with Emotion Causescited by 16
- 2023Towards Safer Generative Language Models: A Survey on Safety Risks, Evaluations, and Improvementscited by 14
- 2023ChatPLUG: Open-Domain Generative Dialogue System with Internet-Augmented Instruction Tuning for Digital Humancited by 14
- 2025OSUM: Advancing Open Speech Understanding Models with Limited Resources in Academiacited by 13
- 2021Towards Expressive Communication with Internet Memes: A New Multimodal Conversation Dataset and Benchmarkcited by 12
- 2022Towards Boosting the Open-Domain Chatbot with Human Feedbackcited by 11
- 2022Estimating Soft Labels for Out-of-Domain Intent Detectioncited by 11
- 2023A Cognitive Stimulation Dialogue System with Multi-source Knowledge Fusion for Elders with Cognitive Impairmentcited by 10
- 2023Overview of Robust and Multilingual Automatic Evaluation Metrics for Open-Domain Dialogue Systems at DSTC 11 Track 4cited by 10
- 2022PanGu-Bot: Efficient Generative Dialogue Pre-training from Pre-trained Language Modelcited by 9
- 2022CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluationcited by 9
- 2023GLM-Dialog: Noise-tolerant Pre-training for Knowledge-grounded Dialogue Generationcited by 9
- 2023LittleMu: Deploying an Online Virtual Teaching Assistant via Heterogeneous Sources Integration and Chain of Teach Promptscited by 9
- 2024Dynamic Stochastic Decoding Strategy for Open-Domain Dialogue Generationcited by 9
- 2025DistilQwen2.5: Industrial Practices of Training Distilled Open Lightweight Language Modelscited by 9
- 2021Bilateral Personalized Dialogue Generation with Contrastive Learningcited by 8
- 2022Prompt Conditioned VAE: Enhancing Generative Replay for Lifelong Learning in Task-Oriented Dialoguecited by 8
- 2024PopALM: Popularity-Aligned Language Models for Social Media Trendy Response Predictioncited by 8
- 2023TikTalk: A Video-Based Dialogue Dataset for Multi-Modal Chitchat in Real Worldcited by 7
- 2023PIPPA: A Partially Synthetic Conversational Datasetcited by 6
- 2024Target-constrained Bidirectional Planning for Generation of Target-oriented Proactive Dialoguecited by 6
- 2024DEMO: Reframing Dialogue Interaction with Fine-grained Element Modelingcited by 6
- 2025Automated Privacy Information Annotation in Large Language Model Interactionscited by 6
- 2023NewsDialogues: Towards Proactive News Grounded Conversationcited by 5
- 2025Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Taskscited by 5
- 2022A Review and Roadmap of Deep Learning Causal Discovery in Different Variable Paradigmscited by 4
- 2023Prompt Learning to Mitigate Catastrophic Forgetting in Cross-lingual Transfer for Open-domain Dialogue Generationcited by 4
- 2024Language Complexity and Speech Recognition Accuracy: Orthographic Complexity Hurts, Phonological Complexity Doesn'tcited by 4
- 2024Fostering Natural Conversation in Large Language Models with NICO: a Natural Interactive COnversation datasetcited by 4
- 2024Building a Family of Data Augmentation Models for Low-cost LLM Fine-tuning on the Cloudcited by 4
- 2021Semantic-Enhanced Explainable Finetuning for Open-Domain Dialoguescited by 3
- 2021Challenging Instances are Worth Learning: Generating Valuable Negative Samples for Response Selection Trainingcited by 3
50 most cited of 77 All 77 (JSON)
- 2026Surfacing the Unsaid: CUE-Bench for Affective Stance in Chinese Discourse11 Aug 2026
- 2026Pseudo-Siamese Network for Planning in Target-Oriented Proactive Dialogues4 Apr 2026
- 2026PMIScore: An Unsupervised Approach to Quantify Dialogue Engagement14 Mar 2026
- 2026Towards the Holographic Characteristic of LLMs for Efficient Short-text Generation30 Jan 2026
- 2025NormGenesis: Multicultural Dialogue Generation via Exemplar-Guided Social Norm Modeling and Violation Recovery22 Sep 2025
- 2025Automated Privacy Information Annotation in Large Language Model Interactions27 May 2025
- 2025Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Tasks16 May 2025
- 2025DistilQwen2.5: Industrial Practices of Training Distilled Open Lightweight Language Models21 Apr 2025
- 2025SmartBench: Is Your LLM Truly a Good Chinese Smartphone Assistant?8 Mar 2025
- 2025OSUM: Advancing Open Speech Understanding Models with Limited Resources in Academia23 Jan 2025
- 2024DEMO: Reframing Dialogue Interaction with Fine-grained Element Modeling6 Dec 2024
- 2024Building a Family of Data Augmentation Models for Low-cost LLM Fine-tuning on the Cloud6 Dec 2024
38 more
- 2024MQM-Chat: Multidimensional Quality Metrics for Chat Translation29 Aug 2024
- 2024Fostering Natural Conversation in Large Language Models with NICO: a Natural Interactive COnversation dataset18 Aug 2024
- 2024Language Complexity and Speech Recognition Accuracy: Orthographic Complexity Hurts, Phonological Complexity Doesn't13 Jun 2024
- 2024Dynamic Stochastic Decoding Strategy for Open-Domain Dialogue Generation12 Jun 2024
- 2024A Systematic Evaluation of Large Language Models for Natural Language Generation Tasks16 May 2024
- 2024Harmonic LLMs are Trustworthy30 Apr 2024
- 2024A Cause-Effect Look at Alleviating Hallucination of Knowledge-grounded Dialogue Generation4 Apr 2024
- 2024Target-constrained Bidirectional Planning for Generation of Target-oriented Proactive Dialogue10 Mar 2024
- 2024PopALM: Popularity-Aligned Language Models for Social Media Trendy Response Prediction29 Feb 2024
- 2024Inconsistent dialogue responses and how to recover from them18 Jan 2024
- 2023Interpreting Indirect Answers to Yes-No Questions in Multiple Languages20 Oct 2023
- 2023Fine-grained Conversational Decoding via Isotropic and Proximal Search12 Oct 2023
- 2023NewsDialogues: Towards Proactive News Grounded Conversation12 Aug 2023
- 2023LittleMu: Deploying an Online Virtual Teaching Assistant via Heterogeneous Sources Integration and Chain of Teach Prompts11 Aug 2023
- 2023PIPPA: A Partially Synthetic Conversational Dataset11 Aug 2023
- 2023Overview of Robust and Multilingual Automatic Evaluation Metrics for Open-Domain Dialogue Systems at DSTC 11 Track 422 Jun 2023
- 2023LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streaming14 Jun 2023
- 2023I run as fast as a rabbit, can you? A Multilingual Simile Dialogue Dataset9 Jun 2023
- 2023ReSee: Responding through Seeing Fine-grained Visual Knowledge in Open-domain Dialogue23 May 2023
- 2023CHBias: Bias Evaluation and Mitigation of Chinese Conversational Language Models18 May 2023
- 2023A Cognitive Stimulation Dialogue System with Multi-source Knowledge Fusion for Elders with Cognitive Impairment14 May 2023
- 2023Prompt Learning to Mitigate Catastrophic Forgetting in Cross-lingual Transfer for Open-domain Dialogue Generation12 May 2023
- 2023ChatPLUG: Open-Domain Generative Dialogue System with Internet-Augmented Instruction Tuning for Digital Human16 Apr 2023
- 2023Dialog-to-Actions: Building Task-Oriented Dialogue System via Action-Level Generation3 Apr 2023
- 2023PanGu-Sigma: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computing20 Mar 2023
- 2023GLM-Dialog: Noise-tolerant Pre-training for Knowledge-grounded Dialogue Generation28 Feb 2023
- 2023Towards Safer Generative Language Models: A Survey on Safety Risks, Evaluations, and Improvements18 Feb 2023
- 2023Friend-training: Learning from Models of Different but Related Tasks31 Jan 2023
- 2023TikTalk: A Video-Based Dialogue Dataset for Multi-Modal Chitchat in Real World14 Jan 2023
- 2022Semi-Supervised Lifelong Language Learning23 Nov 2022
- 2022CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluation21 Nov 2022
- 2022Estimating Soft Labels for Out-of-Domain Intent Detection10 Nov 2022
- 2022PLATO-K: Internal and External Knowledge Enhanced Dialogue Generation2 Nov 2022
- 2022Prompt Conditioned VAE: Enhancing Generative Replay for Lifelong Learning in Task-Oriented Dialogue14 Oct 2022
- 2022Selecting Stickers in Open-Domain Dialogue through Multitask Learning16 Sep 2022
- 2022A Review and Roadmap of Deep Learning Causal Discovery in Different Variable Paradigms14 Sep 2022
- 2022Towards Boosting the Open-Domain Chatbot with Human Feedback30 Aug 2022
- 2022MSDF: A General Open-Domain Multi-Skill Dialog Framework17 Jun 2022
50 newest of 77 All 77 (JSON)
- 2021Pre-Trained Models: Past, Present and Futurecited by 319
- 2022A Contrastive Framework for Neural Text Generationcited by 224
- 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 74
- 2021On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmarkcited by 73
- 2023PanGu-Sigma: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computingcited by 55
- 2021PLATO-XL: Exploring the Large-scale Pre-training of Dialogue Generationcited by 37
- 2022Towards Identifying Social Bias in Dialog Systems: Frame, Datasets, and Benchmarkscited by 36
- 2021Yuan 1.0: Large-Scale Pre-trained Language Model in Zero-Shot and Few-Shot Learningcited by 35
- 2021EVA: An Open-Domain Chinese Dialogue System with Large-Scale Generative Pre-Trainingcited by 34
- 2021ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generationcited by 31
- 2022EVA2.0: Investigating Open-Domain Chinese Dialogue Systems with Large-Scale Pre-Trainingcited by 31
- 2021MMChat: Multi-Modal Chat Dataset on Social Mediacited by 30
12 most cited of 73 All 73 (JSON)
- 2026Surfacing the Unsaid: CUE-Bench for Affective Stance in Chinese Discourse11 Aug 2026
- 2026Pseudo-Siamese Network for Planning in Target-Oriented Proactive Dialogues4 Apr 2026
- 2026PMIScore: An Unsupervised Approach to Quantify Dialogue Engagement14 Mar 2026
- 2025NormGenesis: Multicultural Dialogue Generation via Exemplar-Guided Social Norm Modeling and Violation Recovery22 Sep 2025
- 2025Automated Privacy Information Annotation in Large Language Model Interactions27 May 2025
- 2025Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Tasks16 May 2025
- 2025DistilQwen2.5: Industrial Practices of Training Distilled Open Lightweight Language Models21 Apr 2025
- 2025SmartBench: Is Your LLM Truly a Good Chinese Smartphone Assistant?8 Mar 2025
- 2025OSUM: Advancing Open Speech Understanding Models with Limited Resources in Academia23 Jan 2025
- 2024DEMO: Reframing Dialogue Interaction with Fine-grained Element Modeling6 Dec 2024
- 2024Building a Family of Data Augmentation Models for Low-cost LLM Fine-tuning on the Cloud6 Dec 2024
- 2024MQM-Chat: Multidimensional Quality Metrics for Chat Translation29 Aug 2024
12 newest of 73 All 73 (JSON)