NaturalConv: A Chinese Dialogue Dataset Towards Multi-turn Topic-driven Conversation
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a Chinese multi-turn topic-driven conversation dataset, NaturalConv, which allows the participants to chat anything they want as long as any element from the topic is mentioned and the topic shift is smooth. Our corpus contains 19.9K conversations from six domains, and 400K utterances with an average turn number of 20.1. These conversations contain in-depth discussions on related topics or widely natural transition between multiple topics. We believe either way is normal for human conversation. To facilitate the research on this corpus, we provide results of several benchmark models. Comparative results show that for this dataset, our current models are not able to provide significant improvement by introducing background knowledge/topic. Therefore, the proposed dataset should be a good benchmark for further research to evaluate the validity and naturalness of multi-turn conversation systems. Our dataset is available at https://ailab.tencent.com/ailab/nlp/dialogue/#datasets.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 19 of its 31 references that are in the map. First posted on arXiv 3 Mar 2021.
Builds on
19 of 31 references.
References · 19
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
- 2020Recipes for building an open-domain chatbotcited by 593
- 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
- 2020Towards a Human-like Open-Domain Chatbotcited by 467
- 2017Emotional Chatting Machine: Emotional Conversation Generation with Internal and External Memorycited by 167
- 2018Neural Approaches to Conversational AIcited by 164
- 2019Challenges in Building Intelligent Open-domain Dialog Systemscited by 147
- 2017A Knowledge-Grounded Neural Conversation Modelcited by 136
- 2018A Dataset for Document Grounded Conversationscited by 104
- 2019Proactive Human-Machine Conversation with Explicit Conversation Goalscited by 87
7 more
- 2020KdConv: A Chinese Multi-domain Dialogue Dataset Towards Multi-turn Knowledge-driven Conversationcited by 59
- 2018Towards Exploiting Background Knowledge for Building Conversation Systemscited by 57
- 2018An Interpretable Reasoning Network for Multi-Relation Question Answeringcited by 47
- 2019DyKgChat: Benchmarking Dialogue Generation Grounding on Dynamic Knowledge Graphscited by 33
- 2019Conversing by Reading: Contentful Neural Conversation with On-demand Machine Readingcited by 32
- 2017Flexible End-to-End Dialogue System for Knowledge Grounded Conversationcited by 18
- 2019An Effective Domain Adaptive Post-Training Method for BERT in Response Selectioncited by 7
Built on by
Citing papers per year: 2021: 3; 2022: 5; 2023: 10; 2024: 7; 2025: 7; 2026: 3.
35 papers.
Sort:
By area:
- 2023PanGu-Sigma: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computingcited by 55
- 2022EVA2.0: Investigating Open-Domain Chinese Dialogue Systems with Large-Scale Pre-Trainingcited by 31
- 2021Improving Unsupervised Dialogue Topic Segmentation with Utterance-Pair Coherence Scoringcited by 29
- 2023CHBias: Bias Evaluation and Mitigation of Chinese Conversational Language Modelscited by 25
- 2025OpenCharacter: Training Customizable Role-Playing LLMs with Large-Scale Synthetic Personascited by 25
- 2023Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Studycited by 24
- 2024BEYOND DIALOGUE: A Profile-Dialogue Alignment Framework Towards General Role-Playing Language Modelcited by 13
- 2022Where to Go for the Holidays: Towards Mixed-Type Dialogs for Clarification of User Goalscited by 12
- 2021Domain-Adaptive Pretraining Methods for Dialogue Understandingcited by 11
- 2025Interpersonal Memory Matters: A New Task for Proactive Dialogue Utilizing Conversational Historycited by 10
- 2023GLM-Dialog: Noise-tolerant Pre-training for Knowledge-grounded Dialogue Generationcited by 9
- 2025BabyBabelLM: A Multilingual Benchmark of Developmentally Plausible Training Datacited by 9
23 more
- 2023Multi-Granularity Prompts for Topic Shift Detection in Dialoguecited by 6
- 2021CSAGN: Conversational Structure Aware Graph Network for Conversational Semantic Role Labelingcited by 5
- 2025We Argue to Agree: Towards Personality-Driven Argumentation-Based Negotiation Dialogue Systems for Tourismcited by 5
- 2025MOA: Multi-Objective Alignment for Role-Playing Agentscited by 5
- 2023Topic Shift Detection in Chinese Dialogues: Corpus and Benchmarkcited by 4
- 2024Fostering Natural Conversation in Large Language Models with NICO: a Natural Interactive COnversation datasetcited by 4
- 2023CORECODE: A Common Sense Annotated Dialogue Dataset with Benchmark Tasks for Chinese Large Language Modelscited by 3
- 2024Inconsistent dialogue responses and how to recover from themcited by 3
- 2024MQM-Chat: Multidimensional Quality Metrics for Chat Translationcited by 3
- 2026H2HMem: A Multimodal Memory Benchmark for Agents in Human-Human Interactionscited by 3
- 2022Enabling Harmonious Human-Machine Interaction with Visual-Context Augmented Dialogue System: A Reviewcited by 2
- 2022Exploring Effective Information Utilization in Multi-Turn Topic-Driven Conversationscited by 2
- 2023Interpreting Indirect Answers to Yes-No Questions in Multiple Languagescited by 2
- 2023INA: An Integrative Approach for Enhancing Negotiation Strategies with Reward-Based Dialogue Systemcited by 2
- 2026MUSE: Multi-Domain Chinese User Simulation via Self-Evolving Profiles and Rubric-Guided Alignmentcited by 2
- 2022A Chit-Chats Enhanced Task-Oriented Dialogue Corpora for Fuse-Motive Conversation Systemscited by 1
- 2024A Knowledge Plug-and-Play Test Bed for Open-domain Dialogue Generationcited by 1
- 2025Krul: Efficient State Restoration for Multi-turn Conversations with Dynamic Cross-layer KV Sharingcited by 1
- 2026HiMeS: Hippocampus-inspired Memory System for Personalized AI Assistantscited by 1
- 2023DiQAD: A Benchmark Dataset for End-to-End Open-domain Dialogue Assessmentcited by 0
- 2024Intermittent Semi-Working Mask: A New Masking Paradigm for LLMscited by 0
- 2024Mitigating the Negative Impact of Over-association for Conversational Query Productioncited by 0
- 2025MemeCMD: An Automatically Generated Chinese Multi-turn Dialogue Dataset with Contextually Retrieved Memescited by 0
- 2026H2HMem: A Multimodal Memory Benchmark for Agents in Human-Human Interactions8 Jun 2026
- 2026MUSE: Multi-Domain Chinese User Simulation via Self-Evolving Profiles and Rubric-Guided Alignment15 Apr 2026
- 2026HiMeS: Hippocampus-inspired Memory System for Personalized AI Assistants6 Jan 2026
- 2025MOA: Multi-Objective Alignment for Role-Playing Agents10 Dec 2025
- 2025BabyBabelLM: A Multilingual Benchmark of Developmentally Plausible Training Data11 Oct 2025
- 2025We Argue to Agree: Towards Personality-Driven Argumentation-Based Negotiation Dialogue Systems for Tourism14 Sep 2025
- 2025Krul: Efficient State Restoration for Multi-turn Conversations with Dynamic Cross-layer KV Sharing10 Jul 2025
- 2025MemeCMD: An Automatically Generated Chinese Multi-turn Dialogue Dataset with Contextually Retrieved Memes1 Jul 2025
- 2025Interpersonal Memory Matters: A New Task for Proactive Dialogue Utilizing Conversational History7 Mar 2025
- 2025OpenCharacter: Training Customizable Role-Playing LLMs with Large-Scale Synthetic Personas26 Jan 2025
- 2024Mitigating the Negative Impact of Over-association for Conversational Query Production29 Sep 2024
- 2024MQM-Chat: Multidimensional Quality Metrics for Chat Translation29 Aug 2024
23 more
- 2024BEYOND DIALOGUE: A Profile-Dialogue Alignment Framework Towards General Role-Playing Language Model20 Aug 2024
- 2024Fostering Natural Conversation in Large Language Models with NICO: a Natural Interactive COnversation dataset18 Aug 2024
- 2024Intermittent Semi-Working Mask: A New Masking Paradigm for LLMs1 Aug 2024
- 2024A Knowledge Plug-and-Play Test Bed for Open-domain Dialogue Generation6 Mar 2024
- 2024Inconsistent dialogue responses and how to recover from them18 Jan 2024
- 2023CORECODE: A Common Sense Annotated Dialogue Dataset with Benchmark Tasks for Chinese Large Language Models20 Dec 2023
- 2023INA: An Integrative Approach for Enhancing Negotiation Strategies with Reward-Based Dialogue System27 Oct 2023
- 2023DiQAD: A Benchmark Dataset for End-to-End Open-domain Dialogue Assessment25 Oct 2023
- 2023Interpreting Indirect Answers to Yes-No Questions in Multiple Languages20 Oct 2023
- 2023Multi-Granularity Prompts for Topic Shift Detection in Dialogue23 May 2023
- 2023CHBias: Bias Evaluation and Mitigation of Chinese Conversational Language Models18 May 2023
- 2023Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Study15 May 2023
- 2023Topic Shift Detection in Chinese Dialogues: Corpus and Benchmark2 May 2023
- 2023PanGu-Sigma: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computing20 Mar 2023
- 2023GLM-Dialog: Noise-tolerant Pre-training for Knowledge-grounded Dialogue Generation28 Feb 2023
- 2022Exploring Effective Information Utilization in Multi-Turn Topic-Driven Conversations1 Sep 2022
- 2022Enabling Harmonious Human-Machine Interaction with Visual-Context Augmented Dialogue System: A Review2 Jul 2022
- 2022A Chit-Chats Enhanced Task-Oriented Dialogue Corpora for Fuse-Motive Conversation Systems12 May 2022
- 2022Where to Go for the Holidays: Towards Mixed-Type Dialogs for Clarification of User Goals15 Apr 2022
- 2022EVA2.0: Investigating Open-Domain Chinese Dialogue Systems with Large-Scale Pre-Training17 Mar 2022
- 2021CSAGN: Conversational Structure Aware Graph Network for Conversational Semantic Role Labeling23 Sep 2021
- 2021Improving Unsupervised Dialogue Topic Segmentation with Utterance-Pair Coherence Scoring12 Jun 2021
- 2021Domain-Adaptive Pretraining Methods for Dialogue Understanding28 May 2021
- 2023PanGu-Sigma: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computingcited by 55
- 2022EVA2.0: Investigating Open-Domain Chinese Dialogue Systems with Large-Scale Pre-Trainingcited by 31
- 2021Improving Unsupervised Dialogue Topic Segmentation with Utterance-Pair Coherence Scoringcited by 29
- 2023CHBias: Bias Evaluation and Mitigation of Chinese Conversational Language Modelscited by 25
- 2025OpenCharacter: Training Customizable Role-Playing LLMs with Large-Scale Synthetic Personascited by 25
- 2023Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Studycited by 24
- 2024BEYOND DIALOGUE: A Profile-Dialogue Alignment Framework Towards General Role-Playing Language Modelcited by 13
- 2022Where to Go for the Holidays: Towards Mixed-Type Dialogs for Clarification of User Goalscited by 12
- 2021Domain-Adaptive Pretraining Methods for Dialogue Understandingcited by 11
- 2025Interpersonal Memory Matters: A New Task for Proactive Dialogue Utilizing Conversational Historycited by 10
- 2023GLM-Dialog: Noise-tolerant Pre-training for Knowledge-grounded Dialogue Generationcited by 9
- 2025BabyBabelLM: A Multilingual Benchmark of Developmentally Plausible Training Datacited by 9
12 most cited of 30 All 30 (JSON)
- 2026HiMeS: Hippocampus-inspired Memory System for Personalized AI Assistants6 Jan 2026
- 2025MOA: Multi-Objective Alignment for Role-Playing Agents10 Dec 2025
- 2025BabyBabelLM: A Multilingual Benchmark of Developmentally Plausible Training Data11 Oct 2025
- 2025We Argue to Agree: Towards Personality-Driven Argumentation-Based Negotiation Dialogue Systems for Tourism14 Sep 2025
- 2025MemeCMD: An Automatically Generated Chinese Multi-turn Dialogue Dataset with Contextually Retrieved Memes1 Jul 2025
- 2025Interpersonal Memory Matters: A New Task for Proactive Dialogue Utilizing Conversational History7 Mar 2025
- 2025OpenCharacter: Training Customizable Role-Playing LLMs with Large-Scale Synthetic Personas26 Jan 2025
- 2024Mitigating the Negative Impact of Over-association for Conversational Query Production29 Sep 2024
- 2024MQM-Chat: Multidimensional Quality Metrics for Chat Translation29 Aug 2024
- 2024BEYOND DIALOGUE: A Profile-Dialogue Alignment Framework Towards General Role-Playing Language Model20 Aug 2024
- 2024Fostering Natural Conversation in Large Language Models with NICO: a Natural Interactive COnversation dataset18 Aug 2024
- 2024A Knowledge Plug-and-Play Test Bed for Open-domain Dialogue Generation6 Mar 2024
12 newest of 30 All 30 (JSON)