mlsanityData to 7 Oct 2026

A Survey on Recent Advances in Conversational Data Generation

arXiv 2405.13003 ↗First posted 12 May 2024cs.CL cs.AI cs.IRcited by 23

Not on the map. Why?

Abstract (arXiv)

Recent advancements in conversational systems have significantly enhanced human-machine interactions across various domains. However, training these systems is challenging due to the scarcity of specialized dialogue data. Traditionally, conversational datasets were created through crowdsourcing, but this method has proven costly, limited in scale, and labor-intensive. As a solution, the development of synthetic dialogue data has emerged, utilizing techniques to augment existing datasets or convert textual resources into conversational formats, providing a more efficient and scalable approach to dataset creation. In this survey, we offer a systematic and comprehensive review of multi-turn conversational data generation, focusing on three types of dialogue systems: open domain, task-oriented, and information-seeking. We categorize the existing research based on key components like seed data creation, utterance generation, and quality filtering methods, and introduce a general framework that outlines the main principles of conversation data generation systems. Additionally, we examine the evaluation metrics and methods for assessing synthetic conversational data, address current challenges in the field, and explore potential directions for future research. Our goal is to accelerate progress for researchers and practitioners by presenting an overview of state-of-the-art methods and highlighting opportunities to further research in this area.

Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 108 of its 153 references that are in the map. First posted on arXiv 12 May 2024.

Builds on

108 of 153 references.

References · 108

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  6. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  7. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  8. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  9. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
  10. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
  11. 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 825
  12. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
38 more
  1. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
  2. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
  3. 2018CoQA: A Conversational Question Answering Challengecited by 674
  4. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
  5. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
  6. 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
  7. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 484
  8. 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 426
  9. 2016Reinforcement Learning with Unsupervised Auxiliary Taskscited by 400
  10. 2018QuAC : Question Answering in Contextcited by 379
  11. 2021Towards Emotional Support Dialog Systemscited by 294
  12. 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
  13. 2022Towards a Unified Multi-Dimensional Evaluator for Text Generationcited by 264
  14. 2016A Network-based End-to-End Trainable Task-oriented Dialogue Systemcited by 252
  15. 2023Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Biascited by 230
  16. 2020USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generationcited by 186
  17. 2019The Second Conversational Intelligence Challenge (ConvAI2)cited by 178
  18. 2023Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMscited by 175
  19. 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
  20. 2022SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualizationcited by 166
  21. 2018Decoupling Strategy and Generation in Negotiation Dialoguescited by 156
  22. 2020Open-Domain Question Answering Goes Conversational via Question Rewritingcited by 147
  23. 2019Synthetic QA Corpora Generation with Roundtrip Consistencycited by 143
  24. 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
  25. 2023AugGPT: Leveraging ChatGPT for Text Data Augmentationcited by 128
  26. 2019Survey on Evaluation Methods for Dialogue Systemscited by 126
  27. 2018Cross-Lingual Transfer Learning for Multilingual Task Oriented Dialogcited by 124
  28. 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 115
  29. 2018Generating Informative and Diverse Conversational Responses via Adversarial Information Maximizationcited by 114
  30. 2021TopiOCQA: Open-domain Conversational Question Answering with Topic Switchingcited by 95
  31. 2023Topical-Chat: Towards Knowledge-Grounded Open-Domain Conversationscited by 88
  32. 2024RAG vs Fine-tuning: Pipelines, Tradeoffs, and a Case Study on Agriculturecited by 80
  33. 2022AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversationcited by 79
  34. 2023PLACES: Prompting Language Models for Social Conversation Synthesiscited by 72
  35. 2018Building a Conversational Agent Overnight with Dialogue Self-Playcited by 70
  36. 2023Let the LLMs Talk: Simulating Human-to-Human Conversational QA via Zero-Shot LLM-to-LLM Interactionscited by 70
  37. 2019Target-Guided Open-Domain Conversationcited by 66
  38. 2022Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agentscited by 62

50 most cited of 108 All 108 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 14; 2026: 6.

23 papers.

Sort:

By area:

  1. 2025MTRAG: A Multi-Turn Conversational Benchmark for Evaluating Retrieval-Augmented Generation Systemscited by 50
  2. 2025User Simulation in the Era of Generative AI: User Modeling, Synthetic Data Generation, and System Evaluationcited by 16
  3. 2025Rankers, Judges, and Assistants: Towards Understanding the Interplay of LLMs in Information Retrieval Evaluationcited by 15
  4. 2026A Survey on LLM-based Conversational User Simulationcited by 14
  5. 2025Can LLMs Narrate Tabular Data? An Evaluation Framework for Natural Language Representations of Text-to-SQL System Outputscited by 7
  6. 2024X-TURING: Towards an Enhanced and Efficient Turing Test for Long-Term Dialogue Agentscited by 6
  7. 2024Generate then Refine: Data Augmentation for Zero-shot Intent Detectioncited by 6
  8. 2025We Argue to Agree: Towards Personality-Driven Argumentation-Based Negotiation Dialogue Systems for Tourismcited by 5
  9. 2025Uncertainty Quantification for Retrieval-Augmented Reasoningcited by 5
  10. 2025Query Decomposition for RAG: Balancing Exploration-Exploitationcited by 5
  11. 2025A Comprehensive Taxonomy of Negation for NLP and Neural Retrieverscited by 4
  12. 2024From Intents to Conversations: Generating Intent-Driven Dialogues with Contrastive Learning for Multi-Turn Classificationcited by 2
11 more
  1. 2025Single- vs. Dual-Prompt Dialogue Generation with LLMs for Job Interviews in Human Resourcescited by 2
  2. 2025SPILL: Domain-Adaptive Intent Clustering based on Selection and Pooling with Large Language Modelscited by 2
  3. 2025DialogueForge: LLM Simulation of Human-Chatbot Dialoguecited by 2
  4. 2025DiscussLLM: Teaching Large Language Models When to Speakcited by 1
  5. 2025PromptAug: Fine-grained Conflict Classification Using Data Augmentationcited by 0
  6. 2025A Longitudinal Study on Different Annotator Feedback Loops in Complex RAG Taskscited by 0
  7. 2026MPCEval: A Benchmark for Multi-Party Conversation Generationcited by 0
  8. 2026Uncertainty Quantification for Multimodal Retrieval Augmented Generationcited by 0
  9. 2026The Significance of Style Diversity in Annotation-Free Synthetic Data Generationcited by 0
  10. 2026Clinical Communication Processing with Models Trained on LLM-Generated Synthetic Data: A Structured Survey and Novel Application Case Studiescited by 0
  11. 2026Beyond Mode Collapse: Generating Diverse Synthetic Expert Conversations via Generative Flow Networkscited by 0