mlsanityData to 14 Oct 2026

DiaSynth: Synthetic Dialogue Generation Framework for Low Resource Dialogue Applications

arXiv 2409.19020 ↗First posted 25 Sep 2024cs.CL cs.LGcited by 18

Not on the map. Why?

Abstract (arXiv)

The scarcity of domain-specific dialogue datasets limits the development of dialogue systems across applications. Existing research is constrained by general or niche datasets that lack sufficient scale for training dialogue systems. To address this gap, we introduce DiaSynth - a synthetic dialogue generation framework capable of generating high-quality, contextually rich dialogues across a wide range of domains. Unlike existing frameworks, DiaSynth uses Large Language Models (LLMs) and Chain of Thought (CoT) reasoning to generate dynamic, domain-specific dialogues with simulated personas and diverse conversational features. We perform our experiments by generating synthetic data using different LLMs and few-shot examples from DialogSum and SAMSum. The pretrained language models fine-tuned on the synthetic data outperform the base models by 16.47% on dialogue summarization, while the comparison between models fine-tuned on in-domain data and synthetic data shows that the synthetic data is able to capture 90.48% of the performance distribution of the in-domain data on dialogue summarization. The quality of the data generated also increases as we increase the size of LLM from 3B to 8B. These results validate DiaSynth's potential as a robust alternative to traditional data collection methods. We open source the code and data generated for future research.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 21 of its 26 references that are in the map. First posted on arXiv 25 Sep 2024.

Builds on

21 of 26 references.

References · 21

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  6. 2020Longformer: The Long-Document Transformercited by 3,413
  7. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  8. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  9. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  10. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
  11. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
  12. 2019SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarizationcited by 535
9 more
  1. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 417
  2. 2020Asking and Answering Questions to Evaluate the Factual Consistency of Summariescited by 378
  3. 2023GPTScore: Evaluate as You Desirecited by 361
  4. 2021DialogSum: A Real-Life Scenario Dialogue Summarization Datasetcited by 183
  5. 2020MedDialog: Two Large-scale Medical Dialogue Datasetscited by 161
  6. 2020Unsupervised Evaluation of Interactive Dialog with DialoGPTcited by 139
  7. 2020doc2dial: A Goal-Oriented Document-Grounded Dialogue Datasetcited by 88
  8. 2023Chainpoll: A high efficacy method for LLM hallucination detectioncited by 39
  9. 2024PSYDIAL: Personality-based Synthetic Dialogue Generation using Large Language Modelscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 11.

18 papers.

Sort:

By area:

  1. 2025SEADialogues: A Multilingual Culturally Grounded Multi-turn Dialogue Dataset on Southeast Asian Languagescited by 4
  2. 2026Segment-Level Coherence for Robust Harmful Intent Probing in LLMscited by 3
  3. 2026M3-DuplexBench: A Multi-Turn, Multilingual, Multidomain Benchmark for Full-Duplex Spoken Dialogue Modelscited by 3
  4. 2025Single- vs. Dual-Prompt Dialogue Generation with LLMs for Job Interviews in Human Resourcescited by 2
  5. 2025Spoken DialogSum: An Emotion-Rich Conversational Dataset for Spoken Dialogue Summarizationcited by 2
  6. 2026Frame of Reference: Addressing the Challenges of Common Ground Representation in Situational Dialogscited by 2
  7. 2025Why Synthetic Isn't Real Yet: A Diagnostic Framework for Contact Center Dialogue Generationcited by 1
  8. 2025Paired by the Teacher: Turning Unpaired Data into High-Fidelity Pairs for Low-Resource Text Generationcited by 1
  9. 2025Understanding Generalization in Role-Playing Models via Information Theorycited by 1
  10. 2026Kakugo: Distillation of Low-Resource Languages into Small Language Modelscited by 1
  11. 2025Agentic Persona Control and Task State Tracking for Realistic User Simulation in Interactive Scenarioscited by 1
  12. 2026When2Speak: A Dataset for Temporal Participation and Turn-Taking in Multi-Party Conversations for Large Language Modelscited by 1
6 more
  1. 2026SafeTalkCoach: Diversity-Driven Multi-Agent Simulation for Parent-Teen Health Conversationscited by 0
  2. 2026PersonaTrace: Synthesizing Realistic Digital Footprints with LLM Agentscited by 0
  3. 2026Beyond Individual Personas: Aligning Synthetic Dialogue to Population-Level Behavior Distributionscited by 0
  4. 2026ConVAWG: A Retrieval-Grounded Framework for Controlled Synthetic Dialogue Generation in Violence Against Women and Girlscited by 0
  5. 2026TalkFa: A Unified Benchmark for Farsi Dialogue Generation and Understandingcited by 0
  6. 2026Measuring Cultural Alignment Beyond the Average: A Framework for Evaluating Maternal-Health LLM Interactions in Indian Contextscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025SyGra: A Unified Graph-Based Framework for Scalable Generation, Quality Tagging, and Management of Synthetic Data
  2. 2024SynthDST: Synthetic Data is All You Need for Few-Shot Dialog State Tracking
  3. 2024ConvoSense: Overcoming Monotonous Commonsense Inferences for Conversational AI
  4. 2025Commonsense Generation and Evaluation for Dialogue Systems using Large Language Models
  5. 2024Self-Directed Synthetic Dialogues and Revisions Technical Report
  6. 2023Faithful Persona-based Conversational Dataset Generation with Large Language Models
  7. 2025IP-Dialog: Evaluating Implicit Personalization in Dialogue Systems with Synthetic Data
  8. 2025OmniChat: Enhancing Spoken Dialogue Systems with Scalable Synthetic Data for Diverse Scenarios