DiaSynth: Synthetic Dialogue Generation Framework for Low Resource Dialogue Applications
Not on the map. Why?
Abstract (arXiv)
The scarcity of domain-specific dialogue datasets limits the development of dialogue systems across applications. Existing research is constrained by general or niche datasets that lack sufficient scale for training dialogue systems. To address this gap, we introduce DiaSynth - a synthetic dialogue generation framework capable of generating high-quality, contextually rich dialogues across a wide range of domains. Unlike existing frameworks, DiaSynth uses Large Language Models (LLMs) and Chain of Thought (CoT) reasoning to generate dynamic, domain-specific dialogues with simulated personas and diverse conversational features. We perform our experiments by generating synthetic data using different LLMs and few-shot examples from DialogSum and SAMSum. The pretrained language models fine-tuned on the synthetic data outperform the base models by 16.47% on dialogue summarization, while the comparison between models fine-tuned on in-domain data and synthetic data shows that the synthetic data is able to capture 90.48% of the performance distribution of the in-domain data on dialogue summarization. The quality of the data generated also increases as we increase the size of LLM from 3B to 8B. These results validate DiaSynth's potential as a robust alternative to traditional data collection methods. We open source the code and data generated for future research.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 21 of its 26 references that are in the map. First posted on arXiv 25 Sep 2024.
Builds on
21 of 26 references.
References · 21
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
- 2019SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarizationcited by 535
9 more
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 417
- 2020Asking and Answering Questions to Evaluate the Factual Consistency of Summariescited by 378
- 2023GPTScore: Evaluate as You Desirecited by 361
- 2021DialogSum: A Real-Life Scenario Dialogue Summarization Datasetcited by 183
- 2020MedDialog: Two Large-scale Medical Dialogue Datasetscited by 161
- 2020Unsupervised Evaluation of Interactive Dialog with DialoGPTcited by 139
- 2020doc2dial: A Goal-Oriented Document-Grounded Dialogue Datasetcited by 88
- 2023Chainpoll: A high efficacy method for LLM hallucination detectioncited by 39
- 2024PSYDIAL: Personality-based Synthetic Dialogue Generation using Large Language Modelscited by 6
Built on by
Citing papers per year: 2025: 7; 2026: 11.
18 papers.
Sort:
By area:
- 2025SEADialogues: A Multilingual Culturally Grounded Multi-turn Dialogue Dataset on Southeast Asian Languagescited by 4
- 2026Segment-Level Coherence for Robust Harmful Intent Probing in LLMscited by 3
- 2026M3-DuplexBench: A Multi-Turn, Multilingual, Multidomain Benchmark for Full-Duplex Spoken Dialogue Modelscited by 3
- 2025Single- vs. Dual-Prompt Dialogue Generation with LLMs for Job Interviews in Human Resourcescited by 2
- 2025Spoken DialogSum: An Emotion-Rich Conversational Dataset for Spoken Dialogue Summarizationcited by 2
- 2026Frame of Reference: Addressing the Challenges of Common Ground Representation in Situational Dialogscited by 2
- 2025Why Synthetic Isn't Real Yet: A Diagnostic Framework for Contact Center Dialogue Generationcited by 1
- 2025Paired by the Teacher: Turning Unpaired Data into High-Fidelity Pairs for Low-Resource Text Generationcited by 1
- 2025Understanding Generalization in Role-Playing Models via Information Theorycited by 1
- 2026Kakugo: Distillation of Low-Resource Languages into Small Language Modelscited by 1
- 2025Agentic Persona Control and Task State Tracking for Realistic User Simulation in Interactive Scenarioscited by 1
- 2026When2Speak: A Dataset for Temporal Participation and Turn-Taking in Multi-Party Conversations for Large Language Modelscited by 1
6 more
- 2026SafeTalkCoach: Diversity-Driven Multi-Agent Simulation for Parent-Teen Health Conversationscited by 0
- 2026PersonaTrace: Synthesizing Realistic Digital Footprints with LLM Agentscited by 0
- 2026Beyond Individual Personas: Aligning Synthetic Dialogue to Population-Level Behavior Distributionscited by 0
- 2026ConVAWG: A Retrieval-Grounded Framework for Controlled Synthetic Dialogue Generation in Violence Against Women and Girlscited by 0
- 2026TalkFa: A Unified Benchmark for Farsi Dialogue Generation and Understandingcited by 0
- 2026Measuring Cultural Alignment Beyond the Average: A Framework for Evaluating Maternal-Health LLM Interactions in Indian Contextscited by 0
- 2026Measuring Cultural Alignment Beyond the Average: A Framework for Evaluating Maternal-Health LLM Interactions in Indian Contexts8 Oct 2026
- 2026TalkFa: A Unified Benchmark for Farsi Dialogue Generation and Understanding1 Sep 2026
- 2026ConVAWG: A Retrieval-Grounded Framework for Controlled Synthetic Dialogue Generation in Violence Against Women and Girls11 Aug 2026
- 2026M3-DuplexBench: A Multi-Turn, Multilingual, Multidomain Benchmark for Full-Duplex Spoken Dialogue Models31 Jul 2026
- 2026Beyond Individual Personas: Aligning Synthetic Dialogue to Population-Level Behavior Distributions5 Jun 2026
- 2026When2Speak: A Dataset for Temporal Participation and Turn-Taking in Multi-Party Conversations for Large Language Models7 May 2026
- 2026Segment-Level Coherence for Robust Harmful Intent Probing in LLMs16 Apr 2026
- 2026PersonaTrace: Synthesizing Realistic Digital Footprints with LLM Agents12 Mar 2026
- 2026Kakugo: Distillation of Low-Resource Languages into Small Language Models20 Jan 2026
- 2026SafeTalkCoach: Diversity-Driven Multi-Agent Simulation for Parent-Teen Health Conversations14 Jan 2026
- 2026Frame of Reference: Addressing the Challenges of Common Ground Representation in Situational Dialogs14 Jan 2026
- 2025Understanding Generalization in Role-Playing Models via Information Theory19 Dec 2025
6 more
- 2025Spoken DialogSum: An Emotion-Rich Conversational Dataset for Spoken Dialogue Summarization16 Dec 2025
- 2025Agentic Persona Control and Task State Tracking for Realistic User Simulation in Interactive Scenarios30 Nov 2025
- 2025Paired by the Teacher: Turning Unpaired Data into High-Fidelity Pairs for Low-Resource Text Generation29 Sep 2025
- 2025Why Synthetic Isn't Real Yet: A Diagnostic Framework for Contact Center Dialogue Generation25 Aug 2025
- 2025SEADialogues: A Multilingual Culturally Grounded Multi-turn Dialogue Dataset on Southeast Asian Languages9 Aug 2025
- 2025Single- vs. Dual-Prompt Dialogue Generation with LLMs for Job Interviews in Human Resources25 Feb 2025
- 2025Agentic Persona Control and Task State Tracking for Realistic User Simulation in Interactive Scenarioscited by 1
- 2026SafeTalkCoach: Diversity-Driven Multi-Agent Simulation for Parent-Teen Health Conversationscited by 0
- 2026PersonaTrace: Synthesizing Realistic Digital Footprints with LLM Agentscited by 0
- 2026PersonaTrace: Synthesizing Realistic Digital Footprints with LLM Agents12 Mar 2026
- 2026SafeTalkCoach: Diversity-Driven Multi-Agent Simulation for Parent-Teen Health Conversations14 Jan 2026
- 2025Agentic Persona Control and Task State Tracking for Realistic User Simulation in Interactive Scenarios30 Nov 2025
- 2025SEADialogues: A Multilingual Culturally Grounded Multi-turn Dialogue Dataset on Southeast Asian Languagescited by 4
- 2026M3-DuplexBench: A Multi-Turn, Multilingual, Multidomain Benchmark for Full-Duplex Spoken Dialogue Modelscited by 3
- 2025Single- vs. Dual-Prompt Dialogue Generation with LLMs for Job Interviews in Human Resourcescited by 2
- 2025Spoken DialogSum: An Emotion-Rich Conversational Dataset for Spoken Dialogue Summarizationcited by 2
- 2026Frame of Reference: Addressing the Challenges of Common Ground Representation in Situational Dialogscited by 2
- 2025Why Synthetic Isn't Real Yet: A Diagnostic Framework for Contact Center Dialogue Generationcited by 1
- 2025Understanding Generalization in Role-Playing Models via Information Theorycited by 1
- 2026Kakugo: Distillation of Low-Resource Languages into Small Language Modelscited by 1
- 2026When2Speak: A Dataset for Temporal Participation and Turn-Taking in Multi-Party Conversations for Large Language Modelscited by 1
- 2026Beyond Individual Personas: Aligning Synthetic Dialogue to Population-Level Behavior Distributionscited by 0
- 2026ConVAWG: A Retrieval-Grounded Framework for Controlled Synthetic Dialogue Generation in Violence Against Women and Girlscited by 0
- 2026TalkFa: A Unified Benchmark for Farsi Dialogue Generation and Understandingcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Measuring Cultural Alignment Beyond the Average: A Framework for Evaluating Maternal-Health LLM Interactions in Indian Contexts8 Oct 2026
- 2026TalkFa: A Unified Benchmark for Farsi Dialogue Generation and Understanding1 Sep 2026
- 2026ConVAWG: A Retrieval-Grounded Framework for Controlled Synthetic Dialogue Generation in Violence Against Women and Girls11 Aug 2026
- 2026M3-DuplexBench: A Multi-Turn, Multilingual, Multidomain Benchmark for Full-Duplex Spoken Dialogue Models31 Jul 2026
- 2026Beyond Individual Personas: Aligning Synthetic Dialogue to Population-Level Behavior Distributions5 Jun 2026
- 2026When2Speak: A Dataset for Temporal Participation and Turn-Taking in Multi-Party Conversations for Large Language Models7 May 2026
- 2026Kakugo: Distillation of Low-Resource Languages into Small Language Models20 Jan 2026
- 2026Frame of Reference: Addressing the Challenges of Common Ground Representation in Situational Dialogs14 Jan 2026
- 2025Understanding Generalization in Role-Playing Models via Information Theory19 Dec 2025
- 2025Spoken DialogSum: An Emotion-Rich Conversational Dataset for Spoken Dialogue Summarization16 Dec 2025
- 2025Why Synthetic Isn't Real Yet: A Diagnostic Framework for Contact Center Dialogue Generation25 Aug 2025
- 2025SEADialogues: A Multilingual Culturally Grounded Multi-turn Dialogue Dataset on Southeast Asian Languages9 Aug 2025
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025SyGra: A Unified Graph-Based Framework for Scalable Generation, Quality Tagging, and Management of Synthetic Data
- 2024SynthDST: Synthetic Data is All You Need for Few-Shot Dialog State Tracking
- 2024ConvoSense: Overcoming Monotonous Commonsense Inferences for Conversational AI
- 2025Commonsense Generation and Evaluation for Dialogue Systems using Large Language Models
- 2024Self-Directed Synthetic Dialogues and Revisions Technical Report
- 2023Faithful Persona-based Conversational Dataset Generation with Large Language Models
- 2025IP-Dialog: Evaluating Implicit Personalization in Dialogue Systems with Synthetic Data
- 2025OmniChat: Enhancing Spoken Dialogue Systems with Scalable Synthetic Data for Diverse Scenarios