Can LLMs Generate High-Quality Task-Specific Conversations?
Not on the map. Why?
Abstract (arXiv)
This paper introduces a parameterization framework for controlling conversation quality in large language models. We explore nine key parameters across six dimensions that enable precise specification of dialogue properties. Through experiments with state-of-the-art LLMs, we demonstrate that parameter-based control produces statistically significant differences in generated conversation properties. Our approach addresses challenges in conversation generation, including topic coherence, knowledge progression, character consistency, and control granularity. The framework provides a standardized method for conversation quality control with applications in education, therapy, customer service, and entertainment. Future work will focus on implementing additional parameters through architectural modifications and developing benchmark datasets for evaluation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 61 references that are in the map. First posted on arXiv 4 Aug 2025.
Builds on
36 of 61 references.
References · 36
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,434
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,077
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
24 more
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 799
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 762
- 2020Recipes for building an open-domain chatbotcited by 593
- 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 515
- 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 376
- 2023ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledgecited by 325
- 2017Toward Controlled Generation of Textcited by 272
- 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 267
- 2016A Persona-Based Neural Conversation Modelcited by 223
- 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 198
- 2020USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generationcited by 188
- 2018Neural Approaches to Conversational AIcited by 165
- 2020A Theory of Usable Information Under Computational Constraintscited by 162
- 2019Challenges in Building Intelligent Open-domain Dialog Systemscited by 147
- 2019What makes a good conversation? How controllable attributes affect human judgmentscited by 140
- 2022On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?cited by 138
- 2019Survey on Evaluation Methods for Dialogue Systemscited by 126
- 2019Learning to Speak and Act in a Fantasy Text Adventure Gamecited by 122
- 2020A Distributional Approach to Controlled Text Generationcited by 119
- 2021A Neural Network Solves, Explains, and Generates University Math Problems by Program Synthesis and Few-Shot Learning at Human Levelcited by 96
- 2019Evaluating Coherence in Dialogue Systems using Entailmentcited by 53
- 2024Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMscited by 46
- 2025From Guessing to Asking: An Approach to Resolving the Persona Knowledge Gap in LLMs during Multi-Turn Conversationscited by 1
Built on by
Not cited yet.