Controllable Mixed-Initiative Dialogue Generation through Prompting
Not on the map. Why?
Abstract (arXiv)
Mixed-initiative dialogue tasks involve repeated exchanges of information and conversational control. Conversational agents gain control by generating responses that follow particular dialogue intents or strategies, prescribed by a policy planner. The standard approach has been fine-tuning pre-trained language models to perform generation conditioned on these intents. However, these supervised generation models are limited by the cost and quality of data annotation. We instead prompt large language models as a drop-in replacement to fine-tuning on conditional generation. We formalize prompt construction for controllable mixed-initiative dialogue. Our findings show improvements over fine-tuning and ground truth responses according to human evaluation and automatic metrics for two tasks: PersuasionForGood and Emotional Support Conversations.
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 49 of its 55 references that are in the map. First posted on arXiv 6 May 2023.
Builds on
49 of 55 references.
References · 49
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 799
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 762
- 2015Generating Sentences from a Continuous Spacecited by 612
37 more
- 2020Recipes for building an open-domain chatbotcited by 593
- 2016How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generationcited by 356
- 2021Towards Emotional Support Dialog Systemscited by 299
- 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 267
- 2021Internet-Augmented Dialogue Generationcited by 217
- 2019Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Goodcited by 209
- 2020MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselinescited by 204
- 2022Generating Training Data with Language Models: Towards Zero-Shot Language Understandingcited by 199
- 2022SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualizationcited by 168
- 2017Controlling Linguistic Style Aspects in Neural Language Generationcited by 149
- 2017Style Transfer in Text: Exploration and Evaluationcited by 146
- 2020Towards Conversational Recommendation over Multi-Type Dialogscited by 107
- 2022Language Models that Seek for Knowledge: Modular Search & Generation for Dialogue and Prompt Completioncited by 102
- 2021Dialogue State Tracking with a Language Model using Schema-Driven Promptingcited by 94
- 2021A Comprehensive Assessment of Dialog Evaluation Metricscited by 90
- 2023PLACES: Prompting Language Models for Social Conversation Synthesiscited by 72
- 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systemscited by 64
- 2021A Plug-and-Play Method for Controlled Text Generationcited by 56
- 2019Topic-Guided Variational Autoencoders for Text Generationcited by 44
- 2019Semantically Conditioned Dialog Response Generation via Hierarchical Disentangled Self-Attentioncited by 44
- 2022Weakly Supervised Data Augmentation Through Prompting for Dialogue Understandingcited by 32
- 2021Annotation Inconsistency and Entity Bias in MultiWOZcited by 30
- 2021CINS: Comprehensive Instruction for Few-shot Learning in Task-oriented Dialog Systemscited by 30
- 2020Effects of Persuasive Dialogues: Testing Bot Identities and Inquiry Strategiescited by 29
- 2021Rome was built in 1776: A Case Study on Factual Correctness in Knowledge-Grounded Response Generationcited by 29
- 2021Attribute Alignment: Controlling Text Generation from Pre-trained Language Modelscited by 27
- 2022Multi-Stage Prompting for Knowledgeable Dialogue Generationcited by 22
- 2018Deep Dyna-Q: Integrating Planning for Task-Completion Dialogue Policy Learningcited by 21
- 2021Towards Quantifiable Dialogue Coherence Evaluationcited by 21
- 2022LAD: Language Models as Data for Zero-Shot Dialogcited by 18
- 2019Planning for Goal-Oriented Dialogue Systemscited by 15
- 2019Improving Knowledge-aware Dialogue Generation via Knowledge Base Question Answeringcited by 15
- 2022Don't Prompt, Search! Mining-based Zero-Shot Learning with Language Modelscited by 13
- 2021LEGOEval: An Open-Source Toolkit for Dialogue System Evaluation via Crowdsourcingcited by 11
- 2022Seamlessly Integrating Factual Information and Social Content with Persuasive Dialoguecited by 11
- 2022Zero-Shot Prompting for Implicit Intent Prediction and Recommendation with Commonsense Reasoningcited by 6
- 2022Improving Bot Response Contradiction Detection via Utterance Rewritingcited by 4
Built on by
Citing papers per year: 2023: 6; 2024: 11; 2025: 9; 2026: 6.
32 papers.
Sort:
By area:
- 2025CollabLLM: From Passive Responders to Active Collaboratorscited by 124
- 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 116
- 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agentscited by 77
- 2023Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMscited by 62
- 2023Prompt-Based Monte-Carlo Tree Search for Goal-Oriented Dialogue Policy Planningcited by 61
- 2024Learning to Clarify: Multi-turn Conversations with Action-Based Contrastive Self-Trainingcited by 57
- 2024Can Large Language Models be Good Emotional Supporter? Mitigating Preference Bias on Emotional Support Conversationcited by 55
- 2024Towards Human-centered Proactive Conversational Agentscited by 49
- 2025Creating General User Models from Computer Usecited by 44
- 2025Navigating Rifts in Human-LLM Grounding: Study and Benchmarkcited by 29
- 2024Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspectivecited by 25
- 2024A Survey on Recent Advances in Conversational Data Generationcited by 23
20 more
- 2024Strength Lies in Differences! Improving Strategy Planning for Non-collaborative Dialogues via Diversified User Simulationcited by 21
- 2023COOPER: Coordinating Specialized Agents towards a Complex Dialogue Goalcited by 18
- 2025PRINCIPLES: Synthetic Strategy Memory for Proactive Dialogue Agentscited by 15
- 2024Zero-shot Persuasive Chatbots with LLM-Generated Strategies and Information Retrievalcited by 14
- 2024Simulation-Free Hierarchical Latent Policy Planning for Proactive Dialoguescited by 14
- 2023Curriculum-Driven Edubot: A Framework for Developing Language Learning Chatbots Through Synthesizing Conversational Datacited by 9
- 2024EmoDynamiX: Emotional Support Dialogue Strategy Prediction by Modelling MiXed Emotions and Discourse Dynamicscited by 9
- 2024X-TURING: Towards an Enhanced and Efficient Turing Test for Long-Term Dialogue Agentscited by 6
- 2025KMI: A Dataset of Korean Motivational Interviewing Dialogues for Psychotherapycited by 5
- 2025Towards Open-Ended Emotional Support Conversations in LLMs via Reinforcement Learning with Future-Oriented Rewardscited by 5
- 2026Proactive Service Agents: A Unified Decision Framework, Methods, and Evaluationcited by 2
- 2025BehaviorSFT: Behavioral Token Conditioning for Clinical Agents Across the Proactivity Spectrumcited by 1
- 2025Mixed-Initiative Dialog for Human-Robot Collaborative Manipulationcited by 1
- 2024Mix-Initiative Response Generation with Dynamic Prefix Tuningcited by 0
- 2025Mitigating Strategy Preference Bias in Emotional Support Conversation via Uncertainty Estimationscited by 0
- 2026Tinker Tales: A Tangible Dialogue System for Child-AI Co-Creative Storytellingcited by 0
- 2026Alignment has a Fantasia Problemcited by 0
- 2026A Comparative Study of Controlled Text Generation Systems Using Level-Playing-Field Evaluation Principlescited by 0
- 2026UP-NRPA: User Portrait based Nested Rollout Policy Adaptation for Planning with Large Language Models in Goal-oriented Dialogue Systemscited by 0
- 2026Proactive Dialogue Policy Optimization via Cognitive-State Transitioncited by 0
- 2026Proactive Dialogue Policy Optimization via Cognitive-State Transition28 Sep 2026
- 2026Proactive Service Agents: A Unified Decision Framework, Methods, and Evaluation3 Sep 2026
- 2026A Comparative Study of Controlled Text Generation Systems Using Level-Playing-Field Evaluation Principles12 May 2026
- 2026Alignment has a Fantasia Problem23 Apr 2026
- 2026UP-NRPA: User Portrait based Nested Rollout Policy Adaptation for Planning with Large Language Models in Goal-oriented Dialogue Systems7 Apr 2026
- 2026Tinker Tales: A Tangible Dialogue System for Child-AI Co-Creative Storytelling4 Feb 2026
- 2025PRINCIPLES: Synthetic Strategy Memory for Proactive Dialogue Agents22 Sep 2025
- 2025Mitigating Strategy Preference Bias in Emotional Support Conversation via Uncertainty Estimations16 Sep 2025
- 2025Towards Open-Ended Emotional Support Conversations in LLMs via Reinforcement Learning with Future-Oriented Rewards18 Aug 2025
- 2025Mixed-Initiative Dialog for Human-Robot Collaborative Manipulation7 Aug 2025
- 2025BehaviorSFT: Behavioral Token Conditioning for Clinical Agents Across the Proactivity Spectrum27 May 2025
- 2025Creating General User Models from Computer Use16 May 2025
20 more
- 2025Navigating Rifts in Human-LLM Grounding: Study and Benchmark18 Mar 2025
- 2025KMI: A Dataset of Korean Motivational Interviewing Dialogues for Psychotherapy8 Feb 2025
- 2025CollabLLM: From Passive Responders to Active Collaborators2 Feb 2025
- 2024Simulation-Free Hierarchical Latent Policy Planning for Proactive Dialogues19 Dec 2024
- 2024X-TURING: Towards an Enhanced and Efficient Turing Test for Long-Term Dialogue Agents19 Aug 2024
- 2024EmoDynamiX: Emotional Support Dialogue Strategy Prediction by Modelling MiXed Emotions and Discourse Dynamics16 Aug 2024
- 2024Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspective30 Jul 2024
- 2024Zero-shot Persuasive Chatbots with LLM-Generated Strategies and Information Retrieval4 Jul 2024
- 2024Learning to Clarify: Multi-turn Conversations with Action-Based Contrastive Self-Training31 May 2024
- 2024A Survey on Recent Advances in Conversational Data Generation12 May 2024
- 2024Towards Human-centered Proactive Conversational Agents19 Apr 2024
- 2024Mix-Initiative Response Generation with Dynamic Prefix Tuning26 Mar 2024
- 2024Strength Lies in Differences! Improving Strategy Planning for Non-collaborative Dialogues via Diversified User Simulation11 Mar 2024
- 2024Can Large Language Models be Good Emotional Supporter? Mitigating Preference Bias on Emotional Support Conversation20 Feb 2024
- 2023COOPER: Coordinating Specialized Agents towards a Complex Dialogue Goal19 Dec 2023
- 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agents1 Nov 2023
- 2023Curriculum-Driven Edubot: A Framework for Developing Language Learning Chatbots Through Synthesizing Conversational Data28 Sep 2023
- 2023Prompt-Based Monte-Carlo Tree Search for Goal-Oriented Dialogue Policy Planning23 May 2023
- 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaboration23 May 2023
- 2023Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMs19 May 2023
- 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agentscited by 77
- 2025PRINCIPLES: Synthetic Strategy Memory for Proactive Dialogue Agentscited by 15
- 2024X-TURING: Towards an Enhanced and Efficient Turing Test for Long-Term Dialogue Agentscited by 6
- 2026Proactive Service Agents: A Unified Decision Framework, Methods, and Evaluationcited by 2
- 2025BehaviorSFT: Behavioral Token Conditioning for Clinical Agents Across the Proactivity Spectrumcited by 1
- 2026Proactive Service Agents: A Unified Decision Framework, Methods, and Evaluation3 Sep 2026
- 2025PRINCIPLES: Synthetic Strategy Memory for Proactive Dialogue Agents22 Sep 2025
- 2025BehaviorSFT: Behavioral Token Conditioning for Clinical Agents Across the Proactivity Spectrum27 May 2025
- 2024X-TURING: Towards an Enhanced and Efficient Turing Test for Long-Term Dialogue Agents19 Aug 2024
- 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agents1 Nov 2023
- 2024Learning to Clarify: Multi-turn Conversations with Action-Based Contrastive Self-Trainingcited by 57
- 2025Towards Open-Ended Emotional Support Conversations in LLMs via Reinforcement Learning with Future-Oriented Rewardscited by 5
- 2025Mitigating Strategy Preference Bias in Emotional Support Conversation via Uncertainty Estimationscited by 0
- 2025Mitigating Strategy Preference Bias in Emotional Support Conversation via Uncertainty Estimations16 Sep 2025
- 2025Towards Open-Ended Emotional Support Conversations in LLMs via Reinforcement Learning with Future-Oriented Rewards18 Aug 2025
- 2024Learning to Clarify: Multi-turn Conversations with Action-Based Contrastive Self-Training31 May 2024
- 2025CollabLLM: From Passive Responders to Active Collaboratorscited by 124
- 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 116
- 2023Prompt-Based Monte-Carlo Tree Search for Goal-Oriented Dialogue Policy Planningcited by 61
- 2024Can Large Language Models be Good Emotional Supporter? Mitigating Preference Bias on Emotional Support Conversationcited by 55
- 2024Towards Human-centered Proactive Conversational Agentscited by 49
- 2025Creating General User Models from Computer Usecited by 44
- 2025Navigating Rifts in Human-LLM Grounding: Study and Benchmarkcited by 29
- 2024Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspectivecited by 25
- 2024A Survey on Recent Advances in Conversational Data Generationcited by 23
- 2024Strength Lies in Differences! Improving Strategy Planning for Non-collaborative Dialogues via Diversified User Simulationcited by 21
- 2023COOPER: Coordinating Specialized Agents towards a Complex Dialogue Goalcited by 18
- 2024Zero-shot Persuasive Chatbots with LLM-Generated Strategies and Information Retrievalcited by 14
12 most cited of 23 All 23 (JSON)
- 2026Proactive Dialogue Policy Optimization via Cognitive-State Transition28 Sep 2026
- 2026A Comparative Study of Controlled Text Generation Systems Using Level-Playing-Field Evaluation Principles12 May 2026
- 2026Alignment has a Fantasia Problem23 Apr 2026
- 2026UP-NRPA: User Portrait based Nested Rollout Policy Adaptation for Planning with Large Language Models in Goal-oriented Dialogue Systems7 Apr 2026
- 2026Tinker Tales: A Tangible Dialogue System for Child-AI Co-Creative Storytelling4 Feb 2026
- 2025Mixed-Initiative Dialog for Human-Robot Collaborative Manipulation7 Aug 2025
- 2025Creating General User Models from Computer Use16 May 2025
- 2025Navigating Rifts in Human-LLM Grounding: Study and Benchmark18 Mar 2025
- 2025KMI: A Dataset of Korean Motivational Interviewing Dialogues for Psychotherapy8 Feb 2025
- 2025CollabLLM: From Passive Responders to Active Collaborators2 Feb 2025
- 2024Simulation-Free Hierarchical Latent Policy Planning for Proactive Dialogues19 Dec 2024
- 2024EmoDynamiX: Emotional Support Dialogue Strategy Prediction by Modelling MiXed Emotions and Discourse Dynamics16 Aug 2024
12 newest of 23 All 23 (JSON)