Exploring Prompt-based Few-shot Learning for Grounded Dialog Generation
Not on the map. Why?
Abstract (arXiv)
Dialog models can be greatly strengthened through grounding on various external information, but grounded dialog corpora are usually not naturally accessible. In this work, we focus on the few-shot learning for grounded dialog generation (GDG). We first propose a simple prompting method for GDG tasks, where different constructs of model input, such as the grounding source and the conversation context, are distinguished through continuous or discrete prompts. On three typical GDG tasks, we empirically demonstrate and analyze in-depth the effectiveness of our method. We then conduct extensive experiments to thoroughly investigate how our prompting method works with different pre-trained models. We show that prompted language models perform superiorly to conversational models, and further analyze various factors that influence the effects of prompting. Overall, our work introduces a prompt-based perspective to the few-shot learning for GDG tasks, and provides valuable findings and insights for future research.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 40 of its 55 references that are in the map. First posted on arXiv 14 Sep 2021.
Builds on
40 of 55 references.
References · 40
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
- 2019How Can We Know What Language Models Know?cited by 953
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
28 more
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
- 2021GPT Understands, Toocited by 715
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
- 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
- 2020Recipes for building an open-domain chatbotcited by 593
- 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
- 2021Towards Emotional Support Dialog Systemscited by 294
- 2020AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Promptscited by 246
- 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
- 2021PPT: Pre-trained Prompt Tuning for Few-shot Learningcited by 232
- 2019TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agentscited by 188
- 2019Challenges in Building Intelligent Open-domain Dialog Systemscited by 147
- 2021Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Modelscited by 139
- 2017A Knowledge-Grounded Neural Conversation Modelcited by 136
- 2020Can You Put it All Together: Evaluating Conversational Agents' Ability to Blend Skillscited by 130
- 2018A Dataset for Document Grounded Conversationscited by 104
- 2021PsyQA: A Chinese Dataset for Generating Long Counseling Text for Mental Health Supportcited by 92
- 2020Few-Shot Text Generation with Pattern-Exploiting Trainingcited by 87
- 2019A Pre-training Based Personalized Dialogue Generation Model with Persona-sparse Datacited by 74
- 2020KdConv: A Chinese Multi-domain Dialogue Dataset Towards Multi-turn Knowledge-driven Conversationcited by 59
- 2018Towards Exploiting Background Knowledge for Building Conversation Systemscited by 57
- 2020Low-Resource Knowledge-Grounded Dialogue Generationcited by 53
- 2021CoMAE: A Multi-factor Hierarchical Framework for Empathetic Response Generationcited by 42
- 2020Zero-Resource Knowledge-Grounded Dialogue Generationcited by 35
- 2021CINS: Comprehensive Instruction for Few-shot Learning in Task-oriented Dialog Systemscited by 30
- 2021A Three-Stage Learning Framework for Low-Resource Knowledge-Grounded Dialogue Generationcited by 19
- 2020Difference-aware Knowledge Selection for Knowledge-grounded Conversation Generationcited by 14
Built on by
Citing papers per year: 2021: 4; 2022: 7; 2023: 4; 2024: 4; 2025: 0; 2026: 1.
20 papers.
Sort:
By area:
- 2024On Prompt-Driven Safeguarding for Large Language Modelscited by 109
- 2022AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversationcited by 79
- 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systemscited by 64
- 2022Contrastive Learning Reduces Hallucination in Conversationscited by 39
- 2022Toxicity Detection with Generative Prompt-based Inferencecited by 35
- 2021Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generationcited by 26
- 2022Multi-Stage Prompting for Knowledgeable Dialogue Generationcited by 22
- 2023Dialogue Planning via Brownian Bridge Stochastic Process for Goal-directed Proactive Dialoguecited by 14
- 2023Assisting Language Learners: Automated Trans-Lingual Definition Generation via Contrastive Prompt Learningcited by 13
- 2021Response Generation with Context-Aware Prompt Learningcited by 12
- 2022Constructing Highly Inductive Contexts for Dialogue Safety through Controllable Reverse Generationcited by 8
- 2023UniMC: A Unified Framework for Long-Term Memory Conversation via Relevance Representation Learningcited by 6
8 more
- 2024Target-constrained Bidirectional Planning for Generation of Target-oriented Proactive Dialoguecited by 6
- 2023We are what we repeatedly do: Inducing and deploying habitual schemas in persona-based responsescited by 3
- 2024A Cause-Effect Look at Alleviating Hallucination of Knowledge-grounded Dialogue Generationcited by 3
- 2021PSG: Prompt-based Sequence Generation for Acronym Extractioncited by 2
- 2024GPT-DETOX: An In-Context Learning-Based Paraphraser for Text Detoxificationcited by 2
- 2022Selective Token Generation for Few-shot Natural Language Generationcited by 1
- 2022COMPILING: A Benchmark Dataset for Chinese Complexity Controllable Definition Generationcited by 1
- 2026Controlling and Assessing Appropriate Persona Use in LLM-based Dialogue Generationcited by 0
- 2026Controlling and Assessing Appropriate Persona Use in LLM-based Dialogue Generation4 Sep 2026
- 2024A Cause-Effect Look at Alleviating Hallucination of Knowledge-grounded Dialogue Generation4 Apr 2024
- 2024GPT-DETOX: An In-Context Learning-Based Paraphraser for Text Detoxification3 Apr 2024
- 2024Target-constrained Bidirectional Planning for Generation of Target-oriented Proactive Dialogue10 Mar 2024
- 2024On Prompt-Driven Safeguarding for Large Language Models31 Jan 2024
- 2023We are what we repeatedly do: Inducing and deploying habitual schemas in persona-based responses10 Oct 2023
- 2023UniMC: A Unified Framework for Long-Term Memory Conversation via Relevance Representation Learning18 Jun 2023
- 2023Assisting Language Learners: Automated Trans-Lingual Definition Generation via Contrastive Prompt Learning9 Jun 2023
- 2023Dialogue Planning via Brownian Bridge Stochastic Process for Goal-directed Proactive Dialogue9 May 2023
- 2022Contrastive Learning Reduces Hallucination in Conversations20 Dec 2022
- 2022Constructing Highly Inductive Contexts for Dialogue Safety through Controllable Reverse Generation4 Dec 2022
- 2022COMPILING: A Benchmark Dataset for Chinese Complexity Controllable Definition Generation29 Sep 2022
8 more
- 2022Selective Token Generation for Few-shot Natural Language Generation17 Sep 2022
- 2022Toxicity Detection with Generative Prompt-based Inference24 May 2022
- 2022Multi-Stage Prompting for Knowledgeable Dialogue Generation16 Mar 2022
- 2022AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation26 Feb 2022
- 2021PSG: Prompt-based Sequence Generation for Acronym Extraction29 Nov 2021
- 2021Response Generation with Context-Aware Prompt Learning4 Nov 2021
- 2021Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generation16 Oct 2021
- 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systems15 Oct 2021
- 2024On Prompt-Driven Safeguarding for Large Language Modelscited by 109
- 2024On Prompt-Driven Safeguarding for Large Language Models31 Jan 2024
- 2022AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversationcited by 79
- 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systemscited by 64
- 2022Contrastive Learning Reduces Hallucination in Conversationscited by 39
- 2022Toxicity Detection with Generative Prompt-based Inferencecited by 35
- 2021Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generationcited by 26
- 2022Multi-Stage Prompting for Knowledgeable Dialogue Generationcited by 22
- 2023Dialogue Planning via Brownian Bridge Stochastic Process for Goal-directed Proactive Dialoguecited by 14
- 2023Assisting Language Learners: Automated Trans-Lingual Definition Generation via Contrastive Prompt Learningcited by 13
- 2021Response Generation with Context-Aware Prompt Learningcited by 12
- 2022Constructing Highly Inductive Contexts for Dialogue Safety through Controllable Reverse Generationcited by 8
- 2023UniMC: A Unified Framework for Long-Term Memory Conversation via Relevance Representation Learningcited by 6
- 2024Target-constrained Bidirectional Planning for Generation of Target-oriented Proactive Dialoguecited by 6
12 most cited of 19 All 19 (JSON)
- 2026Controlling and Assessing Appropriate Persona Use in LLM-based Dialogue Generation4 Sep 2026
- 2024A Cause-Effect Look at Alleviating Hallucination of Knowledge-grounded Dialogue Generation4 Apr 2024
- 2024GPT-DETOX: An In-Context Learning-Based Paraphraser for Text Detoxification3 Apr 2024
- 2024Target-constrained Bidirectional Planning for Generation of Target-oriented Proactive Dialogue10 Mar 2024
- 2023We are what we repeatedly do: Inducing and deploying habitual schemas in persona-based responses10 Oct 2023
- 2023UniMC: A Unified Framework for Long-Term Memory Conversation via Relevance Representation Learning18 Jun 2023
- 2023Assisting Language Learners: Automated Trans-Lingual Definition Generation via Contrastive Prompt Learning9 Jun 2023
- 2023Dialogue Planning via Brownian Bridge Stochastic Process for Goal-directed Proactive Dialogue9 May 2023
- 2022Contrastive Learning Reduces Hallucination in Conversations20 Dec 2022
- 2022Constructing Highly Inductive Contexts for Dialogue Safety through Controllable Reverse Generation4 Dec 2022
- 2022COMPILING: A Benchmark Dataset for Chinese Complexity Controllable Definition Generation29 Sep 2022
- 2022Selective Token Generation for Few-shot Natural Language Generation17 Sep 2022
12 newest of 19 All 19 (JSON)