mlsanityData to 7 Oct 2026

Exploring Prompt-based Few-shot Learning for Grounded Dialog Generation

arXiv 2109.06513 ↗First posted 14 Sep 2021cs.CLcited by 20

Not on the map. Why?

Abstract (arXiv)

Dialog models can be greatly strengthened through grounding on various external information, but grounded dialog corpora are usually not naturally accessible. In this work, we focus on the few-shot learning for grounded dialog generation (GDG). We first propose a simple prompting method for GDG tasks, where different constructs of model input, such as the grounding source and the conversation context, are distinguished through continuous or discrete prompts. On three typical GDG tasks, we empirically demonstrate and analyze in-depth the effectiveness of our method. We then conduct extensive experiments to thoroughly investigate how our prompting method works with different pre-trained models. We show that prompted language models perform superiorly to conversational models, and further analyze various factors that influence the effects of prompting. Overall, our work introduces a prompt-based perspective to the few-shot learning for GDG tasks, and provides valuable findings and insights for future research.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 40 of its 55 references that are in the map. First posted on arXiv 14 Sep 2021.

Builds on

40 of 55 references.

References · 40

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  6. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  7. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  8. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  9. 2019Language Models as Knowledge Bases?cited by 1,922
  10. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  11. 2019How Can We Know What Language Models Know?cited by 953
  12. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
28 more
  1. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  2. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  3. 2021GPT Understands, Toocited by 715
  4. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
  5. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
  6. 2020Recipes for building an open-domain chatbotcited by 593
  7. 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
  8. 2021Towards Emotional Support Dialog Systemscited by 294
  9. 2020AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Promptscited by 246
  10. 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
  11. 2021PPT: Pre-trained Prompt Tuning for Few-shot Learningcited by 232
  12. 2019TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agentscited by 188
  13. 2019Challenges in Building Intelligent Open-domain Dialog Systemscited by 147
  14. 2021Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Modelscited by 139
  15. 2017A Knowledge-Grounded Neural Conversation Modelcited by 136
  16. 2020Can You Put it All Together: Evaluating Conversational Agents' Ability to Blend Skillscited by 130
  17. 2018A Dataset for Document Grounded Conversationscited by 104
  18. 2021PsyQA: A Chinese Dataset for Generating Long Counseling Text for Mental Health Supportcited by 92
  19. 2020Few-Shot Text Generation with Pattern-Exploiting Trainingcited by 87
  20. 2019A Pre-training Based Personalized Dialogue Generation Model with Persona-sparse Datacited by 74
  21. 2020KdConv: A Chinese Multi-domain Dialogue Dataset Towards Multi-turn Knowledge-driven Conversationcited by 59
  22. 2018Towards Exploiting Background Knowledge for Building Conversation Systemscited by 57
  23. 2020Low-Resource Knowledge-Grounded Dialogue Generationcited by 53
  24. 2021CoMAE: A Multi-factor Hierarchical Framework for Empathetic Response Generationcited by 42
  25. 2020Zero-Resource Knowledge-Grounded Dialogue Generationcited by 35
  26. 2021CINS: Comprehensive Instruction for Few-shot Learning in Task-oriented Dialog Systemscited by 30
  27. 2021A Three-Stage Learning Framework for Low-Resource Knowledge-Grounded Dialogue Generationcited by 19
  28. 2020Difference-aware Knowledge Selection for Knowledge-grounded Conversation Generationcited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 7; 2023: 4; 2024: 4; 2025: 0; 2026: 1.

20 papers.

Sort:

By area:

  1. 2024On Prompt-Driven Safeguarding for Large Language Modelscited by 109
  2. 2022AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversationcited by 79
  3. 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systemscited by 64
  4. 2022Contrastive Learning Reduces Hallucination in Conversationscited by 39
  5. 2022Toxicity Detection with Generative Prompt-based Inferencecited by 35
  6. 2021Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generationcited by 26
  7. 2022Multi-Stage Prompting for Knowledgeable Dialogue Generationcited by 22
  8. 2023Dialogue Planning via Brownian Bridge Stochastic Process for Goal-directed Proactive Dialoguecited by 14
  9. 2023Assisting Language Learners: Automated Trans-Lingual Definition Generation via Contrastive Prompt Learningcited by 13
  10. 2021Response Generation with Context-Aware Prompt Learningcited by 12
  11. 2022Constructing Highly Inductive Contexts for Dialogue Safety through Controllable Reverse Generationcited by 8
  12. 2023UniMC: A Unified Framework for Long-Term Memory Conversation via Relevance Representation Learningcited by 6
8 more
  1. 2024Target-constrained Bidirectional Planning for Generation of Target-oriented Proactive Dialoguecited by 6
  2. 2023We are what we repeatedly do: Inducing and deploying habitual schemas in persona-based responsescited by 3
  3. 2024A Cause-Effect Look at Alleviating Hallucination of Knowledge-grounded Dialogue Generationcited by 3
  4. 2021PSG: Prompt-based Sequence Generation for Acronym Extractioncited by 2
  5. 2024GPT-DETOX: An In-Context Learning-Based Paraphraser for Text Detoxificationcited by 2
  6. 2022Selective Token Generation for Few-shot Natural Language Generationcited by 1
  7. 2022COMPILING: A Benchmark Dataset for Chinese Complexity Controllable Definition Generationcited by 1
  8. 2026Controlling and Assessing Appropriate Persona Use in LLM-based Dialogue Generationcited by 0