Skeleton-to-Response: Dialogue Generation Guided by Retrieval Memory
Not on the map. Why?
Abstract (arXiv)
For dialogue response generation, traditional generative models generate responses solely from input queries. Such models rely on insufficient information for generating a specific response since a certain query could be answered in multiple ways. Consequentially, those models tend to output generic and dull responses, impeding the generation of informative utterances. Recently, researchers have attempted to fill the information gap by exploiting information retrieval techniques. When generating a response for a current query, similar dialogues retrieved from the entire training data are considered as an additional knowledge source. While this may harvest massive information, the generative models could be overwhelmed, leading to undesirable performance. In this paper, we propose a new framework which exploits retrieval results via a skeleton-then-response paradigm. At first, a skeleton is generated by revising the retrieved responses. Then, a novel generative model uses both the generated skeleton and the original query for response generation. Experimental results show that our approaches significantly improve the diversity and informativeness of the generated responses.
Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 9; 2023: 6; 2024: 16; 2025: 2; 2026: 2.
49 papers.
Sort:
By area:
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
- 2023Benchmarking Large Language Models in Retrieval-Augmented Generationcited by 307
- 2022A Survey on Retrieval-Augmented Text Generationcited by 157
- 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memorycited by 103
- 2023Retrieving Multimodal Information for Augmented Generation: A Surveycited by 84
- 2021Neural Machine Translation with Monolingual Translation Memorycited by 61
- 2024Disentangling Memory and Reasoning Ability in Large Language Modelscited by 43
- 2024VisDoM: Multi-Document QA with Visually Rich Elements Using Multimodal Retrieval-Augmented Generationcited by 40
- 2024RAG-DDR: Optimizing Retrieval-Augmented Generation Using Differentiable Data Rewardscited by 33
- 2023Copy Is All You Needcited by 25
- 2023Personalized Large Language Model Assistant with Evolving Conditional Memorycited by 24
37 more
- 2021RetGen: A Joint framework for Retrieval and Grounded Text Generation Modelingcited by 22
- 2024Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented Generationcited by 19
- 2022Recent Advances in Neural Text Generation: A Task-Agnostic Surveycited by 14
- 2022PCC: Paraphrasing with Bottom-k Sampling and Cyclic Learning for Curriculum Data Augmentationcited by 14
- 2024Accelerating Retrieval-Augmented Generationcited by 14
- 2021Advances in Multi-turn Dialogue Comprehension: A Surveycited by 12
- 2021IGA : An Intent-Guided Authoring Assistantcited by 12
- 2022Seamlessly Integrating Factual Information and Social Content with Persuasive Dialoguecited by 11
- 2021Transferable Persona-Grounded Dialogues via Grounded Minimal Editscited by 10
- 2023Diversify Question Generation with Retrieval-Augmented Style Transfercited by 10
- 2024Retrieval is Accurate Generationcited by 10
- 2021Sketch and Customize: A Counterfactual Story Generatorcited by 9
- 2021Exemplars-guided Empathetic Response Generation Controlled by the Elements of Human Communicationcited by 9
- 2024XL-HeadTags: Leveraging Multimodal Retrieval Augmentation for the Multilingual Generation of News Headlines and Tagscited by 9
- 2022AARGH! End-to-end Retrieval-Generation for Task-Oriented Dialogcited by 8
- 2025Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Modelscited by 8
- 2021Towards Standard Criteria for human evaluation of Chatbots: A Surveycited by 6
- 2021Smoothing Dialogue States for Open Conversational Machine Readingcited by 6
- 2024VeraCT Scan: Retrieval-Augmented Fake News Detection with Justifiable Reasoningcited by 6
- 2025UltraRAG: A Modular and Automated Toolkit for Adaptive Retrieval-Augmented Generationcited by 6
- 2021EmpBot: A T5-based Empathetic Chatbot focusing on Sentimentscited by 5
- 2022ConReader: Exploring Implicit Relations in Contracts for Contract Clause Extractioncited by 5
- 2024Towards a Robust Retrieval-Based Summarization Systemcited by 5
- 2024Dynamic Demonstration Retrieval and Cognitive Understanding for Emotional Support Conversationcited by 5
- 2024Spiral of Silence: How is Large Language Model Killing Information Retrieval? -- A Case Study on Open Domain Question Answeringcited by 5
- 2021Understanding and Improving the Exemplar-based Generation for Open-domain Conversationcited by 3
- 2022Pan More Gold from the Sand: Refining Open-domain Dialogue Training with Noisy Self-Retrieval Generationcited by 2
- 2024Mafin: Enhancing Black-Box Embeddings with Model Augmented Fine-Tuningcited by 2
- 2024Towards Robustness of Text-to-Visualization Translation against Lexical and Phrasal Variabilitycited by 2
- 2021Partner Personas Generation for Diverse Dialogue Generationcited by 1
- 2022DISK: Domain-constrained Instance Sketch for Math Word Problem Generationcited by 1
- 2022Mind the Knowledge Gap: A Survey of Knowledge-enhanced Dialogue Systemscited by 1
- 2021Advances in Multi-turn Dialogue Comprehension: A Surveycited by 0
- 2024A Stack-Propagation Framework for Low-Resource Personalized Dialogue Generationcited by 0
- 2024PrefRAG: Preference-Driven Multi-Source Retrieval Augmented Generationcited by 0
- 2026PRCCF: A Persona-guided Retrieval and Causal-aware Cognitive Filtering Framework for Emotional Support Conversationcited by 0
- 2026Human-AI Co-Interpretation for Responsible AI: A Hermeneutic Perspectivecited by 0
- 2026Human-AI Co-Interpretation for Responsible AI: A Hermeneutic Perspective2 Aug 2026
- 2026PRCCF: A Persona-guided Retrieval and Causal-aware Cognitive Filtering Framework for Emotional Support Conversation2 Apr 2026
- 2025UltraRAG: A Modular and Automated Toolkit for Adaptive Retrieval-Augmented Generation31 Mar 2025
- 2025Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models26 Feb 2025
- 2024Accelerating Retrieval-Augmented Generation14 Dec 2024
- 2024VisDoM: Multi-Document QA with Visually Rich Elements Using Multimodal Retrieval-Augmented Generation14 Dec 2024
- 2024Disentangling Memory and Reasoning Ability in Large Language Models20 Nov 2024
- 2024PrefRAG: Preference-Driven Multi-Source Retrieval Augmented Generation1 Nov 2024
- 2024A Stack-Propagation Framework for Low-Resource Personalized Dialogue Generation26 Oct 2024
- 2024RAG-DDR: Optimizing Retrieval-Augmented Generation Using Differentiable Data Rewards17 Oct 2024
- 2024VeraCT Scan: Retrieval-Augmented Fake News Detection with Justifiable Reasoning12 Jun 2024
- 2024XL-HeadTags: Leveraging Multimodal Retrieval Augmentation for the Multilingual Generation of News Headlines and Tags6 Jun 2024
37 more
- 2024Spiral of Silence: How is Large Language Model Killing Information Retrieval? -- A Case Study on Open Domain Question Answering16 Apr 2024
- 2024Towards Robustness of Text-to-Visualization Translation against Lexical and Phrasal Variability10 Apr 2024
- 2024Dynamic Demonstration Retrieval and Cognitive Understanding for Emotional Support Conversation3 Apr 2024
- 2024Towards a Robust Retrieval-Based Summarization System29 Mar 2024
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Survey29 Feb 2024
- 2024Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented Generation28 Feb 2024
- 2024Retrieval is Accurate Generation27 Feb 2024
- 2024Mafin: Enhancing Black-Box Embeddings with Model Augmented Fine-Tuning19 Feb 2024
- 2023Personalized Large Language Model Assistant with Evolving Conditional Memory22 Dec 2023
- 2023Diversify Question Generation with Retrieval-Augmented Style Transfer23 Oct 2023
- 2023Benchmarking Large Language Models in Retrieval-Augmented Generation4 Sep 2023
- 2023Copy Is All You Need13 Jul 2023
- 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory3 May 2023
- 2023Retrieving Multimodal Information for Augmented Generation: A Survey20 Mar 2023
- 2022Mind the Knowledge Gap: A Survey of Knowledge-enhanced Dialogue Systems19 Dec 2022
- 2022ConReader: Exploring Implicit Relations in Contracts for Contract Clause Extraction17 Oct 2022
- 2022AARGH! End-to-end Retrieval-Generation for Task-Oriented Dialog8 Sep 2022
- 2022PCC: Paraphrasing with Bottom-k Sampling and Cyclic Learning for Curriculum Data Augmentation17 Aug 2022
- 2022DISK: Domain-constrained Instance Sketch for Math Word Problem Generation10 Apr 2022
- 2022Seamlessly Integrating Factual Information and Social Content with Persuasive Dialogue15 Mar 2022
- 2022Recent Advances in Neural Text Generation: A Task-Agnostic Survey6 Mar 2022
- 2022A Survey on Retrieval-Augmented Text Generation2 Feb 2022
- 2022Pan More Gold from the Sand: Refining Open-domain Dialogue Training with Noisy Self-Retrieval Generation27 Jan 2022
- 2021Understanding and Improving the Exemplar-based Generation for Open-domain Conversation13 Dec 2021
- 2021Partner Personas Generation for Diverse Dialogue Generation27 Nov 2021
- 2021EmpBot: A T5-based Empathetic Chatbot focusing on Sentiments30 Oct 2021
- 2021Advances in Multi-turn Dialogue Comprehension: A Survey11 Oct 2021
- 2021Transferable Persona-Grounded Dialogues via Grounded Minimal Edits16 Sep 2021
- 2021Smoothing Dialogue States for Open Conversational Machine Reading28 Aug 2021
- 2021Exemplars-guided Empathetic Response Generation Controlled by the Elements of Human Communication22 Jun 2021
- 2021Neural Machine Translation with Monolingual Translation Memory24 May 2021
- 2021Towards Standard Criteria for human evaluation of Chatbots: A Survey24 May 2021
- 2021RetGen: A Joint framework for Retrieval and Grounded Text Generation Modeling14 May 2021
- 2021IGA : An Intent-Guided Authoring Assistant14 Apr 2021
- 2021Sketch and Customize: A Counterfactual Story Generator2 Apr 2021
- 2021Advances in Multi-turn Dialogue Comprehension: A Survey4 Mar 2021
- 2021What Makes Good In-Context Examples for GPT-3?17 Jan 2021
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
- 2023Benchmarking Large Language Models in Retrieval-Augmented Generationcited by 307
- 2022A Survey on Retrieval-Augmented Text Generationcited by 157
- 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memorycited by 103
- 2024VisDoM: Multi-Document QA with Visually Rich Elements Using Multimodal Retrieval-Augmented Generationcited by 40
- 2024RAG-DDR: Optimizing Retrieval-Augmented Generation Using Differentiable Data Rewardscited by 33
- 2024Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented Generationcited by 19
- 2024Accelerating Retrieval-Augmented Generationcited by 14
- 2023Diversify Question Generation with Retrieval-Augmented Style Transfercited by 10
- 2025Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Modelscited by 8
- 2025UltraRAG: A Modular and Automated Toolkit for Adaptive Retrieval-Augmented Generationcited by 6
- 2024Towards a Robust Retrieval-Based Summarization Systemcited by 5
12 most cited of 15 All 15 (JSON)
- 2025UltraRAG: A Modular and Automated Toolkit for Adaptive Retrieval-Augmented Generation31 Mar 2025
- 2025Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models26 Feb 2025
- 2024Accelerating Retrieval-Augmented Generation14 Dec 2024
- 2024VisDoM: Multi-Document QA with Visually Rich Elements Using Multimodal Retrieval-Augmented Generation14 Dec 2024
- 2024PrefRAG: Preference-Driven Multi-Source Retrieval Augmented Generation1 Nov 2024
- 2024RAG-DDR: Optimizing Retrieval-Augmented Generation Using Differentiable Data Rewards17 Oct 2024
- 2024Spiral of Silence: How is Large Language Model Killing Information Retrieval? -- A Case Study on Open Domain Question Answering16 Apr 2024
- 2024Towards a Robust Retrieval-Based Summarization System29 Mar 2024
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Survey29 Feb 2024
- 2024Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented Generation28 Feb 2024
- 2024Mafin: Enhancing Black-Box Embeddings with Model Augmented Fine-Tuning19 Feb 2024
- 2023Diversify Question Generation with Retrieval-Augmented Style Transfer23 Oct 2023
12 newest of 15 All 15 (JSON)
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
- 2023Retrieving Multimodal Information for Augmented Generation: A Surveycited by 84
- 2021Neural Machine Translation with Monolingual Translation Memorycited by 61
- 2023Copy Is All You Needcited by 25
- 2023Personalized Large Language Model Assistant with Evolving Conditional Memorycited by 24
- 2022Recent Advances in Neural Text Generation: A Task-Agnostic Surveycited by 14
- 2022PCC: Paraphrasing with Bottom-k Sampling and Cyclic Learning for Curriculum Data Augmentationcited by 14
- 2021Advances in Multi-turn Dialogue Comprehension: A Surveycited by 12
- 2021IGA : An Intent-Guided Authoring Assistantcited by 12
- 2022Seamlessly Integrating Factual Information and Social Content with Persuasive Dialoguecited by 11
- 2021Transferable Persona-Grounded Dialogues via Grounded Minimal Editscited by 10
- 2024Retrieval is Accurate Generationcited by 10
12 most cited of 32 All 32 (JSON)
- 2026Human-AI Co-Interpretation for Responsible AI: A Hermeneutic Perspective2 Aug 2026
- 2026PRCCF: A Persona-guided Retrieval and Causal-aware Cognitive Filtering Framework for Emotional Support Conversation2 Apr 2026
- 2024A Stack-Propagation Framework for Low-Resource Personalized Dialogue Generation26 Oct 2024
- 2024VeraCT Scan: Retrieval-Augmented Fake News Detection with Justifiable Reasoning12 Jun 2024
- 2024XL-HeadTags: Leveraging Multimodal Retrieval Augmentation for the Multilingual Generation of News Headlines and Tags6 Jun 2024
- 2024Towards Robustness of Text-to-Visualization Translation against Lexical and Phrasal Variability10 Apr 2024
- 2024Dynamic Demonstration Retrieval and Cognitive Understanding for Emotional Support Conversation3 Apr 2024
- 2024Retrieval is Accurate Generation27 Feb 2024
- 2023Personalized Large Language Model Assistant with Evolving Conditional Memory22 Dec 2023
- 2023Copy Is All You Need13 Jul 2023
- 2023Retrieving Multimodal Information for Augmented Generation: A Survey20 Mar 2023
- 2022Mind the Knowledge Gap: A Survey of Knowledge-enhanced Dialogue Systems19 Dec 2022
12 newest of 32 All 32 (JSON)