Retrieve and Refine: Improved Sequence Generation Models For Dialogue
Not on the map. Why?
Abstract (arXiv)
Sequence generation models for dialogue are known to have several problems: they tend to produce short, generic sentences that are uninformative and unengaging. Retrieval models on the other hand can surface interesting responses, but are restricted to the given retrieval set leading to erroneous replies that cannot be tuned to the specific context. In this work we develop a model that combines the two approaches to avoid both their deficiencies: first retrieve a response and then refine it -- the final sequence generator treating the retrieval as additional context. We show on the recent CONVAI2 challenge task our approach produces responses superior to both standard retrieval and generation models in human evaluations.
Key facts. Cited by 82 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 28; 2022: 18; 2023: 16; 2024: 16; 2025: 2; 2026: 1.
82 papers.
Sort:
By area:
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
- 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 160
- 2022A Survey on Retrieval-Augmented Text Generationcited by 157
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memorycited by 103
- 2023Retrieving Multimodal Information for Augmented Generation: A Surveycited by 84
- 2021Improving Named Entity Recognition by External Context Retrieving and Cooperative Learningcited by 76
- 2023Leveraging Large Language Models in Conversational Recommender Systemscited by 63
- 2021Neural Machine Translation with Monolingual Translation Memorycited by 61
- 2023kNN Prompting: Beyond-Context Learning with Calibration-Free Nearest Neighbor Inferencecited by 47
- 2024AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Frameworkcited by 47
38 more
- 2021Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translationcited by 44
- 2024Goldfish: Vision-Language Understanding of Arbitrarily Long Videoscited by 38
- 2021Fast Nearest Neighbor Machine Translationcited by 37
- 2021Controllable Semantic Parsing via Retrieval Augmentationcited by 35
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generationcited by 34
- 2023WebBrain: Learning to Generate Factually Correct Articles for Queries by Grounding on Large Web Corpuscited by 29
- 2024Stochastic RAG: End-to-End Retrieval-Augmented Generation through Expected Utility Maximizationcited by 29
- 2023Retrieval-augmented Image Captioningcited by 28
- 2022Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Modelscited by 26
- 2023Copy Is All You Needcited by 25
- 2024Jill Watson: A Virtual Teaching Assistant powered by ChatGPTcited by 24
- 2021Hi, my name is Martha: Using names to measure and mitigate bias in generative dialogue modelscited by 23
- 2022CORE: A Retrieve-then-Edit Framework for Counterfactual Data Generationcited by 23
- 2024Towards a Search Engine for Machines: Unified Ranking for Multiple Retrieval-Augmented Large Language Modelscited by 23
- 2021Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systemscited by 16
- 2022Retrieval-Augmented Multilingual Keyphrase Generation with Retriever-Generator Iterative Trainingcited by 16
- 2021RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsingcited by 15
- 2021Unsupervised Enrichment of Persona-grounded Dialog with Background Storiescited by 14
- 2024Accelerating Retrieval-Augmented Generationcited by 14
- 2021Advances in Multi-turn Dialogue Comprehension: A Surveycited by 12
- 2022Symbolic music generation conditioned on continuous-valued emotionscited by 12
- 2022Seamlessly Integrating Factual Information and Social Content with Persuasive Dialoguecited by 11
- 2022Domain-Specific NER via Retrieving Correlated Samplescited by 11
- 2021Transferable Persona-Grounded Dialogues via Grounded Minimal Editscited by 10
- 2024Retrieval is Accurate Generationcited by 10
- 2021Exemplars-guided Empathetic Response Generation Controlled by the Elements of Human Communicationcited by 9
- 2021Comparative Explanations of Recommendationscited by 8
- 2021Faster Nearest Neighbor Machine Translationcited by 8
- 2022AARGH! End-to-end Retrieval-Generation for Task-Oriented Dialogcited by 8
- 2022kNN-NER: Named Entity Recognition with Nearest Neighbor Searchcited by 6
- 2023SYNDICOM: Improving Conversational Commonsense with Error-Injection and Natural Language Feedbackcited by 6
- 2021EmpBot: A T5-based Empathetic Chatbot focusing on Sentimentscited by 5
- 2022MME-CRS: Multi-Metric Evaluation Based on Correlation Re-Scaling for Evaluating Open-Domain Dialoguecited by 5
- 2022Every picture tells a story: Image-grounded controllable stylistic story generationcited by 5
- 2022Knowledge-grounded Dialog State Trackingcited by 5
- 2022PoKE: Prior Knowledge Enhanced Emotional Support Conversation with Latent Variablecited by 5
- 2023TAPIR: Learning Adaptive Revision for Incremental Natural Language Understanding with a Two-Pass Modelcited by 5
- 2024Dynamic Demonstration Retrieval and Cognitive Understanding for Emotional Support Conversationcited by 5
50 most cited of 82 All 82 (JSON)
- 2026PRCCF: A Persona-guided Retrieval and Causal-aware Cognitive Filtering Framework for Emotional Support Conversation2 Apr 2026
- 2025We Argue to Agree: Towards Personality-Driven Argumentation-Based Negotiation Dialogue Systems for Tourism14 Sep 2025
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generation11 Mar 2025
- 2024Accelerating Retrieval-Augmented Generation14 Dec 2024
- 2024Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey14 Nov 2024
- 2024Understanding the Role of LLMs in Multimodal Evaluation Benchmarks16 Oct 2024
- 2024Human Speech Perception in Noise: Can Large Language Models Paraphrase to Improve It?7 Aug 2024
- 2024Goldfish: Vision-Language Understanding of Arbitrarily Long Videos17 Jul 2024
- 2024Jill Watson: A Virtual Teaching Assistant powered by ChatGPT17 May 2024
- 2024Stochastic RAG: End-to-End Retrieval-Augmented Generation through Expected Utility Maximization5 May 2024
- 2024Towards a Search Engine for Machines: Unified Ranking for Multiple Retrieval-Augmented Large Language Models30 Apr 2024
- 2024Enhancing Pre-Trained Generative Language Models with Question Attended Span Extraction on Machine Reading Comprehension27 Apr 2024
38 more
- 2024Graph Integrated Language Transformers for Next Action Prediction in Complex Phone Calls11 Apr 2024
- 2024Dynamic Demonstration Retrieval and Cognitive Understanding for Emotional Support Conversation3 Apr 2024
- 2024AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Framework19 Mar 2024
- 2024WIKIGENBENCH: Exploring Full-length Wikipedia Generation under Real-World Scenario28 Feb 2024
- 2024Retrieval is Accurate Generation27 Feb 2024
- 2024QASE Enhanced PLMs: Improved Control in Text Generation for MRC26 Feb 2024
- 2024Harmonizing Code-mixed Conversations: Personality-assisted Code-mixed Response Generation in Dialogues18 Jan 2024
- 2023Towards Faster k-Nearest-Neighbor Machine Translation12 Dec 2023
- 2023Control in Hybrid Chatbots20 Nov 2023
- 2023Retrieval-Augmented Neural Response Generation Using Logical Reasoning and Relevance Scoring20 Oct 2023
- 2023SYNDICOM: Improving Conversational Commonsense with Error-Injection and Natural Language Feedback18 Sep 2023
- 2023RSpell: Retrieval-augmented Framework for Domain Adaptive Chinese Spelling Check16 Aug 2023
- 2023Towards a Neural Era in Dialogue Management for Collaboration: A Literature Survey18 Jul 2023
- 2023Copy Is All You Need13 Jul 2023
- 2023Learning Descriptive Image Captioning via Semipermeable Maximum Likelihood Estimation23 Jun 2023
- 2023TAPIR: Learning Adaptive Revision for Incremental Natural Language Understanding with a Two-Pass Model18 May 2023
- 2023Leveraging Large Language Models in Conversational Recommender Systems13 May 2023
- 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory3 May 2023
- 2023Speaker Profiling in Multiparty Conversations18 Apr 2023
- 2023WebBrain: Learning to Generate Factually Correct Articles for Queries by Grounding on Large Web Corpus10 Apr 2023
- 2023kNN Prompting: Beyond-Context Learning with Calibration-Free Nearest Neighbor Inference24 Mar 2023
- 2023Retrieving Multimodal Information for Augmented Generation: A Survey20 Mar 2023
- 2023Retrieval-augmented Image Captioning16 Feb 2023
- 2022Error-Robust Retrieval for Chinese Spelling Check15 Nov 2022
- 2022Reranking Overgenerated Responses for End-to-End Task-Oriented Dialogue Systems7 Nov 2022
- 2022PoKE: Prior Knowledge Enhanced Emotional Support Conversation with Latent Variable23 Oct 2022
- 2022Knowledge-grounded Dialog State Tracking13 Oct 2022
- 2022CORE: A Retrieve-then-Edit Framework for Counterfactual Data Generation10 Oct 2022
- 2022AARGH! End-to-end Retrieval-Generation for Task-Oriented Dialog8 Sep 2022
- 2022Every picture tells a story: Image-grounded controllable stylistic story generation4 Sep 2022
- 2022Domain-Specific NER via Retrieving Correlated Samples27 Aug 2022
- 2022MME-CRS: Multi-Metric Evaluation Based on Correlation Re-Scaling for Evaluating Open-Domain Dialogue19 Jun 2022
- 2022Grounding in social media: An approach to building a chit-chat dialogue model12 Jun 2022
- 2022Retrieval-Augmented Multilingual Keyphrase Generation with Retriever-Generator Iterative Training21 May 2022
- 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Dataset18 May 2022
- 2022Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Models30 Apr 2022
- 2022kNN-NER: Named Entity Recognition with Nearest Neighbor Search31 Mar 2022
- 2022Symbolic music generation conditioned on continuous-valued emotions30 Mar 2022
50 newest of 82 All 82 (JSON)
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022A Survey on Retrieval-Augmented Text Generationcited by 157
- 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memorycited by 103
- 2024AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Frameworkcited by 47
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generationcited by 34
- 2024Stochastic RAG: End-to-End Retrieval-Augmented Generation through Expected Utility Maximizationcited by 29
- 2023Retrieval-augmented Image Captioningcited by 28
- 2024Towards a Search Engine for Machines: Unified Ranking for Multiple Retrieval-Augmented Large Language Modelscited by 23
- 2022Retrieval-Augmented Multilingual Keyphrase Generation with Retriever-Generator Iterative Trainingcited by 16
- 2021RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsingcited by 15
- 2024Accelerating Retrieval-Augmented Generationcited by 14
- 2022kNN-NER: Named Entity Recognition with Nearest Neighbor Searchcited by 6
12 most cited of 13 All 13 (JSON)
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generation11 Mar 2025
- 2024Accelerating Retrieval-Augmented Generation14 Dec 2024
- 2024Stochastic RAG: End-to-End Retrieval-Augmented Generation through Expected Utility Maximization5 May 2024
- 2024Towards a Search Engine for Machines: Unified Ranking for Multiple Retrieval-Augmented Large Language Models30 Apr 2024
- 2024AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Framework19 Mar 2024
- 2023RSpell: Retrieval-augmented Framework for Domain Adaptive Chinese Spelling Check16 Aug 2023
- 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory3 May 2023
- 2023Retrieval-augmented Image Captioning16 Feb 2023
- 2022Retrieval-Augmented Multilingual Keyphrase Generation with Retriever-Generator Iterative Training21 May 2022
- 2022kNN-NER: Named Entity Recognition with Nearest Neighbor Search31 Mar 2022
- 2022A Survey on Retrieval-Augmented Text Generation2 Feb 2022
- 2021RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsing21 Sep 2021
12 newest of 13 All 13 (JSON)
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
- 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 160
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2023Retrieving Multimodal Information for Augmented Generation: A Surveycited by 84
- 2021Improving Named Entity Recognition by External Context Retrieving and Cooperative Learningcited by 76
- 2023Leveraging Large Language Models in Conversational Recommender Systemscited by 63
- 2021Neural Machine Translation with Monolingual Translation Memorycited by 61
- 2023kNN Prompting: Beyond-Context Learning with Calibration-Free Nearest Neighbor Inferencecited by 47
- 2021Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translationcited by 44
- 2024Goldfish: Vision-Language Understanding of Arbitrarily Long Videoscited by 38
- 2021Fast Nearest Neighbor Machine Translationcited by 37
- 2021Controllable Semantic Parsing via Retrieval Augmentationcited by 35
12 most cited of 66 All 66 (JSON)
- 2026PRCCF: A Persona-guided Retrieval and Causal-aware Cognitive Filtering Framework for Emotional Support Conversation2 Apr 2026
- 2025We Argue to Agree: Towards Personality-Driven Argumentation-Based Negotiation Dialogue Systems for Tourism14 Sep 2025
- 2024Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey14 Nov 2024
- 2024Human Speech Perception in Noise: Can Large Language Models Paraphrase to Improve It?7 Aug 2024
- 2024Goldfish: Vision-Language Understanding of Arbitrarily Long Videos17 Jul 2024
- 2024Jill Watson: A Virtual Teaching Assistant powered by ChatGPT17 May 2024
- 2024Enhancing Pre-Trained Generative Language Models with Question Attended Span Extraction on Machine Reading Comprehension27 Apr 2024
- 2024Graph Integrated Language Transformers for Next Action Prediction in Complex Phone Calls11 Apr 2024
- 2024Dynamic Demonstration Retrieval and Cognitive Understanding for Emotional Support Conversation3 Apr 2024
- 2024WIKIGENBENCH: Exploring Full-length Wikipedia Generation under Real-World Scenario28 Feb 2024
- 2024Retrieval is Accurate Generation27 Feb 2024
- 2024QASE Enhanced PLMs: Improved Control in Text Generation for MRC26 Feb 2024
12 newest of 66 All 66 (JSON)