mlsanityData to 7 Oct 2026

Internet-Augmented Dialogue Generation

arXiv 2107.07566 ↗First posted 15 Jul 2021cs.AI cs.CLcited by 217

Not on the map. Why?

Cited by 23 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

The largest store of continually updating knowledge on our planet can be accessed via internet search. In this work we study giving access to this information to conversational agents. Large language models, even though they store an impressive amount of knowledge within their weights, are known to hallucinate facts when generating dialogue (Shuster et al., 2021); moreover, those facts are frozen in time at the point of model training. In contrast, we propose an approach that learns to generate an internet search query based on the context, and then conditions on the search results to finally generate a response, a method that can employ up-to-the-minute relevant information. We train and evaluate such models on a newly collected dataset of human-human conversations whereby one of the speakers is given access to internet search during knowledgedriven discussions in order to ground their responses. We find that search-query based access of the internet in conversation provides superior performance compared to existing approaches that either use no augmentation or FAISS-based retrieval (Lewis et al., 2020).

Key facts. Cited by 217 papers in the map (data through 7 Oct 2026). Builds on 34 of its 45 references that are in the map. First posted on arXiv 15 Jul 2021.

Builds on

34 of 45 references.

References · 34

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  6. 2016Pointer Sentinel Mixture Modelscited by 2,992
  7. 2017Billion-scale similarity search with GPUscited by 2,477
  8. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  9. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  10. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  11. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  12. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 788
22 more
  1. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  2. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
  3. 2020Recipes for building an open-domain chatbotcited by 593
  4. 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 571
  5. 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 544
  6. 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
  7. 2020Towards a Human-like Open-Domain Chatbotcited by 467
  8. 2014Memory Networkscited by 354
  9. 2020The Pushshift Reddit Datasetcited by 289
  10. 2021Mind the Gap: Assessing Temporal Generalization in Neural Language Modelscited by 226
  11. 2020Nearest Neighbor Machine Translationcited by 209
  12. 2020Recipes for Safety in Open-domain Chatbotscited by 168
  13. 2019Challenges in Building Intelligent Open-domain Dialog Systemscited by 147
  14. 2017A Knowledge-Grounded Neural Conversation Modelcited by 136
  15. 2020Knowledge-Grounded Dialogue Generation with Pre-trained Language Modelscited by 107
  16. 2018A Dataset for Document Grounded Conversationscited by 104
  17. 2021Adaptive Semiparametric Language Modelscited by 83
  18. 2020Sequential Latent Knowledge Selection for Knowledge-Grounded Dialoguecited by 82
  19. 2016Improving Neural Language Models with a Continuous Cachecited by 81
  20. 2020Generating Fact Checking Briefscited by 50
  21. 2017Task-Oriented Query Reformulation with Reinforcement Learningcited by 39
  22. 2020A Corpus of Controlled Opinionated and Knowledgeable Movie Discussions for Training Neural Conversation Modelscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 15; 2022: 55; 2023: 74; 2024: 49; 2025: 18; 2026: 6.

217 papers.

Sort:

By area:

  1. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  2. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  3. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  4. 2021Improving language models by retrieving from trillions of tokenscited by 1,278
  5. 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
  6. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  7. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
  8. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
  9. 2023A Comprehensive Overview of Large Language Modelscited by 639
  10. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 450
  11. 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Modelscited by 424
  12. 2023Augmented Language Models: a Surveycited by 398
38 more
  1. 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 383
  2. 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 352
  3. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
  4. 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 338
  5. 2022Teaching language models to support answers with verified quotescited by 290
  6. 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 247
  7. 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 245
  8. 2021Sustainable AI: Environmental Implications, Challenges and Opportunitiescited by 242
  9. 2022OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalizationcited by 235
  10. 2024Tool Learning with Large Language Models: A Surveycited by 221
  11. 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 197
  12. 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 193
  13. 2024Corrective Retrieval Augmented Generationcited by 187
  14. 2021Towards Continual Knowledge Learning of Language Modelscited by 172
  15. 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
  16. 2023Foundation Models for Decision Making: Problems, Methods, and Opportunitiescited by 160
  17. 2022A Survey on Retrieval-Augmented Text Generationcited by 157
  18. 2022Rethinking with Retrieval: Faithful Large Language Model Inferencecited by 145
  19. 2023Physics of Language Models: Part 3.2, Knowledge Manipulationcited by 142
  20. 2023Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Surveycited by 134
  21. 2022Internet-augmented language models through few-shot prompting for open-domain question answeringcited by 131
  22. 2022Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answeringcited by 126
  23. 2022Generative Spoken Dialogue Language Modelingcited by 125
  24. 2022Autoregressive Search Engines: Generating Substrings as Document Identifierscited by 112
  25. 2022ProsocialDialog: A Prosocial Backbone for Conversational Agentscited by 109
  26. 2022Language Models that Seek for Knowledge: Modular Search & Generation for Dialogue and Prompt Completioncited by 102
  27. 2023MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversationcited by 94
  28. 2023CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Modelscited by 90
  29. 2024From Matching to Generation: A Survey on Generative Information Retrievalcited by 89
  30. 2021Data Augmentation Approaches in Natural Language Processing: A Surveycited by 82
  31. 2023Boosting Language Models Reasoning with Chain-of-Knowledge Promptingcited by 77
  32. 2022RankGen: Improving Text Generation with Large Ranking Modelscited by 72
  33. 2023Automatic Evaluation of Attribution by Large Language Modelscited by 70
  34. 2023Making Language Models Better Tool Learners with Execution Feedbackcited by 69
  35. 2021CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learningcited by 68
  36. 2025Nemotron-Research-Tool-N1: Exploring Tool-Using Language Models with Reinforced Reasoningcited by 67
  37. 2023Tool Documentation Enables Zero-Shot Tool-Usage with Large Language Modelscited by 66
  38. 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systemscited by 64

50 most cited of 217 All 217 (JSON)