mlsanityData to 7 Oct 2026

Key-Value Memory Networks for Directly Reading Documents

arXiv 1606.03126 ↗First posted 9 Jun 2016cs.CLcited by 223

Not on the map. Why?

Cited by 27 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Directly reading documents and being able to answer questions from them is an unsolved challenge. To avoid its inherent difficulty, question answering (QA) has been directed towards using Knowledge Bases (KBs) instead, which has proven effective. Unfortunately KBs often suffer from being too restrictive, as the schema cannot support certain types of answers, and too sparse, e.g. Wikipedia contains much more information than Freebase. In this work we introduce a new method, Key-Value Memory Networks, that makes reading documents more viable by utilizing different encodings in the addressing and output stages of the memory read operation. To compare using KBs, information extraction or Wikipedia documents directly in a single framework we construct an analysis tool, WikiMovies, a QA dataset that contains raw text alongside a preprocessed KB, in the domain of movies. Our method reduces the gap between all three settings. It also achieves state-of-the-art results on the existing WikiQA benchmark.

Key facts. Cited by 223 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Jun 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2020: 1; 2021: 67; 2022: 45; 2023: 37; 2024: 31; 2025: 20; 2026: 22.

223 papers.

Sort:

By area:

  1. 2023A Survey of Large Language Modelscited by 2,537
  2. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  3. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
  4. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
  5. 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
  6. 20243D Reconstruction with Spatial Memorycited by 269
  7. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
  8. 2024InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memorycited by 192
  9. 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
  10. 2023Walking Down the Memory Maze: Beyond Context Limit through Interactive Readingcited by 129
  11. 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoningcited by 128
  12. 2021Generative Adversarial Transformerscited by 120
38 more
  1. 2021Advances and Challenges in Conversational Recommender Systems: A Surveycited by 118
  2. 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 100
  3. 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graphcited by 100
  4. 2021Question Answering Over Temporal Knowledge Graphscited by 99
  5. 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
  6. 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
  7. 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
  8. 2024KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graphcited by 90
  9. 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
  10. 2021Divide-and-Assemble: Learning Block-wise Memory for Unsupervised Anomaly Detectioncited by 83
  11. 2021A Survey on Complex Knowledge Base Question Answering: Methods, Challenges and Solutionscited by 77
  12. 2022Knowledge Tracing: A Surveycited by 76
  13. 2022Sequence-to-Sequence Knowledge Graph Completion and Question Answeringcited by 75
  14. 2023Few-shot In-context Learning for Knowledge Base Question Answeringcited by 74
  15. 2021Hierarchical Memory Matching Network for Video Object Segmentationcited by 72
  16. 2021Radiology Report Generation with a Learned Knowledge Base and Multi-modal Alignmentcited by 71
  17. 2022Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answeringcited by 71
  18. 2022SyncTalkFace: Talking Face Generation with Precise Lip-Syncing via Audio-Lip Memorycited by 65
  19. 2021TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graphcited by 60
  20. 2024Larimar: Large Language Models with Episodic Memory Controlcited by 53
  21. 2021Adversarial Text-to-Image Synthesis: A Reviewcited by 52
  22. 2021Complex Knowledge Base Question Answering: A Surveycited by 52
  23. 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
  24. 2021HVPR: Hybrid Voxel-Point Representation for Single-stage 3D Object Detectioncited by 47
  25. 2021Auto-Encoding Knowledge Graph for Unsupervised Medical Report Generationcited by 47
  26. 2022The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns via Spotlights of Attentioncited by 45
  27. 2023ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Modelscited by 44
  28. 2021Towards Robust and Adaptive Motion Forecasting: A Causal Representation Perspectivecited by 40
  29. 2021One Chatbot Per Person: Creating Personalized Chatbots based on Implicit User Profilescited by 39
  30. 2022Distinguishing Homophenes Using Multi-Head Visual-Audio Memory for Lip Readingcited by 39
  31. 2024FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answeringcited by 38
  32. 2021Video-based Person Re-identification with Spatial and Temporal Memory Networkscited by 35
  33. 2021Program Transfer for Answering Complex Questions over Knowledge Basescited by 34
  34. 2021Conversational Question Answering: A Surveycited by 31
  35. 2022Knowledge Base Question Answering by Case-based Reasoning over Subgraphscited by 31
  36. 2022Achieving Reliable Human Assessment of Open-Domain Dialogue Systemscited by 31
  37. 2023A Large Language Model Enhanced Conversational Recommender Systemcited by 31
  38. 2021CodeQA: A Question Answering Dataset for Source Code Comprehensioncited by 30

50 most cited of 223 All 223 (JSON)