Memory Networks
Not on the map. Why?
Abstract (arXiv)
We describe a new class of learning models called memory networks. Memory networks reason with inference components combined with a long-term memory component; they learn how to use these jointly. The long-term memory can be read and written to, with the goal of using it for prediction. We investigate these models in the context of question answering (QA) where the long-term memory effectively acts as a (dynamic) knowledge base, and the output is a textual response. We evaluate them on a large-scale QA task, and a smaller, but more complex, toy task generated from a simulated world. In the latter, we show the reasoning power of such models by chaining multiple supporting sentences to answer questions that require understanding the intension of verbs.
Key facts. Cited by 354 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Oct 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 2; 2021: 80; 2022: 82; 2023: 48; 2024: 41; 2025: 45; 2026: 56.
354 papers.
Sort:
By area:
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
- 2022Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasetscited by 599
- 2023Cognitive Architectures for Language Agentscited by 422
- 2024Titans: Learning to Memorize at Test Timecited by 303
- 20243D Reconstruction with Spatial Memorycited by 269
- 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 267
- 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
- 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 235
38 more
- 2021Internet-Augmented Dialogue Generationcited by 217
- 2022Neural Networks and the Chomsky Hierarchycited by 214
- 2024InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memorycited by 192
- 2022Scalable Adaptive Computation for Iterative Generationcited by 190
- 2022Cross-modal Memory Networks for Radiology Report Generationcited by 183
- 2022A Review on Language Models as Knowledge Basescited by 156
- 2023Towards Better Dynamic Graph Learning: New Architecture and Unified Librarycited by 154
- 2023Birth of a Transformer: A Memory Viewpointcited by 154
- 2021Model Adaptation: Historical Contrastive Learning for Unsupervised Domain Adaptation without Source Datacited by 152
- 2025Dynamic Cheatsheet: Test-Time Learning with Adaptive Memorycited by 146
- 2021AGQA: A Benchmark for Compositional Spatio-Temporal Reasoningcited by 120
- 2022MeMOT: Multi-Object Tracking with Memorycited by 113
- 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 109
- 2021MeGA-CDA: Memory Guided Attention for Category-Aware Unsupervised Domain Adaptive Object Detectioncited by 106
- 2023Scaling Transformer to 1M tokens and beyond with RMTcited by 97
- 2021Structured Scene Memory for Vision-Language Navigationcited by 95
- 2022Constrained Few-shot Class-incremental Learningcited by 93
- 2021Do Long-Range Language Models Actually Use Long-Range Context?cited by 92
- 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
- 2024MEMORYLLM: Towards Self-Updatable Large Language Modelscited by 89
- 2021You Only Learn One Representation: Unified Network for Multiple Taskscited by 86
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
- 2023System 2 Attention (is something you might need too)cited by 85
- 2021Divide-and-Assemble: Learning Block-wise Memory for Unsupervised Anomaly Detectioncited by 83
- 2021Why Do Pretrained Language Models Help in Downstream Tasks? An Analysis of Head and Prompt Tuningcited by 82
- 2024From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMscited by 77
- 2023HIPTrack: Visual Tracking with Historical Promptscited by 71
- 2023Large Language Models can Learn Rulescited by 66
- 2022SyncTalkFace: Talking Face Generation with Precise Lip-Syncing via Audio-Lip Memorycited by 65
- 2023Leveraging Large Language Models in Conversational Recommender Systemscited by 63
- 2022Keep Me Updated! Memory Management in Long-term Conversationscited by 62
- 2023Implicit Identity Representation Conditioned Memory Compensation Network for Talking Head video Generationcited by 61
- 2022General-purpose, long-context autoregressive modeling with Perceiver ARcited by 60
- 2026Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontierscited by 60
- 2023Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generationcited by 55
- 2024Larimar: Large Language Models with Episodic Memory Controlcited by 53
- 2024Contextual Position Encoding: Learning to Count What's Importantcited by 53
50 most cited of 354 All 354 (JSON)
- 2026Mapping the RAG Landscape: A Four Axis Taxonomy of Efficiency, Defense, Interactivity, and Reasoning1 Oct 2026
- 2026Learning Under Forgetting: Statistical Support-Selective Retention in Stochastic Training Dynamics30 Sep 2026
- 2026Contract Memory Compiler: Resolve, Then Traverse26 Sep 2026
- 2026Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence25 Sep 2026
- 2026CAVE-Mem: Boundary-Aware Experience Validation for Memory Search23 Sep 2026
- 2026Persistent Recurrent Memory Between Transformer Layers - Improves Language Model Generalization15 Sep 2026
- 2026MoME: Mixture-of-Memory Embeddings for Context-Aware Sparse Lookup14 Sep 2026
- 2026Does Video Memory Use What It Retrieves? A Causal Audit of Memory Specificity10 Sep 2026
- 2026AutoConcept: Training-Free Concept-Guided Reranking for Metadata-Available Composed Image Retrieval1 Sep 2026
- 2026From Terminology to Diagrams: Visual-Instruction Generation for Scientific Diagram Understanding1 Sep 2026
- 2026Good Memory Has ECC: Evaluating the Memory of Vision-Language Models Beyond Accuracy31 Aug 2026
- 2026Metis: Memory Foundation Model29 Jul 2026
38 more
- 2026MEMORA: Embodied Action Memory from Egocentric Videos for Reasoning and Planning15 Jul 2026
- 2026MRMS: A Multi-Resolution Memory Substrate for Long-Lived AI Agents6 Jul 2026
- 2026ReContext: Recursive Evidence Replay as LLM Harness for Long-Context Reasoning2 Jul 2026
- 2026MIRTH: Mutual-Information Reasoning with Temporal Hubs for Vision-Language-Action Agents30 Jun 2026
- 2026BiDeMem: Bidirectional Degradation Memory for Explainable Image Restoration26 Jun 2026
- 2026The Hitchhiker's Guide to Agentic AI: From Foundations to Systems22 Jun 2026
- 2026Multi-Agent Transactive Memory18 Jun 2026
- 2026Repeated Shared Access Enables Grokking, but Edit Propagation Depends on an Addressable Memory17 Jun 2026
- 2026Parallel Causal Associative Fields: Gated Sparse Memory for Long-Context Language Modeling9 Jun 2026
- 2026RowNet: A Memory Transformer for Tabular Regression3 Jun 2026
- 2026ThoughtFold: Folding Reasoning Chains via Introspective Preference Learning2 Jun 2026
- 2026VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions26 May 2026
- 2026BatteryMFormer: Multi-level Learning for Battery Degradation Trajectory Forecasting26 May 2026
- 2026Incantation: Natural Language as the Action Interface for Multi-Entity Video World Models18 May 2026
- 2026Episodic-Semantic Memory Architecture for Long-Horizon Scientific Agents17 May 2026
- 2026DimMem: Dimensional Structuring for Efficient Long-Term Agent Memory15 May 2026
- 2026Exact Linear Attention13 May 2026
- 2026Does Engram Do Memory Retrieval in Autoregressive Image Generation?13 May 2026
- 2026Mela: Test-Time Memory Consolidation based on Transformation Hypothesis11 May 2026
- 2026The Memory Curse: How Expanded Recall Erodes Cooperative Intent in LLM Agents8 May 2026
- 2026TIDE: Every Layer Knows the Token Beneath the Context7 May 2026
- 2026FAAST: Forward-Only Associative Learning via Closed-Form Fast Weights for Test-Time Supervised Adaptation6 May 2026
- 2026Phionyx: A Deterministic AI Runtime Architecture with Structured State Management and Pre-Response Governance4 May 2026
- 2026Ask Only When Needed: Proactive Retrieval from Memory and Skills for Experience-Driven Lifelong Agents22 Apr 2026
- 2026Cram Less to Fit More: Training Data Pruning Improves Memorization of Facts9 Apr 2026
- 2026Care-Conditioned Neuromodulation for Autonomy-Preserving Supportive Dialogue Agents2 Apr 2026
- 2026The Coordinate System Problem in Persistent Structural Memory for Neural Architectures24 Mar 2026
- 2026MKA: Memory-Keyed Attention for Efficient Long-Context Reasoning21 Mar 2026
- 2026Models Designed to Forget: Machine Unlearning via Key Deletion16 Mar 2026
- 2026Tiny Autoregressive Recursive Models9 Mar 2026
- 2026Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers8 Mar 2026
- 2026Neural Paging: Learning Context Management Policies for Turing-Complete Agents11 Feb 2026
- 2026Predictive Associative Memory: Retrieval Beyond Similarity Through Temporal Co-occurrence11 Feb 2026
- 2026Stateless Yet Not Forgetful: Implicit Memory as a Hidden Channel in LLMs9 Feb 2026
- 2026Locas: Your Models are Principled Initializers of Locally-Supported Parametric Memories4 Feb 2026
- 2026Field-Theoretic Memory for AI Agents: Continuous Dynamics for Context Preservation31 Jan 2026
- 2026MemoryLLM: Plug-n-Play Interpretable Feed-Forward Memory for Transformers30 Jan 2026
- 2026MoVE: Mixture of Value Embeddings -- A New Axis for Scaling Parametric Memory in Autoregressive Models30 Jan 2026
50 newest of 354 All 354 (JSON)
- 2023Cognitive Architectures for Language Agentscited by 422
- 2024InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memorycited by 192
- 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 109
- 2026Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontierscited by 60
- 2025R2D2: Remembering, Replaying and Dynamic Decision Making with a Reflective Agentic Memorycited by 14
- 2026VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactionscited by 11
- 2026The Memory Curse: How Expanded Recall Erodes Cooperative Intent in LLM Agentscited by 10
- 2025WebATLAS: An LLM Agent with Experience-Driven Memory and Action Simulationcited by 6
- 2025Ella: Embodied Social Agents with Lifelong Memorycited by 4
- 2025Unifying Dynamic Tool Creation and Cross-Task Experience Sharing through Cognitive Memory Architecturecited by 4
- 2026CAST: Character-and-Scene Episodic Memory for Agentscited by 3
- 2026DimMem: Dimensional Structuring for Efficient Long-Term Agent Memorycited by 2
12 most cited of 17 All 17 (JSON)
- 2026Contract Memory Compiler: Resolve, Then Traverse26 Sep 2026
- 2026Multi-Agent Transactive Memory18 Jun 2026
- 2026VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions26 May 2026
- 2026Episodic-Semantic Memory Architecture for Long-Horizon Scientific Agents17 May 2026
- 2026DimMem: Dimensional Structuring for Efficient Long-Term Agent Memory15 May 2026
- 2026The Memory Curse: How Expanded Recall Erodes Cooperative Intent in LLM Agents8 May 2026
- 2026Care-Conditioned Neuromodulation for Autonomy-Preserving Supportive Dialogue Agents2 Apr 2026
- 2026Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers8 Mar 2026
- 2026Neural Paging: Learning Context Management Policies for Turing-Complete Agents11 Feb 2026
- 2026CAST: Character-and-Scene Episodic Memory for Agents14 Jan 2026
- 2025Unifying Dynamic Tool Creation and Cross-Task Experience Sharing through Cognitive Memory Architecture12 Dec 2025
- 2025WebATLAS: An LLM Agent with Experience-Driven Memory and Action Simulation26 Oct 2025
12 newest of 17 All 17 (JSON)
- 2024Titans: Learning to Memorize at Test Timecited by 303
- 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 235
- 2022Hypergraph Transformer: Weakly-supervised Multi-hop Reasoning for Knowledge-based Visual Question Answeringcited by 15
- 2023Case-Based Reasoning with Language Models for Classification of Logical Fallaciescited by 8
- 2026MKA: Memory-Keyed Attention for Efficient Long-Context Reasoningcited by 6
- 2026Metis: Memory Foundation Modelcited by 5
- 2025Beyond Memorization: Extending Reasoning Depth with Recurrence, Memory and Test-Time Compute Scalingcited by 4
- 2025Can Memory-Augmented Language Models Generalize on Reasoning-in-a-Haystack Tasks?cited by 2
- 2025Deciphering Trajectory-Aided LLM Reasoning: An Optimization Perspectivecited by 2
- 2025Attention as Binding: A Vector-Symbolic Perspective on Transformer Reasoningcited by 2
- 2026ReContext: Recursive Evidence Replay as LLM Harness for Long-Context Reasoningcited by 2
- 2024Composite Learning Units: Generalized Learning Beyond Parameter Updates to Transform LLMs into Adaptive Reasonerscited by 1
12 most cited of 15 All 15 (JSON)
- 2026Mapping the RAG Landscape: A Four Axis Taxonomy of Efficiency, Defense, Interactivity, and Reasoning1 Oct 2026
- 2026Metis: Memory Foundation Model29 Jul 2026
- 2026ReContext: Recursive Evidence Replay as LLM Harness for Long-Context Reasoning2 Jul 2026
- 2026The Hitchhiker's Guide to Agentic AI: From Foundations to Systems22 Jun 2026
- 2026ThoughtFold: Folding Reasoning Chains via Introspective Preference Learning2 Jun 2026
- 2026MKA: Memory-Keyed Attention for Efficient Long-Context Reasoning21 Mar 2026
- 2025Attention as Binding: A Vector-Symbolic Perspective on Transformer Reasoning8 Dec 2025
- 2025Beyond Memorization: Extending Reasoning Depth with Recurrence, Memory and Test-Time Compute Scaling22 Aug 2025
- 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agent3 Jul 2025
- 2025Deciphering Trajectory-Aided LLM Reasoning: An Optimization Perspective26 May 2025
- 2025Can Memory-Augmented Language Models Generalize on Reasoning-in-a-Haystack Tasks?10 Mar 2025
- 2024Titans: Learning to Memorize at Test Time31 Dec 2024
12 newest of 15 All 15 (JSON)
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2025A Systematic Review of Key Retrieval-Augmented Generation (RAG) Systems: Progress, Gaps, and Future Directionscited by 30
- 2025MLP Memory: A Retriever-Pretrained Memory for Large Language Modelscited by 19
- 2021RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsingcited by 15
- 2025PersonaAI: Leveraging Retrieval-Augmented Generation and Personalized Context for AI-Driven Digital Avatarscited by 1
- 2022Suffix Retrieval-Augmented Language Modelingcited by 0
- 2025MLP Memory: A Retriever-Pretrained Memory for Large Language Models3 Aug 2025
- 2025A Systematic Review of Key Retrieval-Augmented Generation (RAG) Systems: Progress, Gaps, and Future Directions25 Jul 2025
- 2025PersonaAI: Leveraging Retrieval-Augmented Generation and Personalized Context for AI-Driven Digital Avatars3 Jan 2025
- 2022Suffix Retrieval-Augmented Language Modeling6 Nov 2022
- 2021RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsing21 Sep 2021
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks22 May 2020
- 2020REALM: Retrieval-Augmented Language Model Pre-Training10 Feb 2020
- 2024Dual Memory Networks: A Versatile Adaptation Approach for Vision-Language Modelscited by 51
- 2024AdaNeg: Adaptive Negative Proxy Guided OOD Detection with Vision-Language Modelscited by 16
- 2024Visual Text Matters: Improving Text-KVQA with Visual Text Entity Knowledge-aware Large Multimodal Assistantcited by 3
- 2026Good Memory Has ECC: Evaluating the Memory of Vision-Language Models Beyond Accuracycited by 0
- 2026From Terminology to Diagrams: Visual-Instruction Generation for Scientific Diagram Understandingcited by 0
- 2026From Terminology to Diagrams: Visual-Instruction Generation for Scientific Diagram Understanding1 Sep 2026
- 2026Good Memory Has ECC: Evaluating the Memory of Vision-Language Models Beyond Accuracy31 Aug 2026
- 2024AdaNeg: Adaptive Negative Proxy Guided OOD Detection with Vision-Language Models26 Oct 2024
- 2024Visual Text Matters: Improving Text-KVQA with Visual Text Entity Knowledge-aware Large Multimodal Assistant24 Oct 2024
- 2024Dual Memory Networks: A Versatile Adaptation Approach for Vision-Language Models26 Mar 2024
- 2022Sparse Mixers: Combining MoE and Mixing to build a more efficient BERTcited by 12
- 2026Exact Linear Attentioncited by 0
- 2026MoME: Mixture-of-Memory Embeddings for Context-Aware Sparse Lookupcited by 0
- 2026MoME: Mixture-of-Memory Embeddings for Context-Aware Sparse Lookup14 Sep 2026
- 2026Exact Linear Attention13 May 2026
- 2022Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT24 May 2022
- 2022Scalable Adaptive Computation for Iterative Generationcited by 190
- 2022Scalable Adaptive Computation for Iterative Generation22 Dec 2022
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
- 2022Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasetscited by 599
- 20243D Reconstruction with Spatial Memorycited by 269
- 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 267
- 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
- 2021Internet-Augmented Dialogue Generationcited by 217
- 2022Neural Networks and the Chomsky Hierarchycited by 214
- 2022Cross-modal Memory Networks for Radiology Report Generationcited by 183
- 2022A Review on Language Models as Knowledge Basescited by 156
- 2023Towards Better Dynamic Graph Learning: New Architecture and Unified Librarycited by 154
12 most cited of 299 All 299 (JSON)
- 2026Learning Under Forgetting: Statistical Support-Selective Retention in Stochastic Training Dynamics30 Sep 2026
- 2026Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence25 Sep 2026
- 2026CAVE-Mem: Boundary-Aware Experience Validation for Memory Search23 Sep 2026
- 2026Persistent Recurrent Memory Between Transformer Layers - Improves Language Model Generalization15 Sep 2026
- 2026Does Video Memory Use What It Retrieves? A Causal Audit of Memory Specificity10 Sep 2026
- 2026AutoConcept: Training-Free Concept-Guided Reranking for Metadata-Available Composed Image Retrieval1 Sep 2026
- 2026MEMORA: Embodied Action Memory from Egocentric Videos for Reasoning and Planning15 Jul 2026
- 2026MRMS: A Multi-Resolution Memory Substrate for Long-Lived AI Agents6 Jul 2026
- 2026BiDeMem: Bidirectional Degradation Memory for Explainable Image Restoration26 Jun 2026
- 2026Repeated Shared Access Enables Grokking, but Edit Propagation Depends on an Addressable Memory17 Jun 2026
- 2026Parallel Causal Associative Fields: Gated Sparse Memory for Long-Context Language Modeling9 Jun 2026
- 2026RowNet: A Memory Transformer for Tabular Regression3 Jun 2026
12 newest of 299 All 299 (JSON)