mlsanityData to 7 Oct 2026

Larimar: Large Language Models with Episodic Memory Control

arXiv 2403.11901 ↗First posted 18 Mar 2024cs.LG cs.AIcited by 53

Not on the map. Why?

Abstract (arXiv)

Efficient and accurate updating of knowledge stored in Large Language Models (LLMs) is one of the most pressing research challenges today. This paper presents Larimar - a novel, brain-inspired architecture for enhancing LLMs with a distributed episodic memory. Larimar's memory allows for dynamic, one-shot updates of knowledge without the need for computationally expensive re-training or fine-tuning. Experimental results on multiple fact editing benchmarks demonstrate that Larimar attains accuracy comparable to most competitive baselines, even in the challenging sequential editing setup, but also excels in speed - yielding speed-ups of 8-10x depending on the base LLM - as well as flexibility due to the proposed architecture being simple, LLM-agnostic, and hence general. We further provide mechanisms for selective fact forgetting, information leakage prevention, and input context length generalization with Larimar and show their effectiveness. Our code is available at https://github.com/IBM/larimar

Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). Builds on 41 of its 60 references that are in the map. First posted on arXiv 18 Mar 2024.

Builds on

41 of 60 references.

References · 41

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  6. 2013Auto-Encoding Variational Bayescited by 3,980
  7. 2016Pointer Sentinel Mixture Modelscited by 2,992
  8. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  9. 2019Language Models as Knowledge Bases?cited by 1,922
  10. 2022Mass-Editing Memory in a Transformercited by 976
  11. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 788
  12. 2014Neural Turing Machinescited by 630
29 more
  1. 2021Knowledge Neurons in Pretrained Transformerscited by 590
  2. 2021Editing Factual Knowledge in Language Modelscited by 548
  3. 2021Fast Model Editing at Scalecited by 491
  4. 2022Memory-Based Model Editing at Scalecited by 443
  5. 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
  6. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 367
  7. 2014Memory Networkscited by 354
  8. 2023The Impact of Positional Encoding on Length Generalization in Transformerscited by 319
  9. 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 284
  10. 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 267
  11. 2023Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Modelscited by 237
  12. 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
  13. 2020Modifying Memories in Transformer Modelscited by 222
  14. 2023In-Context Unlearning: Language Models as Few Shot Unlearnerscited by 214
  15. 2023Unlearn What You Want to Forget: Efficient Unlearning for LLMscited by 211
  16. 2024Repeat After Me: Transformers are Better than State Space Models at Copyingcited by 208
  17. 2022Exploring Length Generalization in Large Language Modelscited by 204
  18. 2023Transformer-Patcher: One Mistake worth One Neuroncited by 196
  19. 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 157
  20. 2023Can Sensitive Information Be Deleted From LLMs? Objectives for Defending Against Extraction Attackscited by 156
  21. 2016Model-Free Episodic Controlcited by 100
  22. 2023EasyEdit: An Easy-to-use Knowledge Editing Framework for Large Language Modelscited by 97
  23. 2024Model Editing at Scale leads to Gradual and Catastrophic Forgettingcited by 92
  24. 2023Unveiling the Pitfalls of Knowledge Editing for Large Language Modelscited by 43
  25. 2017Unbounded cache model for online language modeling with open vocabularycited by 37
  26. 2017Variational Memory Addressing in Generative Modelscited by 17
  27. 2018The Kanerva Machine: A Generative Distributed Memorycited by 13
  28. 2018Learning Attractor Dynamics for Generative Memorycited by 6
  29. 2021Kanerva++: extending The Kanerva Machine with differentiable, locally block allocated latent memorycited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 9; 2025: 23; 2026: 21.

53 papers.

Sort:

By area:

  1. 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 228
  2. 2025MIRIX: Multi-Agent Memory System for LLM-Based Agentscited by 160
  3. 2025A Survey of Context Engineering for Large Language Modelscited by 120
  4. 2024Human-inspired Episodic Memory for Infinite Context LLMscited by 62
  5. 2024Machine Unlearning in Generative AI: A Surveycited by 49
  6. 2025Mem-α: Learning Memory Construction via Reinforcement Learningcited by 49
  7. 2026Skill-Pro: Learning Reusable Skills from Experience via Non-Parametric PPO for LLM Agentscited by 44
  8. 2025Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topicscited by 36
  9. 2025Position: Episodic Memory is the Missing Piece for Long-Term LLM Agentscited by 35
  10. 2024Needle in the Haystack for Memory Based Large Language Modelscited by 32
  11. 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 19
  12. 2024Neuron-Level Sequential Editing for Large Language Modelscited by 18
38 more
  1. 2025Embodied Agents Meet Personalization: Investigating Challenges and Solutions Through the Lens of Memory Utilizationcited by 15
  2. 2025Episodic Memories Generation and Evaluation Benchmark for Large Language Modelscited by 14
  3. 2024Towards LifeSpan Cognitive Systemscited by 13
  4. 2024Human-inspired Perspectives: A Survey on AI Long-term Memorycited by 12
  5. 2025A Simple "Try Again" Can Elicit Multi-Turn LLM Reasoningcited by 11
  6. 2024Assessing Episodic Memory in LLMs with Sequence Order Recall Taskscited by 9
  7. 2025AI Awarenesscited by 6
  8. 2025Beyond Fact Retrieval: Episodic Memory for RAG with Generative Semantic Workspacescited by 6
  9. 2024MindForge: Empowering Embodied Agents with Theory of Mind for Lifelong Cultural Learningcited by 5
  10. 2025ExAnte: A Benchmark for Ex-Ante Inference in Large Language Modelscited by 5
  11. 2025Search-R3: Unifying Reasoning and Embedding in Large Language Modelscited by 4
  12. 2026What to Keep, What to Forget: A Rate--Distortion View of Memory Compaction in LLMs and Agentscited by 4
  13. 2025Scopes of Alignmentcited by 3
  14. 2025Enhancing Reasoning with Collaboration and Memorycited by 3
  15. 2026BMAM: Brain-inspired Multi-Agent Memory Frameworkcited by 3
  16. 2026MemGym: a Long-Horizon Memory Environment for LLM Agentscited by 3
  17. 2025Memory Helps, but Confabulation Misleads: Understanding Streaming Events in Videos with MLLMscited by 2
  18. 2025Can Memory-Augmented Language Models Generalize on Reasoning-in-a-Haystack Tasks?cited by 2
  19. 2025Memorization and Knowledge Injection in Gated LLMscited by 2
  20. 2025Attention is All You Need Until You Need Retentioncited by 1
  21. 2025A Semantic-based Optimization Approach for Repairing LLMs: Case Study on Code Generationcited by 1
  22. 2025Growing Through Experience: Scaling Episodic Grounding in Language Modelscited by 1
  23. 2025Memory-Augmented Architecture for Long-Term Context Handling in Large Language Modelscited by 1
  24. 2025COSMIR: Chain Orchestrated Structured Memory for Iterative Reasoning over Long Contextcited by 1
  25. 2025BudgetMem: Training-Free Selective Memory for Cost-Efficient Long-Context Processing in Language Modelscited by 1
  26. 2026LLM-as-RNN: A Recurrent Language Model for Memory Updates and Sequence Predictioncited by 1
  27. 2026LiveMem: Maintaining Memory State Continuity in Long-Running LLM Inferencecited by 1
  28. 2026Memory Is Not Always Needed: Characterizing Conditional Memory in Scientific Reasoningcited by 1
  29. 2026Mixture of Chapters: Scaling Learnt Memory in Transformerscited by 0
  30. 2026The Dynamic Gist-Based Memory Model (DGMM): A Memory-Centric Architecture for Artificial Intelligencecited by 0
  31. 2026The Echo Amplifies the Knowledge: Somatic Marker Analogues in Language Models via Emotion Vector Re-Injectioncited by 0
  32. 2026LANTERN: Layered Archival and Temporal Episodic Retrieval Network for Long-Context LLM Conversationscited by 0
  33. 2026Position: Hippocampal Explicit Memory Is the Cornerstone for AGIcited by 0
  34. 2026EVAF: A Test-Retest Protocol for Selective Parametric Consolidationcited by 0
  35. 2026Surprise as a Signal for Plasticity and Metacognitioncited by 0
  36. 2026MIITA: Memory-Induced Inference-Time Adaptation for Continual Learning with Small Language Modelscited by 0
  37. 2026Transfiver: Human-AI Co-Inference through a Shared Editable Statecited by 0
  38. 2026An Interpretable Memory Decision Controller for LLM Agents Based on Three-Signal Complementarity: Decoupling Confidence and Consistencycited by 0

50 most cited of 53 All 53 (JSON)