mlsanityData to 14 Oct 2026

MemoryBank: Enhancing Large Language Models with Long-Term Memory

arXiv 2305.10250 ↗First posted 17 May 2023cs.CL cs.AIcited by 556

Not on the map. Why?

Cited by 308 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Revolutionary advancements in Large Language Models have drastically reshaped our interactions with artificial intelligence systems. Despite this, a notable hindrance remains-the deficiency of a long-term memory mechanism within these models. This shortfall becomes increasingly evident in situations demanding sustained interaction, such as personal companion systems and psychological counseling. Therefore, we propose MemoryBank, a novel memory mechanism tailored for LLMs. MemoryBank enables the models to summon relevant memories, continually evolve through continuous memory updates, comprehend, and adapt to a user personality by synthesizing information from past interactions. To mimic anthropomorphic behaviors and selectively preserve memory, MemoryBank incorporates a memory updating mechanism, inspired by the Ebbinghaus Forgetting Curve theory, which permits the AI to forget and reinforce memory based on time elapsed and the relative significance of the memory, thereby offering a human-like memory mechanism. MemoryBank is versatile in accommodating both closed-source models like ChatGPT and open-source models like ChatGLM. We exemplify application of MemoryBank through the creation of an LLM-based chatbot named SiliconFriend in a long-term AI Companion scenario. Further tuned with psychological dialogs, SiliconFriend displays heightened empathy in its interactions. Experiment involves both qualitative analysis with real-world user dialogs and quantitative analysis with simulated dialogs. In the latter, ChatGPT acts as users with diverse characteristics and generates long-term dialog contexts covering a wide array of topics. The results of our analysis reveal that SiliconFriend, equipped with MemoryBank, exhibits a strong capability for long-term companionship as it can provide emphatic response, recall relevant memories and understand user personality.

Key facts. Cited by 556 papers in the map (data through 14 Oct 2026). Builds on 14 of its 19 references that are in the map. First posted on arXiv 17 May 2023.

Builds on

14 of 19 references.

References · 14

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  6. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  7. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  8. 2023A Survey of Large Language Modelscited by 2,576
  9. 2017Billion-scale similarity search with GPUscited by 2,497
  10. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  11. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
  12. 2014Neural Turing Machinescited by 644
2 more
  1. 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 267
  2. 2022Long Time No See! Open-Domain Conversation with Long-Term Persona Memorycited by 108

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 19; 2024: 48; 2025: 129; 2026: 360.

556 papers.

Sort:

By area:

  1. 2023Qwen Technical Reportcited by 3,344
  2. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  3. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  4. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
  5. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
  6. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  7. 2023A Comprehensive Overview of Large Language Modelscited by 648
  8. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 634
  9. 2024Understanding the planning of LLM agents: A surveycited by 421
  10. 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 392
  11. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 284
  12. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactionscited by 254
38 more
  1. 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 246
  2. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 212
  3. 2025LightMem: Lightweight and Efficient Memory-Augmented Generationcited by 180
  4. 2025MIRIX: Multi-Agent Memory System for LLM-Based Agentscited by 173
  5. 2024A Human-Inspired Reading Agent with Gist Memory of Very Long Contextscited by 146
  6. 2025Memory Injection Attacks on LLM Agents via Query-Only Interactioncited by 144
  7. 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 136
  8. 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systemscited by 133
  9. 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studiescited by 131
  10. 2025Memento: Fine-tuning LLM Agents without Fine-tuning LLMscited by 127
  11. 2025A Survey of Context Engineering for Large Language Modelscited by 126
  12. 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 123
  13. 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 122
  14. 2024Empowering Biomedical Discovery with AI Agentscited by 118
  15. 2026AutoSkill: Experience-Driven Lifelong Learning via Skill Self-Evolutioncited by 115
  16. 2024A Survey on Large Language Model-Based Game Agentscited by 112
  17. 2025MemGen: Weaving Generative Latent Memory for Self-Evolving Agentscited by 109
  18. 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agentscited by 106
  19. 2025On Memory Construction and Retrieval for Personalized Conversational Agentscited by 105
  20. 2025How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behaviorcited by 101
  21. 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 99
  22. 2023MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversationcited by 97
  23. 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 97
  24. 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 95
  25. 2025Agent KB: Leveraging Cross-Domain Experience for Agentic Problem Solvingcited by 94
  26. 2024MEMORYLLM: Towards Self-Updatable Large Language Modelscited by 93
  27. 2025PersonaMem-v2: Towards Personalized Intelligence via Learning Implicit User Personas and Agentic Memorycited by 88
  28. 2025A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Modelscited by 87
  29. 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generationcited by 83
  30. 2025Lifelong Learning of Large Language Model based Agents: A Roadmapcited by 83
  31. 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agentscited by 82
  32. 2024From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMscited by 79
  33. 2023Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Surveycited by 72
  34. 2025MemoryGraft: Persistent Compromise of LLM Agents via Poisoned Experience Retrievalcited by 72
  35. 2025A-MemGuard: A Proactive Defense Framework for LLM-Based Agent Memorycited by 67
  36. 2026Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontierscited by 65
  37. 2023Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memorycited by 64
  38. 2024The Benefits of a Concise Chain of Thought on Problem-Solving in Large Language Modelscited by 63

50 most cited of 556 All 556 (JSON)