mlsanityData to 7 Oct 2026

Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers

arXiv 2603.07670 ↗First posted 8 Mar 2026cs.AIcited by 60

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

Large language model (LLM) agents increasingly operate in settings where a single context window is far too small to capture what has happened, what was learned, and what should not be repeated. Memory -- the ability to persist, organize, and selectively recall information across interactions -- is what turns a stateless text generator into a genuinely adaptive agent. This survey offers a structured account of how memory is designed, implemented, and evaluated in modern LLM-based agents, covering work from 2022 through early 2026. We formalize agent memory as a write--manage--read loop tightly coupled with perception and action, then introduce a three-dimensional taxonomy spanning temporal scope, representational substrate, and control policy. Five mechanism families are examined in depth: context-resident compression, retrieval-augmented stores, reflective self-improvement, hierarchical virtual context, and policy-learned management. On the evaluation side, we trace the shift from static recall benchmarks to multi-session agentic tests that interleave memory with decision-making, analyzing four recent benchmarks that expose stubborn gaps in current systems. We also survey applications where memory is the differentiating factor -- personal assistants, coding agents, open-world games, scientific reasoning, and multi-agent teamwork -- and address the engineering realities of write-path filtering, contradiction handling, latency budgets, and privacy governance. The paper closes with open challenges: continual consolidation, causally grounded retrieval, trustworthy reflection, learned forgetting, and multimodal embodied memory.

Key facts. Cited by 60 papers in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 52 of its 66 references that are in the map. First posted on arXiv 8 Mar 2026.

Builds on

52 of 66 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks18 Feb
  2. 2026Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agents5 Jan
  3. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions7 Jul
  4. 2025MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agents20 Jun
  5. 2024A Survey on the Memory Mechanism of Large Language Model based Agents21 Apr
  6. 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb

Other references · 46

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  6. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  7. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  8. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  9. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  10. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  11. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  12. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
34 more
  1. 2017Billion-scale similarity search with GPUscited by 2,477
  2. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  3. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  4. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  5. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  6. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  7. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  8. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  9. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  10. 2021Improving language models by retrieving from trillions of tokenscited by 1,278
  11. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  12. 2019Machine Unlearningcited by 1,020
  13. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
  14. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  15. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 721
  16. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  17. 2014Neural Turing Machinescited by 630
  18. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
  19. 2023Cognitive Architectures for Language Agentscited by 422
  20. 2014Memory Networkscited by 354
  21. 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 288
  22. 2022Memorizing Transformerscited by 219
  23. 2022Recurrent Memory Transformercited by 197
  24. 2023Augmenting Language Models with Long-Term Memorycited by 186
  25. 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 170
  26. 2023ChatDB: Augmenting LLMs with Databases as Their Symbolic Memorycited by 136
  27. 2024Towards Safer Large Language Models through Machine Unlearningcited by 134
  28. 2023Retrieval meets Long Context Large Language Modelscited by 114
  29. 2022Training Language Models with Memory Augmentationcited by 112
  30. 2023ProAgent: Building Proactive Cooperative Agents with Large Language Modelscited by 97
  31. 2023RET-LLM: Towards a General Read-Write Memory for Large Language Modelscited by 64
  32. 2024Scaling Retrieval-Based Language Models with a Trillion-Token Datastorecited by 54
  33. 2023DERA: Enhancing Large Language Model Completions with Dialog-Enabled Resolving Agentscited by 52
  34. 2024MemLLM: Finetuning LLMs to Use An Explicit Read-Write Memorycited by 35

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 60.

60 papers.

Sort:

By area:

  1. 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 68
  2. 2026Dynamic Dual-Granularity Skill Bank for Agentic RLcited by 33
  3. 2026From Agent Traces to Trust: A Survey of Evidence Tracing and Execution Provenance in LLM Agentscited by 29
  4. 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applicationscited by 17
  5. 2026PERMA: Benchmarking Personalized Memory Agents via Event-Driven Preference and Realistic Task Environmentscited by 13
  6. 2026SEA-Eval: A Benchmark for Evaluating Self-Evolving Agents Beyond Episodic Assessmentcited by 12
  7. 2026MemTX: Transactional Belief Commit for Stateful Agent Memorycited by 12
  8. 2026Are We Ready For An Agent-Native Memory System?cited by 11
  9. 2026Belief Memory: Agent Memory Under Partial Observabilitycited by 9
  10. 2026From Question Answering to Task Completion: A Survey on Agent System and Harness Designcited by 9
  11. 2026User as Code: Executable Memory for Personalized Agentscited by 7
  12. 2026SkillLens: Adaptive Multi-Granularity Skill Reuse for Cost-Efficient LLM Agentscited by 6
38 more
  1. 2026Co-Evolving Skill Generation and Policy Optimizationcited by 5
  2. 2026RaMem: Contextual Reinstatement for Long-term Agentic Memorycited by 5
  3. 2026State Contamination in Memory-Augmented LLM Agentscited by 4
  4. 2026Meta-Cognitive Memory Policy Optimization for Long-Horizon LLM Agentscited by 4
  5. 2026Learning What to Remember: Observability-Safe Memory Retention via Constrained Optimization for Long-Horizon Language Agentscited by 4
  6. 2026What to Keep, What to Forget: A Rate--Distortion View of Memory Compaction in LLMs and Agentscited by 4
  7. 2026ComBodied Agents: a New Paradigm of Human-Centric Agentic AIcited by 4
  8. 2026Learning to Commit: Generating Organic Pull Requests via Online Repository Memorycited by 3
  9. 2026FSFM: A Biologically-Inspired Framework for Selective Forgetting of Agent Memorycited by 3
  10. 2026Learning When to Remember: Risk-Sensitive Contextual Bandits for Abstention-Aware Memory Retrieval in LLM-Based Coding Agentscited by 3
  11. 2026H2HMem: A Multimodal Memory Benchmark for Agents in Human-Human Interactionscited by 3
  12. 2026MEMORA: Embodied Action Memory from Egocentric Videos for Reasoning and Planningcited by 3
  13. 2026MemPoison: Uncovering Persistent Memory Threats and Structural Blind Spots in LLM Agentscited by 3
  14. 2026The Regression Tax: Decomposing Why Skills Help and Hurt LLM Agentscited by 3
  15. 2026What Happens Inside Agent Memory? Circuit Analysis from Emergence to Diagnosiscited by 2
  16. 2026From Agent Loops to Deterministic Graphs: Execution Lineage for Reproducible AI-Native Workcited by 2
  17. 2026Safe Multi-Agent Behavior Must Be Maintained, Not Merely Asserted: Constraint Drift in LLM-Based Multi-Agent Systemscited by 2
  18. 2026R^2-Mem: Reflective Experience for Memory Searchcited by 2
  19. 2026Less Context, More Accuracy: A Bi-Temporal Memory Engine for LLM Agents Where a Lean Retrieved Context Beats the Full Historycited by 2
  20. 2026User as Engram: Internalizing Per-User Memory as Local Parametric Editscited by 2
  21. 2026ACE: Pluggable Adaptive Context Elasticizer across Agentscited by 2
  22. 2026CrystalMem: Elastic Memory for Self-Evolving LLM Agents via Knowledge Crystallizationcited by 2
  23. 2026AutoMem: A Text-Gradient Recursive Self-Improvement Framework for Automated Memory Architectures Searchcited by 2
  24. 2026Retrieval-Driven Memory Reconsolidation for Long-Term LLM Agentscited by 2
  25. 2026The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Projectcited by 1
  26. 2026Mesh Memory Protocol: Semantic Infrastructure for Multi-Agent LLM Systemscited by 1
  27. 2026ZenBrain: A Neuroscience-Inspired 7-Layer Memory Architecture for Autonomous AI Systemscited by 1
  28. 2026Behind EvoMap: Characterizing a Self-Evolving Agent-to-Agent Collaboration Networkcited by 1
  29. 2026PEAM: Parametric Embodied Agent Memory through Contrastive Internalization of Experience in Minecraftcited by 1
  30. 2026KnowAct-GUIClaw: Know Deeply, Act Perfectly, Personal GUI Assistant with Self-Evolving Memory and Skillcited by 1
  31. 2026Toward User-Conditioned Evaluation of Personal LLM Agents under Temporal Interventionscited by 1
  32. 2026MemChain: Learning Interpretable Memory Traces for Memory-Augmented LLM Agentscited by 1
  33. 2026EA-Graph: Artifact-Anchored Verification Memory for Coding Agents under Upstream Driftcited by 1
  34. 2026Behavioral Determinants of Deployed AI Agents in Social Networks: A Multi-Factor Study of Personality, Model, and Guardrail Specificationcited by 0
  35. 2026FundaPod: A Multi-Persona Agent Pod Architecture with Knowledge Graph Memory for AI-Assisted Fundamental Investment Researchcited by 0
  36. 2026Honest Lying: Understanding Memory Confabulation in Reflexive Agentscited by 0
  37. 2026When Cloud Agents Meet Device Agents: Lessons from Hybrid Multi-Agent Systemscited by 0
  38. 2026Symbolic Reasoning Frameworks Trigger Memory-Mediated Ecosystem Dynamics in Multi-Agent LLM Systemscited by 0

50 most cited of 60 All 60 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topics
  2. 2026Memory in the LLM Era: Modular Architectures and Strategies in a Unified Framework
  3. 2026Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations
  4. 2026Choosing How to Remember: Adaptive Memory Structures for LLM Agents
  5. 2025Intrinsic Memory Agents: Heterogeneous Multi-Agent LLM Systems through Structured Contextual Memory
  6. 2026Memory as a Controlled Process: Learned Adaptive Memory Management for LLM Agents
  7. 2026Graph-Based Personalized Memory for LLM Agents: Representation, Evolution, Retrieval, and Evaluation
  8. 2026AdMem: Advanced Memory for Task-solving Agents