mlsanityData to 7 Oct 2026

A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents

arXiv 2602.06052 ↗First posted 14 Jan 2026cs.CL cs.AIcited by 40

On the map: LLM agents and tool use → Agent memory systems

also in 1 more
Abstract (arXiv)

Research in artificial intelligence is shifting from model innovations and benchmark scores towards problem definition and rigorous real-world evaluation. As the field enters the "second half," the central challenge becomes real utility in long-horizon, dynamic, and user-dependent settings such as agentic coding, deep research, and computer use, where LLM-based agents face context explosion beyond fixed context windows and must continuously accumulate, manage, and selectively reuse information across extended interactions. Memory, with hundreds of papers released in 2025, therefore emerges as the critical solution to fill this utility gap. Beyond passive storage, memory is increasingly the substrate through which agents self-evolve: short-term memory gates which experiences are perceived and abstracted during execution, while long-term memory consolidates them into reusable knowledge and skills, forming the loop through which agents improve from their own experience. In this survey, we provide a unified view of foundation agent memory along three dimensions: memory substrate (internal parametric state and external retrieval-augmented stores), cognitive mechanism (sensory, working, episodic, semantic, and procedural), and memory subject (user-centric personalization and agent-centric experience). We then analyze how memory is operated under single- and multi-agent topologies and highlight learning policies over memory operations, showing how memory management itself is becoming a trainable capability spanning reinforcement-learned context curation, experience consolidation at decision time, and the emerging ecosystem of portable, shareable agent skills. Finally, we review evaluation benchmarks and metrics for memory utility, and outline open challenges and future directions.

Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 252 of its 535 references that are in the map. First posted on arXiv 14 Jan 2026.

Builds on

252 of 535 references.

Closest ancestors · 58

Same direction, newest first

  1. 2026Mem-Gallery: Benchmarking Multimodal Long-Term Conversational Memory for MLLM Agents7 Jan
  2. 2025AI Meets Brain: Memory Systems from Cognitive Neuroscience to Autonomous Agents29 Dec
  3. 2025Memory in the Age of AI Agents15 Dec
  4. 2025Forgetful but Faithful: A Cognitive Memory Architecture and Benchmark for Privacy-Aware Generative Agents14 Dec
  5. 2025Hindsight is 20/20: Building Agent Memory that Retains, Recalls, and Reflects14 Dec
  6. 2025Memoria: A Scalable Agentic Memory Framework for Personalized Conversational AI14 Dec
  7. 2025Unifying Dynamic Tool Creation and Cross-Task Experience Sharing through Cognitive Memory Architecture12 Dec
  8. 2025Towards Continuous Intelligence Growth: Self-Training, Continual Learning, and Dual-Scale Memory in SuperIntelliAgent28 Nov
  9. 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memory25 Nov
  10. 2025General Agentic Memory Via Deep Research23 Nov
  11. 2025A Benchmark for Procedural Memory Retrieval in Language Agents21 Nov
  12. 2025Mem-PAL: Towards Memory-based Personalized Dialogue Assistants for Long-term User-Agent Interaction17 Nov
38 more
  1. 2025From Experience to Strategy: Empowering LLM Agents with Trainable Graph Memory11 Nov
  2. 2025LiCoMemory: Lightweight and Cognitive Agentic Memory for Efficient Long-Term Reasoning3 Nov
  3. 2025EvoMem: Improving Multi-Agent Planning with Dual-Evolving Memory1 Nov
  4. 2025Dynamic Affective Memory Management for Personalized LLM Agents31 Oct
  5. 2025AgentFold: Long-Horizon Web Agents with Proactive Context Management28 Oct
  6. 2025RGMem: Renormalization Group-inspired Memory Evolution for Language Agents18 Oct
  7. 2025Memory as Action: Autonomous Context Curation for Long-Horizon Agentic Tasks14 Oct
  8. 2025Scaling Long-Horizon LLM Agent via Context-Folding13 Oct
  9. 2025Preference-Aware Memory Update for Long-Term LLM Agents10 Oct
  10. 2025Enabling Personalized Long-term Interactions in LLM-based Agents through Persistent Memory and User Profiles9 Oct
  11. 2025ToolMem: Enhancing Multimodal Agents with Learnable Tool Capability Memory8 Oct
  12. 2025CAM: A Constructivist View of Agentic Memory for LLM-Based Reading Comprehension7 Oct
  13. 2025LEGOMem: Modular Procedural Memory for Multi-agent LLM Systems for Workflow Automation6 Oct
  14. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models6 Oct
  15. 2025MEMTRACK: Evaluating Long-Term Memory and State Tracking in Multi-Platform Dynamic Agent Environments1 Oct
  16. 2025ACON: Optimizing Context Compression for Long-horizon LLM Agents1 Oct
  17. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memory29 Sep
  18. 2025MemGen: Weaving Generative Latent Memory for Self-Evolving Agents29 Sep
  19. 2025Look Back to Reason Forward: Revisitable Memory for Long-Context LLM Agents27 Sep
  20. 2025ReSum: Unlocking Long-Horizon Search Intelligence via Context Summarization16 Sep
  21. 2025Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learning27 Aug
  22. 2025Memento: Fine-tuning LLM Agents without Fine-tuning LLMs22 Aug
  23. 2025Learn to Memorize: Optimizing LLM-based Agents with Adaptive Memory Framework15 Aug
  24. 2025Intrinsic Memory Agents: Heterogeneous Multi-Agent LLM Systems through Structured Contextual Memory12 Aug
  25. 2025Memp: Exploring Agent Procedural Memory8 Aug
  26. 2025What Deserves Memory: Adaptive Memory Distillation for LLM Agents5 Aug
  27. 2025Hierarchical Memory for High-Efficiency Long-Term Reasoning in LLM Agents23 Jul
  28. 2025MIRIX: Multi-Agent Memory System for LLM-Based Agents10 Jul
  29. 2025Agent KB: Leveraging Cross-Domain Experience for Agentic Problem Solving8 Jul
  30. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions7 Jul
  31. 2025MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agents20 Jun
  32. 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agents18 Jun
  33. 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systems9 Jun
  34. 2025PersonaAgent: Bridging Memory and Action for Personalized LLM Agents6 Jun
  35. 2025Collaborative Memory: Multi-User Memory Sharing in LLM Agents with Dynamic Access Control23 May
  36. 2025How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behavior21 May
  37. 2025LifelongAgentBench: Evaluating LLM Agents as Lifelong Learners17 May
  38. 2025Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topics1 May

50 newest of 58 All 58 (JSON)

Other references · 194

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  6. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  7. 2018World Modelscited by 1,444
  8. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
  9. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  10. 2023Mastering Diverse Domains through World Modelscited by 1,193
  11. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  12. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
38 more
  1. 2024DeepSeek-V3 Technical Reportcited by 724
  2. 2019Compressive Transformers for Long-Range Sequence Modellingcited by 699
  3. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
  4. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
  5. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  6. 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
  7. 2024Large Language Models: A Surveycited by 506
  8. 2025Humanity's Last Examcited by 467
  9. 2023Model Tells You What to Discard: Adaptive KV Cache Compression for LLMscited by 466
  10. 2024PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funnelingcited by 420
  11. 2024Understanding the planning of LLM agents: A surveycited by 414
  12. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
  13. 2025Accelerating scientific discovery with Co-Scientistcited by 353
  14. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 329
  15. 2024Titans: Learning to Memorize at Test Timecited by 303
  16. 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 288
  17. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agentscited by 280
  18. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
  19. 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 235
  20. 2023S3: Social-network Simulation System with Large Language Model-Empowered Agentscited by 228
  21. 2017SearchQA: A New Q&A Dataset Augmented with Context from a Search Enginecited by 221
  22. 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 213
  23. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
  24. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 205
  25. 2024Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attentioncited by 194
  26. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
  27. 2025Survey on Evaluation of LLM-based Agentscited by 190
  28. 2025Mobile-Agent-v3: Fundamental Agents for GUI Automationcited by 183
  29. 2024TradingAgents: Multi-Agents LLM Financial Trading Frameworkcited by 182
  30. 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 163
  31. 2025LightMem: Lightweight and Efficient Memory-Augmented Generationcited by 163
  32. 2025WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learningcited by 162
  33. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
  34. 2025Dynamic Cheatsheet: Test-Time Learning with Adaptive Memorycited by 146
  35. 2023War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Warscited by 143
  36. 2023ChatDB: Augmenting LLMs with Databases as Their Symbolic Memorycited by 136
  37. 2025MemOS: A Memory OS for AI Systemcited by 129
  38. 2025Memory Injection Attacks on LLM Agents via Query-Only Interactioncited by 127

50 most cited of 194 All 194 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 40.

40 papers.

Sort:

By area:

  1. 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verificationcited by 117
  2. 2026Code as Agent Harnesscited by 40
  3. 2026Dive into Claude Code: The Design Space of Today's and Future AI Agent Systemscited by 33
  4. 2026GAM: Hierarchical Graph-based Agentic Memory for LLM Agentscited by 19
  5. 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applicationscited by 17
  6. 2026MemoryCD: Benchmarking Long-Context User Memory of LLM Agents for Lifelong Cross-Domain Personalizationcited by 15
  7. 2026When Users Change Their Mind: Evaluating Interruptible Agents in Long-Horizon Web Navigationcited by 12
  8. 2026GroupMemBench: Benchmarking LLM Agent Memory in Multi-Party Conversationscited by 12
  9. 2026MemTX: Transactional Belief Commit for Stateful Agent Memorycited by 12
  10. 2026Graph-Native Cognitive Memory for AI Agents: Formal Belief Revision Semantics for Versioned Memory Architecturescited by 9
  11. 2026Auto-Dreamer: Learning Offline Memory Consolidation for Language Agentscited by 9
  12. 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
28 more
  1. 2026AtelierEval: Agentic Evaluation of Humans & LLMs as Text-to-Image Prompterscited by 7
  2. 2026OpenWebRL: Demystifying Online Multi-turn Reinforcement Learning for Visual Web Agentscited by 6
  3. 2026The Last AI Built by Humans: Toward Genuine Recursive Self-Improvementcited by 5
  4. 2026HyMem: Hybrid Memory Architecture with Dynamic Retrieval Schedulingcited by 4
  5. 2026Learning What to Remember: Observability-Safe Memory Retention via Constrained Optimization for Long-Horizon Language Agentscited by 4
  6. 2026MemTrace: Probing What Final Accuracy Misses in Long-Term Memorycited by 4
  7. 2026LeanMem: Simple and Efficient Long-Term Memory for LLM Agentscited by 4
  8. 2026Mem-π: Adaptive Memory through Learning When and What to Generatecited by 3
  9. 2026Organize then Retrieve: Hierarchical Memory Navigation for Efficient Agentscited by 3
  10. 2026HY-WU (Part I): An Extensible Functional Neural Memory Framework and An Instantiation in Text-Guided Image Editingcited by 2
  11. 2026MINTEval: Evaluating Memory under Multi-Target Interference in Long-Horizon Agent Systemscited by 2
  12. 2026Harnessing Generalist Agents for Contextualized Time Seriescited by 2
  13. 2026XBridge: Entity-Grounded Latent Bridge for Heterogeneous LLM Communicationcited by 2
  14. 2026Probing to Refine: Reinforcement Distillation of LLMs via Explanatory Inversioncited by 1
  15. 2026Task-Focused Memorization for Multimodal Agentscited by 1
  16. 2026Rethinking Self-Evolution: A Constrained Exploration-Exploitation Process for Mitigating Skill Overfittingcited by 1
  17. 2026MemSIF: From Structured Interactions to Dual-Track Fact Memory for LLM Agentscited by 1
  18. 2026SodaMem: Evidence-Grounded Temporal Graph Memory for LLM Agentscited by 1
  19. 2026Agents in the Large: Perception-Centered Architecture for Persistent Agentscited by 1
  20. 2026EvoIR-Agent: Self-Evolving Image Restoration Agentic System via Experience-Driven Learningcited by 0
  21. 2026DeferMem: Query-Time Evidence Distillation via Reinforcement Learning for Long-Term Agent Memorycited by 0
  22. 2026MemTools: A Unified Research Framework for Interoperable Agent Memorycited by 0
  23. 2026Know It, Act on It: Investigating Memory Utilization in LLM Personalizationcited by 0
  24. 2026Minimal Local Simulation Foundations for LLM- and VLM-Driven Agents in 2D and 3D Environmentscited by 0
  25. 2026EnSIMem: Entity-Structured Indexing for Long-Term Agent Memorycited by 0
  26. 2026Beyond Dyadic Memory: Interaction-Aware Multimodal Memory with Adaptive Agentic Retrieval for Multi-Party Spoken Conversationscited by 0
  27. 2026Org-Agent: Beyond Personal Assistants Towards Organizational Agentscited by 0
  28. 2026RSI-Master: Structuring Experiments to Guide Autonomous Model Improvementcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025MemEvolve: Meta-Evolution of Agent Memory Systems
  2. 2026Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers
  3. 2026EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspective
  4. 2025Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolution
  5. 2026Memory Beyond Recall: A Dual-Process Cognitive Memory System for Self-Evolving LLM Agents
  6. 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms
  7. 2026AdMem: Advanced Memory for Task-solving Agents
  8. 2026Exploring Cross-Scenario Generality of Agentic Memory Systems: Diagnostics and a Strong Baseline