mlsanityData to 14 Oct 2026

Dual-Layer Agentic Memory with Fast Write Routing and Slow Consolidation

arXiv 2608.22215 ↗First posted 23 Aug 2026cs.CLcited by 1

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

Large language model (LLM) agents operate in dynamic environments where knowledge continuously evolves. Existing memory systems typically treat external memory as a monotonically growing repository, inevitably leading to retrieval degradation and increasing computational costs over time. We argue that the core challenge is not retrieval alone, but managing the knowledge lifecycle: deciding what to externalize, update, or ultimately internalize. Inspired by Complementary Learning Systems (CLS) theory in neuroscience, we propose Dual-Layer Agentic Memory, a framework that shifts memory management to the write phase through cost-aware epistemic routing and periodic parametric consolidation. Incoming information is categorized as non-write, write-new, or write-update, and routed through a small-to-large model cascade that minimizes routing overhead while filtering redundant memories. A subsequent write-back phase selectively consolidates high-value external memories into model parameters via supervised fine-tuning. Experiments demonstrate the dual efficiency of our approach: a 1.7B/8B cascade prunes up to 68% of redundant external memory while escalating fewer than 50% of inputs, yet retains over 98% of the downstream QA Exact Match (EM) achieved by an exhaustive retention baseline. We further show that periodic consolidation successfully internalizes external knowledge, allowing the router to adaptively suppress redundant writes as the model's epistemic boundaries evolve. Overall, our framework presents a unified paradigm for agent memory: selective externalization followed by selective internalization. Code and dataset will be released upon acceptance.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 26 of its 33 references that are in the map. First posted on arXiv 23 Aug 2026.

Builds on

26 of 33 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025MemInsight: Autonomous Memory Augmentation for LLM Agents27 Mar
  2. 2025A-MEM: Agentic Memory for LLM Agents17 Feb
  3. 2025Lifelong Learning of Large Language Model based Agents: A Roadmap13 Jan
  4. 2024On the Structural Memory of LLM Agents17 Dec
  5. 2024HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Model18 Aug

Other references · 21

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  5. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  6. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  7. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  8. 2022Mass-Editing Memory in a Transformercited by 1,001
  9. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
  10. 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 451
  11. 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 426
  12. 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 234
9 more
  1. 2024Continual Learning for Large Language Models: A Surveycited by 147
  2. 2024A Unified Approach to Routing and Cascading for LLMscited by 80
  3. 2025AnyEdit: Edit Any Knowledge Encoded in Language Modelscited by 76
  4. 2024SeaKR: Self-aware Knowledge Retrieval for Adaptive Retrieval Augmented Generationcited by 40
  5. 2024When to Retrieve: Teaching LLMs to Utilize Information Retrieval Effectivelycited by 21
  6. 2025Decoupling Reasoning and Knowledge Injection for In-Context Knowledge Editingcited by 12
  7. 2025Self-Routing RAG: Binding Selective Retrieval with Knowledge Verbalizationcited by 9
  8. 2025Robust Knowledge Editing via Explicit Reasoning Chains for Distractor-Resilient Multi-Hop QAcited by 4
  9. 2024Unsupervised Replay Strategies for Continual Learning with Limited Datacited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Memory as a Controlled Process: Learned Adaptive Memory Management for LLM Agents
  2. 2026Auto-Dreamer: Learning Offline Memory Consolidation for Language Agents
  3. 2026Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations
  4. 2026The AI Hippocampus: How Far are We From Human Memory?
  5. 2026LifeFuse-Mem: Lifecycle-Aware State Fusion Against Temporary Overwriting for Long-Term Memory
  6. 2026Continuum Memory Architectures for Long-Horizon LLM Agents
  7. 2026What to Keep, What to Forget: A Rate--Distortion View of Memory Compaction in LLMs and Agents
  8. 2026Towards Autonomous Memory Agents