mlsanityData to 7 Oct 2026

Control-Plane Placement Shapes Forgetting: An Architectural Study of Agent Memory Across Thirteen System Configurations

arXiv 2606.15903 ↗First posted 14 Jun 2026cs.CL cs.AIcited by 0

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

Where an LLM sits in an agent memory pipeline -- between the recall plane that retrieves stored facts (extensively benchmarked) and the control plane that mutates them via supersede, release, purge (largely untested) -- shapes which forgetting failure modes the system recovers. Comparing thirteen system configurations on a 385-case adversarial surface, we observe three placement regimes with partly complementary coverage: deterministic primitives suffice for lexical/temporal categories but fail canonicalization (5% on identifier-obfuscation, 0% on cross-lingual); inscribe-time LLM recovers canonicalization (100%) but cannot help intent-aware deletion (0% on prefix-collision and compound-fact); a mutation-time hook recovers intent-aware deletion (78-85%) and brightens nearly all categories simultaneously (91.7-93.2% overall, 0.17 per 385-case run, 2.3s/case mutation latency vs. 64-191ms/case deterministic, recall path unchanged). We expose the trade-off via ForgetEval, a 1000-case templated suite plus a 385-case adversarial layer (132 hand-crafted + 253 LLM-drafted oracle-validated) scored by deterministic substring match, paired with a six-method Adapter Protocol with honest N/A scoring that lets heterogeneous memory stores enter in 130 lines. Admission is corroborated by 10-annotator IAA (Fleiss' kappa = 0.958) and a 77-case external-authored subset (four blind contributors) that replicates the canonicalization asymmetry and amplifies the joint-placement lift (+27.8 pt). Production failures are predominantly forgetting failures rather than recall failures, yet existing benchmarks measure only recall. ForgetEval and all adapters are released under MIT.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 14 of its 33 references that are in the map. First posted on arXiv 14 Jun 2026.

Builds on

14 of 33 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026Reliable Post-Retrieval Assembly for Agent Memory: Separating Evidence Extraction from Policy Execution31 May
  2. 2026MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks18 Feb
  3. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions7 Jul
  4. 2025MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agents20 Jun
  5. 2025A-MEM: Agentic Memory for LLM Agents17 Feb
  6. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memory20 Jan

Other references · 8

  1. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  2. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  3. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  4. 2019Machine Unlearningcited by 1,020
  5. 2022Mass-Editing Memory in a Transformercited by 976
  6. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
  7. 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 507
  8. 2024Model Editing at Scale leads to Gradual and Catastrophic Forgettingcited by 92

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026What to Keep, What to Forget: A Rate--Distortion View of Memory Compaction in LLMs and Agents
  2. 2026FSFM: A Biologically-Inspired Framework for Selective Forgetting of Agent Memory
  3. 2026Understanding and Mitigating Inference-Time Overreliance Using Agentic Memory
  4. 2026SAGE: A Novelty Gate for Efficient Memory Evolution in Agentic LLMs
  5. 2026The Trap of Trajectory: Towards Understanding and Mitigating Spurious Correlations in Agentic Memory
  6. 2025How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behavior
  7. 2026The Epistemics of Agent Memory: Measuring, and Governing, the Consolidation Decision in Long-Horizon LLM Agents
  8. 2026Memory Beyond Recall: A Dual-Process Cognitive Memory System for Self-Evolving LLM Agents