mlsanityData to 7 Oct 2026

Does Your Agent's Memory Survive a Model Upgrade? A Controlled Study of Memory Portability

arXiv 2609.05339 ↗First posted 4 Sep 2026cs.AI cs.CL cs.IRcited by 0

On the map: Retrieval-augmented generation → Agentic RAG, agents and memory

Abstract (arXiv)

Model upgrades are routine; memory migrations are not. An agent can keep the same memory store and still forget: a new model may interpret old notes differently, mixed embedding versions may break retrieval, and repair may fail without the original evidence. We compare memory as the same history is preserved verbatim for long-context reading (LC-RAW), divided into chunks for retrieval-augmented generation (RAG), compressed by a model into natural-language notes (NOTES), or normalized into a fixed-schema knowledge graph (KG-fixed). The study uses 48 synthetic histories with randomized answer codes, exact scoring, and two open-weight models with sub 10 billion parameters. Our measurements show that fixed-schema structures transfer reliably, with KG-fixed accuracy changing by only +0.0004 ± 0.0020 following a writer swap. Conversely, compressed NOTES exhibit high model coupling, with accuracy shifting asymmetrically by +9.91 or -13.28 percentage points depending on the specific migration direction. In RAG systems, partial embedding migrations using a 50/50 mixed index capture only a 4.96-point accuracy improvement, forfeiting the majority of the 11.90-point gain achieved through full re-embedding. Diagnostic decomposition attributes 80% (0.467 ± 0.014) of the NOTES accuracy deficit to information lost during initial construction, whereas retrieval failures drive 81% (0.364 ± 0.012) of the RAG deficit. Finally, store-only repair of NOTES fails to reach a 90% performance recovery target in all 48 test cases, whereas retaining the raw source history enables successful recovery in 34 of 48 cases for one tested direction. These findings highlight the necessity of direction-specific migration testing, strict embedding space isolation, and the retention of source histories for memory repair.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agentic RAG, agents and memory, one of 15 directions in Retrieval-augmented generation. Builds on 12 of its 16 references that are in the map. First posted on arXiv 4 Sep 2026.

Builds on

12 of 16 references.

References · 12

  1. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  2. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  3. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 800
  4. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  5. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
  6. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
  7. 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 223
  8. 2025From Experience to Strategy: Empowering LLM Agents with Trainable Graph Memorycited by 16
  9. 2026MemoryCD: Benchmarking Long-Context User Memory of LLM Agents for Lifelong Cross-Domain Personalizationcited by 15
  10. 2024textitTrans-LoRA: towards data-free Transferable Parameter Efficient Finetuningcited by 13
  11. 2026Memori: A Persistent Memory Layer for Efficient, Context-Aware LLM Agentscited by 12
  12. 2026Managing Procedural Memory in LLM Agents: Control, Adaptation, and Evaluationcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MemDelta: Controlled Baselines and Hidden Confounds in Agent Memory Evaluation
  2. 2026Agent Zero Memory: Provenance-Aware Long-Term Memory for LLM Agents
  3. 2026Are We Ready For An Agent-Native Memory System?
  4. 2026Diagnosing Retrieval vs. Utilization Bottlenecks in LLM Agent Memory
  5. 2026What Eviction Destroys: A Restore-Counterfactual Audit of Forgetting in Agent Memory
  6. 2026Positions Are Not Facts: The Mismatch Between KV Caches and Memory
  7. 2026Persistent Context Graphs for Efficient Memory Compaction in LLM Agents
  8. 2026Retain or Consolidate? Budget-Dependent Operator Selection for Language Agent Memory