mlsanityData to 14 Oct 2026

Temporal Validity in Retrieval Memory: Eliminating Stale-Fact Errors for AI Agents over Evolving Knowledge

arXiv 2606.26511 ↗First posted 25 Jun 2026cs.CL cs.AI cs.ETcited by 14

On the map: Retrieval-augmented generation → Agentic RAG, agents and memory

also in 1 more
Abstract (arXiv)

Retrieval-augmented generation (RAG) gives agents access to accumulated knowledge, but has no model of time. When a fact changes (e.g., a function is renamed or API restructured), RAG retrieves both the stale and current value with near-identical embedding similarity. The agent then either abstains or serves the superseded fact. We show this is a structural problem: on a calibrated dataset, cosine similarity distinguishes a contradicted fact from a duplicated one with AUROC 0.59 (near chance), as contradictions are often more embedding-similar to the original than rephrased duplicates. We present MemStrata, a retrieval memory maintaining temporal validity. It stores facts like RAG, preserving static recall, but when a fact's value is contradicted, a deterministic (subject, relation, object) supersession rule retires the stale value in a bi-temporal ledger - with no similarity threshold and no LLM call. Across six benchmarks run locally with a 7B model, MemStrata ties RAG on static knowledge and reaches 0.95-1.00 accuracy on evolving knowledge (where RAG reaches 0.20-0.47). The central result is the stale-fact-error rate: when required to answer, RAG serves superseded values 15-40% of the time; MemStrata drives this to ~0%, a failure class RAG cannot avoid. MemStrata achieves this at retrieval latency (~2.1s) versus ~16-18s for LLM-reranking baselines. We release the harness, datasets, and a marker-free evaluation protocol for memory under knowledge evolution.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Agentic RAG, agents and memory, one of 15 directions in Retrieval-augmented generation. Builds on 13 of its 20 references that are in the map. First posted on arXiv 25 Jun 2026.

Builds on

13 of 20 references.

References · 13

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  3. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  4. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  5. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  6. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  7. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
  8. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
  9. 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
  10. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
  11. 2025HyperGraphRAG: Retrieval-Augmented Generation via Hypergraph-Structured Knowledge Representationcited by 68
  12. 2024A Survey on Temporal Knowledge Graph: Representation Learning and Applicationscited by 30
1 more
  1. 2025NodeRAG: Structuring Graph-based RAG with Heterogeneous Nodescited by 26

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 14.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026The Immutable Past: Formalizing State Mutability and Conflict Resolution in Mutable RAG
  2. 2026MemTrace: Probing What Final Accuracy Misses in Long-Term Memory
  3. 2026Beyond RAG for Agent Memory: Retrieval by Decoupling and Aggregation
  4. 2026Mitigating Provenance-Role Collapse in Long-Term Agents via Typed Memory Representation
  5. 2026Eywa: Provenance-Grounded Long-Term Memory for AI Agents
  6. 2026Less Context, More Accuracy: A Bi-Temporal Memory Engine for LLM Agents Where a Lean Retrieved Context Beats the Full History
  7. 2026Chronofy: A Temporal-Logical Decay Architecture for Information Validity in Time-Aware Retrieval-Augmented Generation
  8. 2026MemRetriever: Learning to Search, Reflect, and Retrieve from Long-Term Memory ↗