Temporal Validity in Retrieval Memory: Eliminating Stale-Fact Errors for AI Agents over Evolving Knowledge
On the map: Retrieval-augmented generation → Agentic RAG, agents and memory
also in 1 more
Abstract (arXiv)
Retrieval-augmented generation (RAG) gives agents access to accumulated knowledge, but has no model of time. When a fact changes (e.g., a function is renamed or API restructured), RAG retrieves both the stale and current value with near-identical embedding similarity. The agent then either abstains or serves the superseded fact. We show this is a structural problem: on a calibrated dataset, cosine similarity distinguishes a contradicted fact from a duplicated one with AUROC 0.59 (near chance), as contradictions are often more embedding-similar to the original than rephrased duplicates. We present MemStrata, a retrieval memory maintaining temporal validity. It stores facts like RAG, preserving static recall, but when a fact's value is contradicted, a deterministic (subject, relation, object) supersession rule retires the stale value in a bi-temporal ledger - with no similarity threshold and no LLM call. Across six benchmarks run locally with a 7B model, MemStrata ties RAG on static knowledge and reaches 0.95-1.00 accuracy on evolving knowledge (where RAG reaches 0.20-0.47). The central result is the stale-fact-error rate: when required to answer, RAG serves superseded values 15-40% of the time; MemStrata drives this to ~0%, a failure class RAG cannot avoid. MemStrata achieves this at retrieval latency (~2.1s) versus ~16-18s for LLM-reranking baselines. We release the harness, datasets, and a marker-free evaluation protocol for memory under knowledge evolution.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Agentic RAG, agents and memory, one of 15 directions in Retrieval-augmented generation. Builds on 13 of its 20 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
13 of 20 references.
References · 13
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
- 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
- 2025HyperGraphRAG: Retrieval-Augmented Generation via Hypergraph-Structured Knowledge Representationcited by 68
- 2024A Survey on Temporal Knowledge Graph: Representation Learning and Applicationscited by 30
1 more
Built on by
Citing papers per year: 2026: 14.
14 papers.
Sort:
By area:
- 2026MemTX: Transactional Belief Commit for Stateful Agent Memorycited by 15
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 9
- 2026Ground Truth First: A Longitudinal Evaluation Instrument for Agent Memory, and the Tenure Crossover in Memory-Architecture Rankingscited by 3
- 2026When Stale Constraints Go Unchecked: Budgeted Verification Failures in Inherited Agent Memorycited by 3
- 2026Revoked but Still Authoritative: An Empirical Study of Revocation Enforcement in Agent-Memory Systemscited by 1
- 2026Memory Consolidation Flattens the Temporal Shape of User Factscited by 1
- 2026ChurnBench: A Drift-Aware Benchmark Demonstrating That Refresh Scheduling, Not Cache Age, Governs Staleness in Agentic AIcited by 0
- 2026Epi-Logic: A Conceptual Framework for Epistemic Runtime Control, Schema Validity Checking, and Controlled Accommodation in Autonomous AI Agentscited by 0
- 2026Impact Is Not Invalidation: Ask About the Claim, Not the Diffcited by 0
- 2026Personalized State-Transition-Aware Memory for Clinical Agentscited by 0
- 2026StateWise: Diagnosing and Repairing Persistent Operational State Before Agent Actionscited by 0
- 2026MemStrata: 95% and 90.91% Source-Aware Accuracy on LongMemEval-500 and LoCoMo-1540 with a Local Qwen 3.8 27B Q4_K_M Readercited by 0
- 2026Stale, Misattributed, or Late: Where Personal Memory Fails Before Generation7 Oct 2026
- 2026When Old Facts Return: Re-Reads, Reverts, and the Limits of Temporal Memory6 Oct 2026
- 2026MemStrata: 95% and 90.91% Source-Aware Accuracy on LongMemEval-500 and LoCoMo-1540 with a Local Qwen 3.8 27B Q4_K_M Reader4 Oct 2026
- 2026StateWise: Diagnosing and Repairing Persistent Operational State Before Agent Actions4 Oct 2026
- 2026Personalized State-Transition-Aware Memory for Clinical Agents29 Sep 2026
- 2026Memory Consolidation Flattens the Temporal Shape of User Facts29 Sep 2026
- 2026Epi-Logic: A Conceptual Framework for Epistemic Runtime Control, Schema Validity Checking, and Controlled Accommodation in Autonomous AI Agents21 Sep 2026
- 2026Impact Is Not Invalidation: Ask About the Claim, Not the Diff20 Sep 2026
- 2026ChurnBench: A Drift-Aware Benchmark Demonstrating That Refresh Scheduling, Not Cache Age, Governs Staleness in Agentic AI10 Sep 2026
- 2026Revoked but Still Authoritative: An Empirical Study of Revocation Enforcement in Agent-Memory Systems8 Sep 2026
- 2026When Stale Constraints Go Unchecked: Budgeted Verification Failures in Inherited Agent Memory26 Aug 2026
- 2026MemTX: Transactional Belief Commit for Stateful Agent Memory27 Jul 2026
- 2026MemTX: Transactional Belief Commit for Stateful Agent Memorycited by 15
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 9
- 2026Ground Truth First: A Longitudinal Evaluation Instrument for Agent Memory, and the Tenure Crossover in Memory-Architecture Rankingscited by 3
- 2026When Stale Constraints Go Unchecked: Budgeted Verification Failures in Inherited Agent Memorycited by 3
- 2026Revoked but Still Authoritative: An Empirical Study of Revocation Enforcement in Agent-Memory Systemscited by 1
- 2026ChurnBench: A Drift-Aware Benchmark Demonstrating That Refresh Scheduling, Not Cache Age, Governs Staleness in Agentic AIcited by 0
- 2026Impact Is Not Invalidation: Ask About the Claim, Not the Diffcited by 0
- 2026Personalized State-Transition-Aware Memory for Clinical Agentscited by 0
- 2026Personalized State-Transition-Aware Memory for Clinical Agents29 Sep 2026
- 2026Impact Is Not Invalidation: Ask About the Claim, Not the Diff20 Sep 2026
- 2026ChurnBench: A Drift-Aware Benchmark Demonstrating That Refresh Scheduling, Not Cache Age, Governs Staleness in Agentic AI10 Sep 2026
- 2026Revoked but Still Authoritative: An Empirical Study of Revocation Enforcement in Agent-Memory Systems8 Sep 2026
- 2026When Stale Constraints Go Unchecked: Budgeted Verification Failures in Inherited Agent Memory26 Aug 2026
- 2026MemTX: Transactional Belief Commit for Stateful Agent Memory27 Jul 2026
- 2026Ground Truth First: A Longitudinal Evaluation Instrument for Agent Memory, and the Tenure Crossover in Memory-Architecture Rankings24 Jul 2026
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026
- 2026Memory Consolidation Flattens the Temporal Shape of User Factscited by 1
- 2026Epi-Logic: A Conceptual Framework for Epistemic Runtime Control, Schema Validity Checking, and Controlled Accommodation in Autonomous AI Agentscited by 0
- 2026MemStrata: 95% and 90.91% Source-Aware Accuracy on LongMemEval-500 and LoCoMo-1540 with a Local Qwen 3.8 27B Q4_K_M Readercited by 0
- 2026When Old Facts Return: Re-Reads, Reverts, and the Limits of Temporal Memorycited by 0
- 2026Stale, Misattributed, or Late: Where Personal Memory Fails Before Generationcited by 0
- 2026Stale, Misattributed, or Late: Where Personal Memory Fails Before Generation7 Oct 2026
- 2026When Old Facts Return: Re-Reads, Reverts, and the Limits of Temporal Memory6 Oct 2026
- 2026MemStrata: 95% and 90.91% Source-Aware Accuracy on LongMemEval-500 and LoCoMo-1540 with a Local Qwen 3.8 27B Q4_K_M Reader4 Oct 2026
- 2026Memory Consolidation Flattens the Temporal Shape of User Facts29 Sep 2026
- 2026Epi-Logic: A Conceptual Framework for Epistemic Runtime Control, Schema Validity Checking, and Controlled Accommodation in Autonomous AI Agents21 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026The Immutable Past: Formalizing State Mutability and Conflict Resolution in Mutable RAG
- 2026MemTrace: Probing What Final Accuracy Misses in Long-Term Memory
- 2026Beyond RAG for Agent Memory: Retrieval by Decoupling and Aggregation
- 2026Mitigating Provenance-Role Collapse in Long-Term Agents via Typed Memory Representation
- 2026Eywa: Provenance-Grounded Long-Term Memory for AI Agents
- 2026Less Context, More Accuracy: A Bi-Temporal Memory Engine for LLM Agents Where a Lean Retrieved Context Beats the Full History
- 2026Chronofy: A Temporal-Logical Decay Architecture for Information Validity in Time-Aware Retrieval-Augmented Generation
- 2026MemRetriever: Learning to Search, Reflect, and Retrieve from Long-Term Memory ↗