Presentation, Not Mechanism: A Render Confound in Deprecation-Aware Memory Evaluation
Not on the map. Why?
Abstract (arXiv)
AI systems increasingly retrieve from records that revise themselves: issue threads, encyclopedic histories, policy logs, and long conversations. The challenge is not only finding relevant evidence, but deciding which claims remain in force, which were superseded, and when to abstain. Structured memories promise to solve this with typed edges, temporal updates, and conflict status, yet evaluations often change mechanism and prompt presentation together. We study this as Evidence-State Revision, comparing flat retrieval, coarse edge invalidation, and fine-grained RevisionLedger on 2,907 high-agreement questions from GitHub, multi-repo issue histories, Wikipedia, and DyKnow-style temporal streams. A render-matched control (same layout, deprecation disabled) reveals the central confound: when a value is changed and later restored, RevisionLedger appears to beat a flat baseline by +0.182, but almost all the gain comes from easier presentation; the fine-grained mechanism residual is indistinguishable from zero (+0.021 to +0.025 across two judge families). After presentation is controlled, coarse invalidation is the only mechanism that pays for current-state queries, beating the fine ledger by 0.084; the same query-sufficiency principle says provenance mainly needs retained invalidated evidence, not richer typing. Memory evaluations should hold render fixed, and deprecation-aware systems should deploy the coarsest retained state that covers their queries.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 27 of its 44 references that are in the map. First posted on arXiv 17 Jul 2026.
Builds on
27 of 44 references.
References · 27
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
- 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
- 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 333
- 2021Time-Aware Language Models as Temporal Knowledge Basescited by 290
- 2024The Power of Noise: Redefining Retrieval for RAG Systemscited by 275
- 2024Knowledge Conflicts for LLMs: A Surveycited by 274
- 2025AbstentionBench: Reasoning LLMs Fail on Unanswerable Questionscited by 129
- 2022StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Modelscited by 123
15 more
- 2024FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows"cited by 85
- 2024ConflictBank: A Benchmark for Evaluating the Influence of Knowledge Conflicts in LLMcited by 73
- 2021Optimal strategies for reject option classifierscited by 61
- 2020Classification with Rejection Based on Cost-sensitive Classificationcited by 55
- 2024WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipediacited by 43
- 2024RAGGED: Towards Informed Design of Scalable and Stable RAG Systemscited by 24
- 2025Forgetful but Faithful: A Cognitive Memory Architecture and Benchmark for Privacy-Aware Generative Agentscited by 12
- 2025Stronger Baselines for Retrieval-Augmented Generation with Long-Context Language Modelscited by 9
- 2025Classifying and Addressing the Diversity of Errors in Retrieval-Augmented Generation Systemscited by 9
- 2026Graph-Native Cognitive Memory for AI Agents: Formal Belief Revision Semantics for Versioned Memory Architecturescited by 9
- 2025A Fano-Style Accuracy Upper Bound for LLM Single-Pass Reasoning in Multi-Hop QAcited by 8
- 2026Memanto: Typed Semantic Memory with Information-Theoretic Retrieval for Long-Horizon Agentscited by 6
- 2026WorldDB: A Vector Graph-of-Worlds Memory Engine with Ontology-Aware Write-Time Reconciliationcited by 3
- 2026MemRouter: Memory-as-Embedding Routing for Long-Term Conversational Agentscited by 3
- 2026SelRoute: Query-Type-Aware Routing for Long-Term Conversational Memory Retrievalcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.