mlsanityData to 7 Oct 2026

Stale, Misattributed, or Late: Where Personal Memory Fails Before Generation

arXiv 2610.10265 ↗First posted 7 Oct 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Personal memory for language agents is usually judged by whether the final an- swer is correct. That score hides errors that arise before generation: the memory block may contain an obsolete value, a fact about the wrong person, or no use- ful fact before the serving deadline. We measure these failures directly. Using Personal Fact Memory (PFM) as a reference layer, we find that temporal validity is primarily a property of memory construction in our setting. On a controlled revision benchmark, serving only the active value of each correctly keyed slot eliminates observed stale exposure; without update resolution, 70.3% of prompts expose a superseded value. Once retrievers share the same active store and par- ticipant information, participant-aware BM25 is equivalent to the reference ranker within a prespecified 0.02 margin. The harder problem is assigning revisions to the right slot. Missed merges leave stale values active, whereas false merges silently remove current values; four LLM key assigners achieve higher key re- call than a rule extractor yet produce lower clean-retrieval rates, and open-domain merge recall on LongMemEval never exceeds 0.062. Misattribution survives va- lidity filtering: an entity posterior reduces same-name exposure on controlled data but cannot distinguish identically named speakers in LoCoMo. Two frozen lan- guage models reproduce prompt errors in generated text. Retrieval latency varies across rankers, but prompt prefill dominates turn-level latency on our hardware. These results argue for evaluating agent memory before generation, separating stored-state validity, identity resolution, abstention, and serving latency.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 28 references that are in the map. First posted on arXiv 7 Oct 2026.

Builds on

12 of 28 references.

References · 12

  1. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  2. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
  3. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
  4. 2026STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?cited by 36
  5. 2026Beyond Dialogue Time: Temporal Semantic Memory for Personalized LLM Agentscited by 14
  6. 2026Are We Ready For An Agent-Native Memory System?cited by 11
  7. 2026Temporal Validity in Retrieval Memory: Eliminating Stale-Fact Errors for AI Agents over Evolving Knowledgecited by 11
  8. 2026MemConflict: Evaluating Long-Term Memory Systems Under Memory Conflictscited by 10
  9. 2026TOKI: A Bitemporal Operator Algebra for Contradiction Resolution in LLM-Agent Persistent Memorycited by 7
  10. 2026MemTrace: Probing What Final Accuracy Misses in Long-Term Memorycited by 4
  11. 2026AgentIR: A Workload-Adaptive Cascade Retrieval Substrate for Long-Term Conversational Memorycited by 2
  12. 2025MUSE: A Heterogeneity-Aware Multimedia Search Engine for Mobile SoCscited by 1

Built on by

Not cited yet.