Stale, Misattributed, or Late: Where Personal Memory Fails Before Generation
Not on the map. Why?
Abstract (arXiv)
Personal memory for language agents is usually judged by whether the final an- swer is correct. That score hides errors that arise before generation: the memory block may contain an obsolete value, a fact about the wrong person, or no use- ful fact before the serving deadline. We measure these failures directly. Using Personal Fact Memory (PFM) as a reference layer, we find that temporal validity is primarily a property of memory construction in our setting. On a controlled revision benchmark, serving only the active value of each correctly keyed slot eliminates observed stale exposure; without update resolution, 70.3% of prompts expose a superseded value. Once retrievers share the same active store and par- ticipant information, participant-aware BM25 is equivalent to the reference ranker within a prespecified 0.02 margin. The harder problem is assigning revisions to the right slot. Missed merges leave stale values active, whereas false merges silently remove current values; four LLM key assigners achieve higher key re- call than a rule extractor yet produce lower clean-retrieval rates, and open-domain merge recall on LongMemEval never exceeds 0.062. Misattribution survives va- lidity filtering: an entity posterior reduces same-name exposure on controlled data but cannot distinguish identically named speakers in LoCoMo. Two frozen lan- guage models reproduce prompt errors in generated text. Retrieval latency varies across rankers, but prompt prefill dominates turn-level latency on our hardware. These results argue for evaluating agent memory before generation, separating stored-state validity, identity resolution, abstention, and serving latency.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 28 references that are in the map. First posted on arXiv 7 Oct 2026.
Builds on
12 of 28 references.
References · 12
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
- 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
- 2026STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?cited by 36
- 2026Beyond Dialogue Time: Temporal Semantic Memory for Personalized LLM Agentscited by 14
- 2026Are We Ready For An Agent-Native Memory System?cited by 11
- 2026Temporal Validity in Retrieval Memory: Eliminating Stale-Fact Errors for AI Agents over Evolving Knowledgecited by 11
- 2026MemConflict: Evaluating Long-Term Memory Systems Under Memory Conflictscited by 10
- 2026TOKI: A Bitemporal Operator Algebra for Contradiction Resolution in LLM-Agent Persistent Memorycited by 7
- 2026MemTrace: Probing What Final Accuracy Misses in Long-Term Memorycited by 4
- 2026AgentIR: A Workload-Adaptive Cascade Retrieval Substrate for Long-Term Conversational Memorycited by 2
- 2025MUSE: A Heterogeneity-Aware Multimedia Search Engine for Mobile SoCscited by 1
Built on by
Not cited yet.