Causal Memory Policy: Making Memory Utility Identifiable by Intervening on Retrieval
Not on the map. Why?
Abstract (arXiv)
Memory-augmented large language models must decide which memories to retain, and recent systems do so by estimating each memory's effect on task performance. However, these estimates rely entirely on retrieved memories. When a memory is never retrieved, store-level interventions produce identical outcomes, leaving its utility unidentified. This is a retrieval-level positivity violation, invisible to diagnostics that examine only memory operations. We introduce Causal Memory Policy (CMP), a causal framework that restores identification by intervening on retrieval itself, reserving a fixed number of context slots for memories sampled with known propensities. CMP estimates memory utility by self-normalized inverse propensity weighting under a balanced assignment design. We prove the causal factorization of memory utility through retrieval, the unbiasedness and exact variance of the estimator, and the optimal decision rule under irreversible operations. Empirically, identification fails for 54% of required memories on LongMemEval and 67% on LoCoMo, and the failure persists in a deployed memory system. CMP improves discrimination between required and non-required memories from 0.54 to 0.66 AUC. Finally, we show that identified memory utility alone is insufficient for retention decisions: per-query utility reaches 0.78 AUC on the query for which it is estimated, yet no aggregation available to a retention policy predicts a memory's value on unseen queries. Code is available at: https://anonymous.4open.science/r/cmp-release-D0C3/.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 61 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
37 of 61 references.
References · 37
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
- 2017Counterfactual Fairnesscited by 802
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 800
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 617
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
25 more
- 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactionscited by 236
- 2022Memorizing Transformerscited by 219
- 2023Augmenting Language Models with Long-Term Memorycited by 186
- 2016Unbiased Learning-to-Rank with Biased Feedbackcited by 155
- 2024ContextCite: Attributing Model Generation to Contextcited by 93
- 2023Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanationscited by 80
- 2019Degenerate Feedback Loops in Recommender Systemscited by 67
- 2024A Survey on Data Synthesis and Augmentation for Large Language Modelscited by 40
- 2023Memory Sandbox: Transparent and Interactive Memory Management for Conversational Agentscited by 36
- 2026STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?cited by 36
- 2024Model Internals-based Answer Attribution for Trustworthy Retrieval-Augmented Generationcited by 25
- 2026LongMemEval-V2: Evaluating Long-Term Agent Memory Toward Experienced Colleaguescited by 17
- 2026MemPO: Self-Memory Policy Optimization for Long-Horizon Agentscited by 11
- 2026SkillAudit: Ground-Truth-Free Skill Evolution via Paired Trajectory Auditingcited by 11
- 2024Graph Neural Network Causal Explanation via Neural Causal Modelscited by 8
- 2026Forget to Improve: On-Device LLM-Agent Continual Learning via Budget-Curated Memorycited by 8
- 2025Source Attribution in Retrieval-Augmented Generationcited by 7
- 2026Causal Intervention-Based Memory Selection for Long-Horizon LLM Agentscited by 6
- 2025REMI: A Novel Causal Schema Memory Architecture for Personalized Lifestyle Recommendation Agentscited by 4
- 2024Bio-inspired AI: Integrating Biological Complexity into Artificial Intelligencecited by 3
- 2025Measure-Theoretic Anti-Causal Representation Learningcited by 3
- 2025Do Data Valuations Make Good Data Prices?cited by 2
- 2024Handling incomplete outcomes and covariates in cluster-randomized trials: doubly-robust estimation, efficiency considerations, and sensitivity analysiscited by 1
- 2026When to Forget: A Memory Governance Primitivecited by 1
- 2026Don't Let Bandit Feedback Pull Continual LLM-Recommender Updates Off Targetcited by 1
Built on by
Not cited yet.