The Memory Curse: How Expanded Recall Erodes Cooperative Intent in LLM Agents
On the map: LLM agents and tool use → Reinforcement learning for LLM agents
Abstract (arXiv)
Context window expansion is often treated as a straightforward capability upgrade for LLMs, but we find it systematically fails in multi-agent social dilemmas. Across 7 LLMs and 4 games over 500 rounds, expanding accessible history degrades cooperation in 18 of 28 model--game settings, a pattern we term the memory curse. We isolate the underlying mechanism through three analyses. First, lexical analysis of 378,000 reasoning traces associates this breakdown with eroding forward-looking intent rather than rising paranoia. We validate this using targeted fine-tuning as a cognitive probe: a LoRA adapter trained exclusively on forward-looking traces mitigates the decay and transfers zero-shot to distinct games. Second, memory sanitization holds prompt length fixed while replacing visible history with synthetic cooperative records, which restores cooperation substantially, proving the trigger is memory content, not length alone. Finally, ablating explicit Chain-of-Thought reasoning often reduces the collapse, showing that deliberation paradoxically amplifies the memory curse. Together, these results recast memory as an active determinant of multi-agent behavior: longer recall can either destabilize or support cooperation depending on the reasoning patterns it elicits.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 15 of its 21 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
15 of 21 references.
References · 15
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 373
- 2014Memory Networkscited by 354
- 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactionscited by 236
- 2023Playing repeated games with Large Language Modelscited by 213
- 2024Cooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agentscited by 120
- 2025MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agentscited by 82
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026Bridging Reasoning Trajectories in On-Policy Distillation via Near-Future Guidancecited by 12
- 2026Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillationcited by 11
- 2026Cross-Model LLM Code Review: Should you use Claude to review Codex or vice versa?cited by 2
- 2026When Should Active RAG Retrieve? A Budget-Aware Evaluation of Utility, Calibration, and Costcited by 2
- 2026Toward User-Conditioned Evaluation of Personal LLM Agents under Temporal Interventionscited by 1
- 2026Evidence-Unit Fairness and the Limits of Query-Adaptive Sparse-Dense Fusion in Financial Document Retrievalcited by 1
- 2026Symbolic Reasoning Frameworks Trigger Memory-Mediated Ecosystem Dynamics in Multi-Agent LLM Systemscited by 0
- 2026Benchmarking the Residual: What Long-Horizon Evaluations Add Beyond Matched Short-Task Performancecited by 0
- 2026Explicit State Elicitation Is Not Enough: A Controlled Audit of Memory-Policy Classificationcited by 0
- 2026Toward Workflow-Aware Benchmarking for Healthcare NLP Agentscited by 0
- 2026Toward Workflow-Aware Benchmarking for Healthcare NLP Agents31 Aug 2026
- 2026Explicit State Elicitation Is Not Enough: A Controlled Audit of Memory-Policy Classification18 Aug 2026
- 2026Evidence-Unit Fairness and the Limits of Query-Adaptive Sparse-Dense Fusion in Financial Document Retrieval31 Jul 2026
- 2026Benchmarking the Residual: What Long-Horizon Evaluations Add Beyond Matched Short-Task Performance29 Jul 2026
- 2026When Should Active RAG Retrieve? A Budget-Aware Evaluation of Utility, Calibration, and Cost27 Jul 2026
- 2026Cross-Model LLM Code Review: Should you use Claude to review Codex or vice versa?22 Jul 2026
- 2026Toward User-Conditioned Evaluation of Personal LLM Agents under Temporal Interventions20 Jul 2026
- 2026Bridging Reasoning Trajectories in On-Policy Distillation via Near-Future Guidance29 May 2026
- 2026Symbolic Reasoning Frameworks Trigger Memory-Mediated Ecosystem Dynamics in Multi-Agent LLM Systems22 May 2026
- 2026Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillation10 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Sparks of Cooperative Reasoning: LLMs as Strategic Hanabi Agents
- 2026EquiMem: Calibrating Shared Memory in Multi-Agent Debate via Game-Theoretic Equilibrium
- 2026The Epistemics of Agent Memory: Measuring, and Governing, the Consolidation Decision in Long-Horizon LLM Agents
- 2026Readable Minds: Emergent Theory-of-Mind-Like Behavior in LLM Poker Agents
- 2026LLMs Are Not Good Strategists, Yet Memory-Enhanced Agency Boosts Reasoning
- 2026How memory can affect collective and cooperative behaviors in an LLM-Based Social Particle Swarm
- 2026Governed Collaborative Memory as Artificial Selection in LLM-Based Multi-Agent Systems
- 2025How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behavior