AI Agents Need Memory Control Over More Context
Not on the map. Why?
Abstract (arXiv)
AI agents are increasingly used in long, multi-turn workflows in both research and enterprise settings. As interactions grow, agent behavior often degrades due to loss of constraint focus, error accumulation, and memory-induced drift. This problem is especially visible in real-world deployments where context evolves, distractions are introduced, and decisions must remain consistent over time. A common practice is to equip agents with persistent memory through transcript replay or retrieval-based mechanisms. While convenient, these approaches introduce unbounded context growth and are vulnerable to noisy recall and memory poisoning, leading to unstable behavior and increased drift. In this work, we introduce the Agent Cognitive Compressor (ACC), a bio-inspired memory controller that replaces transcript replay with a bounded internal state updated online at each turn. ACC separates artifact recall from state commitment, enabling stable conditioning while preventing unverified content from becoming persistent memory. We evaluate ACC using an agent-judge-driven live evaluation framework that measures both task outcomes and memory-driven anomalies across extended interactions. Across scenarios spanning IT operations, cybersecurity response, and healthcare workflows, ACC consistently maintains bounded memory and exhibits more stable multi-turn behavior, with significantly lower hallucination and drift than transcript replay and retrieval-based agents. These results show that cognitive compression provides a practical and effective foundation for reliable memory control in long-horizon AI agents.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 19 of its 44 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
19 of 44 references.
References · 19
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
7 more
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,103
- 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 897
- 2025Survey on Evaluation of LLM-based Agentscited by 204
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Surveycited by 57
- 2025Agentic Systems: A Guide to Transforming Industries with Vertical AI Agentscited by 20
- 2025Physical AI Agents: Integrating Cognitive Intelligence with Real-World Actioncited by 5
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026U-Fold: Dynamic Intent-Aware Context Folding for User-Centric Agentscited by 8
- 2026State Contamination in Memory-Augmented LLM Agentscited by 5
- 2026ProofAgent Harness: Open Infrastructure for Adversarial Evaluation of AI Agentscited by 4
- 2026Human-on-the-Bridge: Scalable Evaluation for AI Agentscited by 4
- 2026AI Agents Do Not Fail Alone:The Context Fails Firstcited by 2
- 2026Trustworthy Agent Network: Trust in Agent Networks Must Be Baked In, Not Bolted Oncited by 1
- 2026Security of OpenClaw Agents: Fundamentals, Attacks, and Countermeasurescited by 1
- 2026AI Agents Do Not Fail Alone:The Context Fails First15 Jul 2026
- 2026Human-on-the-Bridge: Scalable Evaluation for AI Agents15 Jun 2026
- 2026Security of OpenClaw Agents: Fundamentals, Attacks, and Countermeasures25 May 2026
- 2026ProofAgent Harness: Open Infrastructure for Adversarial Evaluation of AI Agents22 May 2026
- 2026Trustworthy Agent Network: Trust in Agent Networks Must Be Baked In, Not Bolted On18 May 2026
- 2026State Contamination in Memory-Augmented LLM Agents16 May 2026
- 2026U-Fold: Dynamic Intent-Aware Context Folding for User-Centric Agents26 Jan 2026