mlsanityData to 14 Oct 2026

AI Agents Need Memory Control Over More Context

arXiv 2601.11653 ↗First posted 15 Jan 2026q-bio.NC cs.LG cs.MAcited by 7

Not on the map. Why?

Abstract (arXiv)

AI agents are increasingly used in long, multi-turn workflows in both research and enterprise settings. As interactions grow, agent behavior often degrades due to loss of constraint focus, error accumulation, and memory-induced drift. This problem is especially visible in real-world deployments where context evolves, distractions are introduced, and decisions must remain consistent over time. A common practice is to equip agents with persistent memory through transcript replay or retrieval-based mechanisms. While convenient, these approaches introduce unbounded context growth and are vulnerable to noisy recall and memory poisoning, leading to unstable behavior and increased drift. In this work, we introduce the Agent Cognitive Compressor (ACC), a bio-inspired memory controller that replaces transcript replay with a bounded internal state updated online at each turn. ACC separates artifact recall from state commitment, enabling stable conditioning while preventing unverified content from becoming persistent memory. We evaluate ACC using an agent-judge-driven live evaluation framework that measures both task outcomes and memory-driven anomalies across extended interactions. Across scenarios spanning IT operations, cybersecurity response, and healthcare workflows, ACC consistently maintains bounded memory and exhibits more stable multi-turn behavior, with significantly lower hallucination and drift than transcript replay and retrieval-based agents. These results show that cognitive compression provides a practical and effective foundation for reliable memory control in long-horizon AI agents.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 19 of its 44 references that are in the map. First posted on arXiv 15 Jan 2026.

Builds on

19 of 44 references.

References · 19

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  6. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  7. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  8. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  9. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  10. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  11. 2024A Survey on LLM-as-a-Judgecited by 1,423
  12. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
7 more
  1. 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
  2. 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,103
  3. 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 897
  4. 2025Survey on Evaluation of LLM-based Agentscited by 204
  5. 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Surveycited by 57
  6. 2025Agentic Systems: A Guide to Transforming Industries with Vertical AI Agentscited by 20
  7. 2025Physical AI Agents: Integrating Cognitive Intelligence with Real-World Actioncited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.