mlsanityData to 7 Oct 2026

The Compaction Cliff in Long-Running AI Agent Memory

arXiv 2608.22752 ↗First posted 24 Aug 2026cs.AI cs.IRcited by 1

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

A safety rule and an episodic log compete for the same tokens in an AI agent's context. When the budget overflows, both are summarized at the same rate; only the rule needs exact wording to remain enforceable. On 20 production agent configurations, Claude Code's /compact prompt on Sonnet 4.6 preserves 53% of safety rules after one compaction round and 10% after five. We name this the Compaction Cliff. We address it with Knowledge Triage, a framework that classifies each line of an agent's knowledge base by type and routes each type through its own retention policy. Three deterministic operators implement this triage across the three context-management operations: TypeCompact rewrites items in place under per-type fidelity, TypeDecompose partitions a topic too large to compact safely, replicating in-scope safety rules across partitions, and TypeRetrieve fetches items from external storage with in-scope rules pinned ahead of relevance. On five public corpora, TypeCompact preserves 2--4× more safety rules than the strongest single-shot LLM compactor at every ratio, with 96% recall over five rounds. TypeDecompose reaches 0% locality violations against 93% under uniform partitioning. TypeRetrieve reaches 100% recall@50 against 73% for the best single-shot LLM retriever. On three downstream behavioral benchmarks, we outperform the production Sonnet compactor on medical compliance (paired McNemar p < 10-8 on preservation, N = 200), the full-policy and hierarchical baselines on retail task pass rate (p < 0.01, N = 115), and the hierarchical compaction on the airline domain (p = 0.024). We release AgentArtifactCorpus (396,934 agent configurations from 54,628 public GitHub repositories), the classifier, and the reference implementation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 28 of its 41 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

28 of 41 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Graph-Native Cognitive Memory for AI Agents: Formal Belief Revision Semantics for Versioned Memory Architectures18 Mar
  2. 2025An Information Theoretic Perspective on Agentic System Design25 Dec
  3. 2025Forgetful but Faithful: A Cognitive Memory Architecture and Benchmark for Privacy-Aware Generative Agents14 Dec
  4. 2025How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behavior21 May
  5. 2025A-MEM: Agentic Memory for LLM Agents17 Feb

Other references · 23

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  3. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
  4. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  5. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
  6. 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,378
  7. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  8. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  9. 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,270
  10. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  11. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
  12. 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 578
11 more
  1. 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 441
  2. 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 343
  3. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agentscited by 268
  4. 2023RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentationcited by 253
  5. 2024xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Tokencited by 123
  6. 2024PersonaRAG: Enhancing Retrieval-Augmented Generation Systems with User-Centric Agentscited by 28
  7. 2025Adaptive Focus Memory for Language Modelscited by 6
  8. 2024QUITO-X: A New Perspective on Context Compression from the Information Bottleneck Theorycited by 3
  9. 2026OwlerLite: Scope- and Freshness-Aware Web Retrieval for LLM Assistantscited by 3
  10. 2026Hierarchical Memory Orchestration for Personalized Persistent Agentscited by 3
  11. 2026Metadata, Structure, or Strategy? A Decomposition of RAG Context Enrichmentcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Epistemics of Agent Memory: Measuring, and Governing, the Consolidation Decision in Long-Horizon LLM Agents
  2. 2026AI Guardrail Survival under Single-Cycle Agentic Self-Summarization
  3. 2026Self-Compacting Language Model Agents
  4. 2026Governance Decay: How Context Compaction Silently Erases Safety Constraints in Long-Horizon LLM Agents
  5. 2026Addressable Recall Compaction for Long Context-Window Control in AI Agents
  6. 2026Agentic Context Management: Solving Agent Memory and Cost by Treating Them as Lifecycle and Architecture Problems
  7. 2026Tool Specifications Matter: Uncovering and Mitigating Safety Risks in AI Agents
  8. 2026Beyond Compaction: Structured Context Eviction for Long-Horizon Agents