CADOC: Cache-Aware Dynamic Object Context for Long-Horizon Agents
Not on the map. Why?
Abstract (arXiv)
For a long-horizon agent, context is the bottleneck: the history is resent with every request, the window caps task length, and reasoning degrades as the history grows. Replacing structured objects with compact retrieval Cards shortens the prompt and keeps the exact originals retrievable, but editing the history can break prefix-cache reuse, and prior recoverable methods time their edits by forecasts of future reuse or by preset intervals. We propose CADOC (Cache-Aware Dynamic Object Context), an online algorithm that replaces structured objects with compact Cards while preserving exact, on-demand retrieval of their original contents. CADOC schedules replacements in batches by balancing accumulated waiting cost against shared cache-reconstruction cost. Its scheduling rule follows from an economic order quantity trade-off, recovers the optimal integer batch under stationary assumptions. Across evaluation, CADOC consistently achieves the lowest aggregate input cost among the compared configurations, which reduces input cost by approximately 40% on average while maintaining task performance close to full context. CADOC thus provides a cost-derived approach to compressible context management, demonstrating that efficient compression depends not only on shortening prompts but also on scheduling edits to preserve cache reuse.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 20 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
15 of 20 references.
References · 15
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agentscited by 238
- 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 148
- 2025ReSum: Unlocking Long-Horizon Search Intelligence via Context Summarizationcited by 141
- 2025ACON: Optimizing Context Compression for Long-horizon LLM Agentscited by 136
- 2025The Complexity Trap: Simple Observation Masking Is as Efficient as LLM Summarization for Agent Context Managementcited by 48
- 2026LongMemEval-V2: Evaluating Long-Term Agent Memory Toward Experienced Colleaguescited by 23
- 2026Don't Break the Cache: An Evaluation of Prompt Caching for Long-Horizon Agentic Taskscited by 19
- 2026ContextBudget: Budget-Aware Context Management for Long-Horizon Search Agentscited by 14
- 2026Self-GC: Self-Governing Context for Long-Horizon LLM Agentscited by 11
3 more
- 2026The Missing Memory Hierarchy: Demand Paging for LLM Context Windowscited by 8
- 2026LCM: Lossless Context Managementcited by 4
- 2026TokenPilot: Cache-Efficient Context Management for LLM Agentscited by 3
Built on by
Not cited yet.