Memory Compression for High-Fanout Agent Sandboxes
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
High-fanout agent workloads create a growing memory bottleneck because a single task may spawn many concurrent sandbox sessions. Yet these sandboxes are far from independent: they originate from a shared template and execute related trajectories, exposing substantial template-relative and cross-sandbox memory redundancy. Conventional memory compression is poorly matched to this setting in three fundamental dimensions: how to compress, because they fail to exploit similarity across non-identical sandbox pages; what to compress, because they control page-fault overhead through conservative page selection; and when to compress, because compression is either triggered by memory pressure or performed without awareness of agent execution phases. We present AgentZip, the first memory compression system designed specifically for AI-agent sandboxes. AgentZip introduces compression mechanisms that exploit both the template-relative and cross-sandbox redundancy. It broadens the compression scope to any page with a profitable representation and shifts overhead control from compression-time page selection to restore-time prefetching. It further aligns expensive compression with LLM waiting periods to avoid interfering with foreground tool execution. Across LLM training and inference workloads, AgentZip reduces sandbox-owned memory by up to 8.7x, compared with 2.1x for the Linux configuration. Restore prefetching and agent-execution-aware scheduling reduce the slowdown of aggressive compression from as high as 3.1x to 1.40x while retaining nearly all of its memory-saving benefit.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 8 of its 23 references that are in the map. First posted on arXiv 10 Sep 2026.
Builds on
8 of 23 references.
References · 8
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agentscited by 140
- 2026ProRL Agent: Rollout-as-a-Service for RL Training of Multi-Turn LLM Agentscited by 17
- 2026Chimera: Latency- and Performance-Aware Multi-agent Serving for Heterogeneous LLMscited by 4
- 2024Triangel: A High-Performance, Accurate, Timely On-Chip Temporal Prefetchercited by 2
- 2025Integrating Prefetcher Selection with Dynamic Request Allocation Improves Prefetching Efficiencycited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond Token Savings: A Systematic Study of Context Compression in LLM Agents
- 2026A Self-Evolving Framework for Efficient Terminal Agents via Observational Context Compression
- 2026AgentCgroup: Understanding and Controlling OS Resources of AI Agents
- 2026Experience Compression Spectrum: Unifying Memory, Skills, and Rules in LLM Agents
- 2026AgentCompress: Task-Aware Compression for Affordable Large Language Model Agents
- 2026ActKV: Efficient LLM Agents through Action-Guided KV Cache Management
- 2026Just-In-Time Agent Memory with Runtime Agentic Research
- 2026SkillZip: Contract-Preserving Graph Compression for Scalable Agent Skill Libraries