LLM Agents Are Latent Context Managers: Eliciting Self-Managed Context via State Proprioception
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Long-horizon tool agents are bottlenecked by how their context grows toward the limits of the context window. Recent systems make context management agent- or system-controlled, but they either learn compression policies that discard evidence or manage context in a layer the agent never sees. We argue that both miss a more basic gap: frontier language models are proprioceptively blind to their own context. From the prompt alone they cannot reliably infer block size, recency, or the remaining budget, all of which are needed for keep-or-archive decisions. We introduce VISTA (Visible Internal State for Tool Agents), a training-free, model-agnostic layer that represents working memory as typed addressable blocks, surfaces a runtime dashboard of token usage, recency, archive status, and remaining budget, and archives blocks as recoverable full-fidelity payloads. On LOCA-Bench, BrowseComp-Plus, and GAIA, the same untrained interface transfers across 1M-, 100K-, and 10K-scale trajectories. On LOCA-Bench it lifts Gemini-3-Flash from 22.7 to 50.7%, reaches 58.0% on BrowseComp-Plus, and remains competitive on GAIA. Gains grow with context pressure and transfer across backbones, while ablations confirm that the dashboard matters beyond archive and recovery tools.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 45 of its 55 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
45 of 55 references.
Closest ancestors · 20
Same direction, newest first
- 2026Plans Don't Persist: Why Context Management Is Load Bearing for LLM Agents22 Jun
- 2026Learning Agent-Compatible Context Management for Long-Horizon Tasks29 May
- 2026Beyond Compaction: Structured Context Eviction for Long-Horizon Agents1 May
- 2026Contextual Agentic Memory is a Memo, Not True Memory30 Apr
- 2026GenericAgent: A Token-Efficient Self-Evolving LLM Agent via Contextual Information Density Maximization (V1.0)18 Apr
- 2026ContextBudget: Budget-Aware Context Management for Long-Horizon Search Agents2 Apr
- 2026AgentSwing: Adaptive Parallel Context Management Routing for Long-Horizon Web Agents29 Mar
- 2026Memex(RL): Scaling Long-Horizon LLM Agents via Indexed Experience Memory4 Mar
- 2026AMA-Bench: Evaluating Long-Horizon Memory for Agentic Applications26 Feb
- 2026PlugMem: A Task-Agnostic Plugin Memory Module for LLM Agents6 Feb
- 2026Learning Query-Aware Budget-Tier Routing for Runtime Agent Memory5 Feb
- 2026Active Context Compression: Autonomous Memory Management in LLM Agents12 Jan
8 more
- 2026SimpleMem: Efficient Lifelong Memory for LLM Agents5 Jan
- 2026Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agents5 Jan
- 2025Memory as Action: Autonomous Context Curation for Long-Horizon Agentic Tasks14 Oct
- 2025Scaling Long-Horizon LLM Agent via Context-Folding13 Oct
- 2025ACON: Optimizing Context Compression for Long-horizon LLM Agents1 Oct
- 2025ReSum: Unlocking Long-Horizon Search Intelligence via Context Summarization16 Sep
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
- 2024HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Model18 Aug
Other references · 25
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 183
- 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 68
- 2026Skill-Pro: Learning Reusable Skills from Experience via Non-Parametric PPO for LLM Agentscited by 44
- 2025Context as a Tool: Context Management for Long-Horizon SWE-Agentscited by 38
- 2026MEMENTO: Teaching LLMs to Manage Their Own Contextcited by 16
- 2025One Surrogate to Fool Them All: Universal, Transferable, and Targeted Adversarial Attacks with CLIPcited by 15
- 2026LOCA-bench: Benchmarking Language Agents Under Controllable and Extreme Context Growthcited by 12
- 2025Evidence for Limited Metacognition in LLMscited by 11
- 2025Lost in the Maze: Overcoming Context Limitations in Long-Horizon Agentic Searchcited by 11
- 2026Reasoning Cache: Continual Improvement Over Long Horizons via Short-Horizon RLcited by 11
13 more
- 2025CLIP-Guided Backdoor Defense through Entropy-Based Poisoned Dataset Separationcited by 9
- 2025From Samples to Scenarios: A New Paradigm for Probabilistic Forecastingcited by 8
- 2026The Missing Memory Hierarchy: Demand Paging for LLM Context Windowscited by 8
- 2026LongSeeker: Elastic Context Orchestration for Long-Horizon Search Agentscited by 8
- 2025Your LLM Agents are Temporally Blind: The Misalignment Between Tool Use Decisions and Human Time Perceptioncited by 7
- 2025Breaking the Stealth-Potency Trade-off in Clean-Image Backdoors with Generative Trigger Optimizationcited by 7
- 2026From Multi-Agent to Single-Agent: When Is Skill Distillation Beneficial?cited by 6
- 2026Masking Stale Observations Helps Search Agents -- Until It Doesn't: A Regime Map and Its Mechanismcited by 4
- 2026From Internal Diagnosis to External Auditing: A VLM-Driven Paradigm for Data-Free Online Backdoor Defensecited by 3
- 2026TokenPilot: Cache-Efficient Context Management for LLM Agentscited by 3
- 2026Architecting AgentOS: From Token-Level Context to Emergent System-Level Intelligencecited by 2
- 2026When Agent Automation Becomes Profitable: Quantifying and Insuring Autonomous AI Risk through Trace-Economic Underwritingcited by 2
- 2026Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Reviewcited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Less Context, More Accuracy: A Bi-Temporal Memory Engine for LLM Agents Where a Lean Retrieved Context Beats the Full History
- 2026PRO-LONG: Programmatic Memory Enables Long-Horizon Reasoning
- 2026ContextWeaver: Selective and Dependency-Structured Memory Construction for LLM Agents
- 2026Beyond Semantic Organization: Memory as Execution State Management for Long-Horizon Agents
- 2026Persistent Context Graphs for Efficient Memory Compaction in LLM Agents
- 2026Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers
- 2026Addressable Recall Compaction for Long Context-Window Control in AI Agents
- 2026PEEK: Context Map as an Orientation Cache for Long-Context LLM Agents