Sculptor: Empowering LLMs with Cognitive Agency via Active Context Management
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) suffer from significant performance degradation when processing long contexts due to proactive interference, where irrelevant information in earlier parts of the context disrupts reasoning and memory recall. While most research focuses on external memory systems to augment LLMs' capabilities, we propose a complementary approach: empowering LLMs with Active Context Management (ACM) tools to actively sculpt their internal working memory. We introduce Sculptor, a framework that equips LLMs with three categories of tools: (1) context fragmentation, (2) summary, hide, and restore, and (3) precise search. Our approach enables LLMs to proactively manage their attention and working memory, analogous to how humans selectively focus on relevant information while filtering out distractions. Experimental evaluation on diverse long-context benchmarks demonstrates that Sculptor significantly improves performance even without specific training, leveraging LLMs' inherent tool-calling and instruction-following capabilities. To further optimize these strategies, we introduce a novel dynamic context-aware reinforcement learning (RL) approach, advancing the training of an agent that actively modifies its own conversational history. By enabling Active Context Management, Sculptor not only mitigates proactive interference but also provides a cognitive foundation for more reliable reasoning across diverse long-context tasks-highlighting that explicit context-control strategies, rather than merely larger token windows, are key to robustness at scale.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 45 of its 54 references that are in the map. First posted on arXiv 6 Aug 2025.
Builds on
45 of 54 references.
References · 45
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
33 more
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
- 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 880
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
- 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 740
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
- 2024KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantizationcited by 591
- 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 453
- 2023Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Timecited by 439
- 2025Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attentioncited by 407
- 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 379
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
- 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 348
- 2023LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Modelscited by 287
- 2023RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentationcited by 256
- 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 246
- 2024BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystackcited by 215
- 2019Levenshtein Transformercited by 199
- 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 197
- 2023Compressing Context to Enhance Inference Efficiency of Large Language Modelscited by 189
- 2025MIRIX: Multi-Agent Memory System for LLM-Based Agentscited by 173
- 2024Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generationcited by 162
- 2025MemOS: A Memory OS for AI Systemcited by 138
- 2019Insertion Transformer: Flexible Sequence Generation via Insertion Operationscited by 125
- 2024SeerAttention: Learning Intrinsic Sparse Attention in Your LLMscited by 124
- 2024Found in the Middle: Calibrating Positional Attention Bias Improves Long Context Utilizationcited by 101
- 2024Michelangelo: Long Context Evaluations Beyond Haystacks via Latent Structure Queriescited by 88
- 2025MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Modelscited by 73
- 2025ACEBench: Who Wins the Match Point in Tool Usage?cited by 71
- 2025Learning without training: The implicit dynamics of in-context learningcited by 43
- 2024Memory3: Language Modeling with Explicit Memorycited by 40
- 2025Unable to Forget: Proactive Interference Reveals Working Memory Limits in LLMs Beyond Context Lengthcited by 20
- 2024Distance between Relevant Information Pieces Causes Bias in Long-Context LLMscited by 16
- 2025Learning to Focus: Causal Attention Distillation via Gradient-Guided Token Pruningcited by 13
Built on by
Citing papers per year: 2025: 1; 2026: 17.
18 papers.
Sort:
By area:
- 2026StructMem: Structured Memory for Long-Horizon Behavior in LLMscited by 18
- 2026SAM: State-Adaptive Memory for Long-Horizon Reasoning Agentcited by 10
- 2026An Empirical Study of Harness Design for Coding Agentscited by 6
- 2026Think Locally, Explain Globally: Graph-Guided LLM Investigations via Local Reasoning and Belief Propagationcited by 3
- 2026ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RLcited by 2
- 2025COSMIR: Chain Orchestrated Structured Memory for Iterative Reasoning over Long Contextcited by 1
- 2026Context Cartography: Toward Structured Governance of Contextual Space in Large Language Model Systemscited by 1
- 2026Remember Your Trace: Memory-Guided Long-Horizon Agentic Framework for Consistent and Hierarchical Repository-Level Code Documentationcited by 1
- 2026TRACER: Per-Tool Context Retention for LLM Agents via Consequence-Attributed Reinforcement Learningcited by 1
- 2026Memory Control Signals Emerge Before Action in Long Horizon Agentscited by 1
- 2026StateComp: Learning When to Compress History in Long Horizon Agentscited by 1
- 2026Context Language Modelscited by 1
6 more
- 2026DRSR: Learning Set-Level Deletion Risk for Efficient Long-Horizon Agentscited by 0
- 2026Stable Geometry with Divergent Task Evidence for Efficient Long-Horizon Agent Compressioncited by 0
- 2026Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agentscited by 0
- 2026Coding Agent Memory Post-training: Unlocking the Memory Potential of Pre-trained File Operations for Long-Horizon Tasks via Reinforcement Learningcited by 0
- 2026ContextRender: From Execution Dependencies to Agent Contextcited by 0
- 2026Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief Statescited by 0
- 2026Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief States1 Oct 2026
- 2026ContextRender: From Execution Dependencies to Agent Context29 Sep 2026
- 2026Context Language Models29 Sep 2026
- 2026Coding Agent Memory Post-training: Unlocking the Memory Potential of Pre-trained File Operations for Long-Horizon Tasks via Reinforcement Learning28 Sep 2026
- 2026Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents23 Sep 2026
- 2026Stable Geometry with Divergent Task Evidence for Efficient Long-Horizon Agent Compression23 Sep 2026
- 2026StateComp: Learning When to Compress History in Long Horizon Agents23 Sep 2026
- 2026Memory Control Signals Emerge Before Action in Long Horizon Agents23 Sep 2026
- 2026DRSR: Learning Set-Level Deletion Risk for Efficient Long-Horizon Agents23 Sep 2026
- 2026An Empirical Study of Harness Design for Coding Agents17 Sep 2026
- 2026TRACER: Per-Tool Context Retention for LLM Agents via Consequence-Attributed Reinforcement Learning29 Aug 2026
- 2026ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RL28 Aug 2026
6 more
- 2026SAM: State-Adaptive Memory for Long-Horizon Reasoning Agent23 May 2026
- 2026Remember Your Trace: Memory-Guided Long-Horizon Agentic Framework for Consistent and Hierarchical Repository-Level Code Documentation14 May 2026
- 2026StructMem: Structured Memory for Long-Horizon Behavior in LLMs23 Apr 2026
- 2026Context Cartography: Toward Structured Governance of Contextual Space in Large Language Model Systems21 Mar 2026
- 2026Think Locally, Explain Globally: Graph-Guided LLM Investigations via Local Reasoning and Belief Propagation25 Jan 2026
- 2025COSMIR: Chain Orchestrated Structured Memory for Iterative Reasoning over Long Context6 Oct 2025
- 2026An Empirical Study of Harness Design for Coding Agentscited by 6
- 2026ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RLcited by 2
- 2026Remember Your Trace: Memory-Guided Long-Horizon Agentic Framework for Consistent and Hierarchical Repository-Level Code Documentationcited by 1
- 2026Memory Control Signals Emerge Before Action in Long Horizon Agentscited by 1
- 2026StateComp: Learning When to Compress History in Long Horizon Agentscited by 1
- 2026Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agentscited by 0
- 2026Coding Agent Memory Post-training: Unlocking the Memory Potential of Pre-trained File Operations for Long-Horizon Tasks via Reinforcement Learningcited by 0
- 2026ContextRender: From Execution Dependencies to Agent Contextcited by 0
- 2026Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief Statescited by 0
- 2026Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief States1 Oct 2026
- 2026ContextRender: From Execution Dependencies to Agent Context29 Sep 2026
- 2026Coding Agent Memory Post-training: Unlocking the Memory Potential of Pre-trained File Operations for Long-Horizon Tasks via Reinforcement Learning28 Sep 2026
- 2026Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents23 Sep 2026
- 2026StateComp: Learning When to Compress History in Long Horizon Agents23 Sep 2026
- 2026Memory Control Signals Emerge Before Action in Long Horizon Agents23 Sep 2026
- 2026An Empirical Study of Harness Design for Coding Agents17 Sep 2026
- 2026ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RL28 Aug 2026
- 2026Remember Your Trace: Memory-Guided Long-Horizon Agentic Framework for Consistent and Hierarchical Repository-Level Code Documentation14 May 2026
- 2026StructMem: Structured Memory for Long-Horizon Behavior in LLMscited by 18
- 2026SAM: State-Adaptive Memory for Long-Horizon Reasoning Agentcited by 10
- 2026Think Locally, Explain Globally: Graph-Guided LLM Investigations via Local Reasoning and Belief Propagationcited by 3
- 2025COSMIR: Chain Orchestrated Structured Memory for Iterative Reasoning over Long Contextcited by 1
- 2026Context Cartography: Toward Structured Governance of Contextual Space in Large Language Model Systemscited by 1
- 2026TRACER: Per-Tool Context Retention for LLM Agents via Consequence-Attributed Reinforcement Learningcited by 1
- 2026DRSR: Learning Set-Level Deletion Risk for Efficient Long-Horizon Agentscited by 0
- 2026DRSR: Learning Set-Level Deletion Risk for Efficient Long-Horizon Agents23 Sep 2026
- 2026TRACER: Per-Tool Context Retention for LLM Agents via Consequence-Attributed Reinforcement Learning29 Aug 2026
- 2026SAM: State-Adaptive Memory for Long-Horizon Reasoning Agent23 May 2026
- 2026StructMem: Structured Memory for Long-Horizon Behavior in LLMs23 Apr 2026
- 2026Context Cartography: Toward Structured Governance of Contextual Space in Large Language Model Systems21 Mar 2026
- 2026Think Locally, Explain Globally: Graph-Guided LLM Investigations via Local Reasoning and Belief Propagation25 Jan 2026
- 2025COSMIR: Chain Orchestrated Structured Memory for Iterative Reasoning over Long Context6 Oct 2025
- 2026Context Language Modelscited by 1
- 2026Stable Geometry with Divergent Task Evidence for Efficient Long-Horizon Agent Compressioncited by 0
- 2026Context Language Models29 Sep 2026
- 2026Stable Geometry with Divergent Task Evidence for Efficient Long-Horizon Agent Compression23 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Escaping the Context Bottleneck: Active Context Curation for LLM Agents via Reinforcement Learning
- 2025Memory as Action: Autonomous Context Curation for Long-Horizon Agentic Tasks
- 2025Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topics
- 2023Empowering Working Memory for Large Language Model Agents
- 2026Memory in the LLM Era: Modular Architectures and Strategies in a Unified Framework
- 2026LLM Agents Are Latent Context Managers: Eliciting Self-Managed Context via State Proprioception
- 2026Verifiable Memory: Learning Unified Memory Management with Local and Global Verifiers for Large Language Model Agents
- 2026Continuous Context Management