mlsanityData to 14 Oct 2026

Sculptor: Empowering LLMs with Cognitive Agency via Active Context Management

arXiv 2508.04664 ↗First posted 6 Aug 2025cs.CL cs.AI cs.LGcited by 18

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) suffer from significant performance degradation when processing long contexts due to proactive interference, where irrelevant information in earlier parts of the context disrupts reasoning and memory recall. While most research focuses on external memory systems to augment LLMs' capabilities, we propose a complementary approach: empowering LLMs with Active Context Management (ACM) tools to actively sculpt their internal working memory. We introduce Sculptor, a framework that equips LLMs with three categories of tools: (1) context fragmentation, (2) summary, hide, and restore, and (3) precise search. Our approach enables LLMs to proactively manage their attention and working memory, analogous to how humans selectively focus on relevant information while filtering out distractions. Experimental evaluation on diverse long-context benchmarks demonstrates that Sculptor significantly improves performance even without specific training, leveraging LLMs' inherent tool-calling and instruction-following capabilities. To further optimize these strategies, we introduce a novel dynamic context-aware reinforcement learning (RL) approach, advancing the training of an agent that actively modifies its own conversational history. By enabling Active Context Management, Sculptor not only mitigates proactive interference but also provides a cognitive foundation for more reliable reasoning across diverse long-context tasks-highlighting that explicit context-control strategies, rather than merely larger token windows, are key to robustness at scale.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 45 of its 54 references that are in the map. First posted on arXiv 6 Aug 2025.

Builds on

45 of 54 references.

References · 45

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  5. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  6. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  7. 2020Longformer: The Long-Document Transformercited by 3,413
  8. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  9. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
  10. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  11. 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
  12. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
33 more
  1. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
  2. 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 880
  3. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
  4. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 740
  5. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
  6. 2024KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantizationcited by 591
  7. 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 453
  8. 2023Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Timecited by 439
  9. 2025Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attentioncited by 407
  10. 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 379
  11. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
  12. 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 348
  13. 2023LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Modelscited by 287
  14. 2023RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentationcited by 256
  15. 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 246
  16. 2024BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystackcited by 215
  17. 2019Levenshtein Transformercited by 199
  18. 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 197
  19. 2023Compressing Context to Enhance Inference Efficiency of Large Language Modelscited by 189
  20. 2025MIRIX: Multi-Agent Memory System for LLM-Based Agentscited by 173
  21. 2024Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generationcited by 162
  22. 2025MemOS: A Memory OS for AI Systemcited by 138
  23. 2019Insertion Transformer: Flexible Sequence Generation via Insertion Operationscited by 125
  24. 2024SeerAttention: Learning Intrinsic Sparse Attention in Your LLMscited by 124
  25. 2024Found in the Middle: Calibrating Positional Attention Bias Improves Long Context Utilizationcited by 101
  26. 2024Michelangelo: Long Context Evaluations Beyond Haystacks via Latent Structure Queriescited by 88
  27. 2025MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Modelscited by 73
  28. 2025ACEBench: Who Wins the Match Point in Tool Usage?cited by 71
  29. 2025Learning without training: The implicit dynamics of in-context learningcited by 43
  30. 2024Memory3: Language Modeling with Explicit Memorycited by 40
  31. 2025Unable to Forget: Proactive Interference Reveals Working Memory Limits in LLMs Beyond Context Lengthcited by 20
  32. 2024Distance between Relevant Information Pieces Causes Bias in Long-Context LLMscited by 16
  33. 2025Learning to Focus: Causal Attention Distillation via Gradient-Guided Token Pruningcited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 17.

18 papers.

Sort:

By area:

  1. 2026StructMem: Structured Memory for Long-Horizon Behavior in LLMscited by 18
  2. 2026SAM: State-Adaptive Memory for Long-Horizon Reasoning Agentcited by 10
  3. 2026An Empirical Study of Harness Design for Coding Agentscited by 6
  4. 2026Think Locally, Explain Globally: Graph-Guided LLM Investigations via Local Reasoning and Belief Propagationcited by 3
  5. 2026ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RLcited by 2
  6. 2025COSMIR: Chain Orchestrated Structured Memory for Iterative Reasoning over Long Contextcited by 1
  7. 2026Context Cartography: Toward Structured Governance of Contextual Space in Large Language Model Systemscited by 1
  8. 2026Remember Your Trace: Memory-Guided Long-Horizon Agentic Framework for Consistent and Hierarchical Repository-Level Code Documentationcited by 1
  9. 2026TRACER: Per-Tool Context Retention for LLM Agents via Consequence-Attributed Reinforcement Learningcited by 1
  10. 2026Memory Control Signals Emerge Before Action in Long Horizon Agentscited by 1
  11. 2026StateComp: Learning When to Compress History in Long Horizon Agentscited by 1
  12. 2026Context Language Modelscited by 1
6 more
  1. 2026DRSR: Learning Set-Level Deletion Risk for Efficient Long-Horizon Agentscited by 0
  2. 2026Stable Geometry with Divergent Task Evidence for Efficient Long-Horizon Agent Compressioncited by 0
  3. 2026Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agentscited by 0
  4. 2026Coding Agent Memory Post-training: Unlocking the Memory Potential of Pre-trained File Operations for Long-Horizon Tasks via Reinforcement Learningcited by 0
  5. 2026ContextRender: From Execution Dependencies to Agent Contextcited by 0
  6. 2026Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief Statescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Escaping the Context Bottleneck: Active Context Curation for LLM Agents via Reinforcement Learning
  2. 2025Memory as Action: Autonomous Context Curation for Long-Horizon Agentic Tasks
  3. 2025Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topics
  4. 2023Empowering Working Memory for Large Language Model Agents
  5. 2026Memory in the LLM Era: Modular Architectures and Strategies in a Unified Framework
  6. 2026LLM Agents Are Latent Context Managers: Eliciting Self-Managed Context via State Proprioception
  7. 2026Verifiable Memory: Learning Unified Memory Management with Local and Global Verifiers for Large Language Model Agents
  8. 2026Continuous Context Management