mlsanityData to 14 Oct 2026

Maximising Transparency in Context Compaction Improves Retention of Facts and Commitments for Lightweight Coding Agents

arXiv 2610.20116 ↗First posted 14 Oct 2026cs.AIcited by 0

On the map: LLM agents and tool use → Agent memory systems also fits: Web, search, and research agents

Abstract (arXiv)

Long coding agent sessions outgrow the model's context window, so agents compact: older history is replaced by something shorter, usually a model-written summary. A summary selects and rewords, and the agent cannot see what was lost. Existing work has explored a range of compaction techniques, but comparatively little attention has been paid to their effectiveness with lightweight models, including those deployed locally or used for high-volume workloads. Here, we present transparent-compact, a simple deterministic method for the open-source Pi coding agent, designed specifically for use with such models and with the purpose of maximising the transparency of the agent's view of its own compacted context. It guarantees that user and assistant prose in its context is unchanged by a model or algorithm, and explicitly flags where compaction has stripped information. We compare it with Pi's default model-written summary compaction and with pi-vcc, a popular deterministic method with similar methods but without verbatim retention of prose. Our benchmarks run on four models of varying performance levels, with emphasis on Qwen3.8-27B: a lightweight model at the top end of what consumer hardware can serve locally. On sets probing commitments (rules the user set which exist only in the conversation) and recall of facts, transparent-compact matched or outperformed both alternatives. In particular, it showed an advantage in avoiding confident blunders, i.e. assertion of false information as opposed to recognizing that something was not recalled. Even with a frontier model, its advantage was present but smaller. We argue that transparent-compact spares lightweight models from reasoning or searching their way around what compaction lost, and results in improved recall and application of information as a result, without the need for task or context-specific structuring of the session history.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 9 of its 21 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

9 of 21 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026How Do AI Agents Spend Your Money? Analyzing and Predicting Token Consumption in Agentic Coding Tasks24 Apr

Other references · 8

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  3. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  4. 2025The Complexity Trap: Simple Observation Masking Is as Efficient as LLM Summarization for Agent Context Managementcited by 48
  5. 2026Toward Reliable Context Compression for Long-Horizon Agents: An Empirical Study of Execution Instabilitycited by 10
  6. 2026Governance Decay: How Context Compaction Silently Erases Safety Constraints in Long-Horizon LLM Agentscited by 8
  7. 2026Omission Constraints Decay While Commission Constraints Persist in Long-Context LLM Agentscited by 5
  8. 2026View-oriented Conversation Compiler for Agent Trace Analysiscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CliffCompaction: Cost-Efficient Compaction for Long-Horizon Coding Agents
  2. 2026Prune the Summary, Not the History: Source-Judged Compaction for Long-Horizon Agents
  3. 2026Agent Retrieval Bench: Evaluating Repository Context Retrieval for Coding Agents
  4. 2025ACON: Optimizing Context Compression for Long-horizon LLM Agents
  5. 2026PACMS: Submodular Context Selection as a Pluggable Engine for LLM Agents
  6. 2026AgSpec: Pushing the Limits of Retrieval-Based Speculative Decoding in Coding Agent Pipelines
  7. 2026Compact Documentation for Coding Agents: A Benchmark, an Optimizer, and Why It Does Not Transfer
  8. 2026Self-Compacting Language Model Agents