Evaluating Budgeted Context Projection with Unexecuted Companion Runs
Not on the map. Why?
Abstract (arXiv)
Context projection can shorten individual requests while changing whether an agent finishes within its budget. We examine how sequential evaluation obscures this trade-off when a capped first continuation prevents its companion from running. In a recorded ReVerPi source-reading campaign, 15 pairs with two final answers yield 12 historically scored successes per arm. Retaining all 27 intervention boundaries distinguishes observed failures from ten unexecuted companions and bounds projected-minus-full success between -9 and +1 tasks. Under the archived scoring contract, a frozen projection selector has a success difference from full context of [-3,0]; outside four fitting tasks, it is [-4,-1] across 23 boundaries. Excluding one task whose platform premise is not established by retained actor-input evidence changes the nonfitting range to [-3,0] across 22 boundaries, so strict inferiority is not robust to that exclusion. Among eleven historically joint-success pairs, projection uses 25% fewer aggregate logical tokens but more tokens for the median pair and 55 rather than 35 suffix requests. These retrospective results concern one adaptively assembled campaign, not population performance. The case motivates accounting that retains every boundary, preserves unknown outcomes and policy dependencies, checks task premises, and separates bounded completion from success-conditioned resource use.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 28 references that are in the map. First posted on arXiv 25 Sep 2026.
Builds on
13 of 28 references.
References · 13
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2021Deep Reinforcement Learning at the Edge of the Statistical Precipicecited by 781
- 2023LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Modelscited by 279
- 2024AI Agents That Mattercited by 199
- 2025ACON: Optimizing Context Compression for Long-horizon LLM Agentscited by 126
- 2023Unlocking Context Constraints of LLMs: Enhancing Context Efficiency of LLMs with Self-Information-Based Content Filteringcited by 62
- 2025The Complexity Trap: Simple Observation Masking Is as Efficient as LLM Summarization for Agent Context Managementcited by 40
- 2026Toward Reliable Context Compression for Long-Horizon Agents: An Empirical Study of Execution Instabilitycited by 5
- 2026Token Reduction Is Not Cost Reductioncited by 2
1 more
Built on by
Not cited yet.