TRACER: Per-Tool Context Retention for LLM Agents via Consequence-Attributed Reinforcement Learning
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Enterprise data agents answer business queries by chaining many tool calls over multiple reasoning steps, routinely accumulating hundreds of thousands of context tokens per session. Existing compression strategies typically allocate retention budgets without accounting for the downstream consequences of removing individual tool outputs. Aggressive compression may therefore trigger costly tool re-invocations that offset the initial savings. We call this the compression--consequence gap. To close it, we propose TRACER, which formulates compression as a sequential per-tool decision problem. A lightweight REINFORCE policy assigns query-conditioned retention ratios using only information available at each compression event. Its consequence-aware objective jointly accounts for task success, total token consumption, and post-compression tool re-invocations. To improve credit assignment, TRACER uses a learned outcome model to compare the predicted consequences of the selected retention ratio with those of fully retaining each tool output. On held-out production queries across three compressor backends, TRACER reduces total token consumption by 29--46% relative to keeping all context while maintaining comparable or higher task success. Compared with a tool-type-conditional static policy, TRACER provides an additional 15--18% of token savings. Interventional rollouts show that the learned per-tool credit scores correlate with measured single-tool consequences. The learned policy also yields positive savings when transferred across agent backbones and compressor architectures, and reduces token consumption by 18--25% on five held-out LOCA-bench environments. These results demonstrate the value of consequence-aware, per-tool context retention for improving the efficiency of long-horizon language agents.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 19 of its 30 references that are in the map. First posted on arXiv 29 Aug 2026.
Builds on
19 of 30 references.
Closest ancestors · 1
Same direction, newest first
- 2025Enhancing Agentic RL with Progressive Reward Shaping and Value-based Sampling Policy Optimization8 Dec
Other references · 18
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2017Counterfactual Multi-Agent Policy Gradientscited by 751
- 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 453
- 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 348
- 2018RUDDER: Return Decomposition for Delayed Rewardscited by 173
- 2025ACON: Optimizing Context Compression for Long-horizon LLM Agentscited by 136
- 2025Scaling LLM Multi-turn RL with End-to-end Summarization-based Context Managementcited by 51
- 2025Sculptor: Empowering LLMs with Cognitive Agency via Active Context Managementcited by 18
- 2026Learning Agent-Compatible Context Management for Long-Horizon Taskscited by 15
- 2026LOCA-bench: Benchmarking Language Agents Under Controllable and Extreme Context Growthcited by 14
- 2026CM2: Reinforcement Learning with Checklist Rewards for Multi-Turn and Multi-Step Agentic Tool Usecited by 14
6 more
- 2024Understanding Individual Agent Importance in Multi-Agent System via Counterfactual Reasoningcited by 11
- 2026Verifiable Process Rewards for Agentic Reasoningcited by 11
- 2026When Denser Credit Is Not Enough: Evidence-Calibrated Policy Optimization for Long-Horizon LLM Agent Trainingcited by 7
- 2026Learning When Not to Act: Mitigating Tool Abuse in Agentic Reinforcement Learningcited by 4
- 2026AGORA: Adapter-Grounded Observation-Action Retention for Inference-Free Prompt Compression in LLM Agentscited by 2
- 2026Tool-Aware Optimization with Entropy Guidance for Efficient Agentic Reinforcement Learningcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond Token Savings: A Systematic Study of Context Compression in LLM Agents
- 2026Control Under Compression: Reliability Frontiers for Tool-Using Agents
- 2026Scores Are Not Decisions: Cost-Aware Stopping for Tool Acquisition in LLM Agents
- 2026FOCUS: Training-Free Decision-Preserving Context Compression for LLM Agents
- 2026Squeez: Task-Conditioned Tool-Output Pruning for Coding Agents
- 2026Rethinking the Role of Entropy in Optimizing Tool-Use Behaviors for Large Language Model Agents
- 2026Toward Reliable Context Compression for Long-Horizon Agents: An Empirical Study of Execution Instability
- 2026ToolAtlas: Learning Once, Reusing Everywhere with Tool-Side Memory