AGORA: Adapter-Grounded Observation-Action Retention for Inference-Free Prompt Compression in LLM Agents
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
The token-level extractive compressors widely used for general LM context are structurally inappropriate for LLM agents: across 17 (env, backbone, method) cells spanning two independent token-level method families, every cell collapses to mean reward <= 0.05 despite 1.3-13.3x realized compression. We name and characterize this failure mode as action-grammar destruction -- the tokens carrying action semantics (identifiers, brackets, action verbs) are exactly those self-information ranks lowest, so a general-purpose compressor reliably removes them and the environment rejects the residual. The diagnosis points to step-granularity compression. We introduce AGORA, an inference-free step-level compressor combining a structural prompt parser, an always-keep floor for format- and recency-critical content, and a 125M-parameter relevance scorer trained on counterfactual next-action-change labels (~2ms/step, zero per-step LLM toll). Across the compared inference-free and LLM-based methods, AGORA is the only one retaining >= 75% uncompressed performance in 8 of 9 cells (with the lone exception at 73%); a four-way component ablation isolates the structural floor as the dominant quality lever and the learned scorer as the source of 1.0-11.5x adaptive end-to-end compression from a single fixed keep ratio.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 9 of its 37 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
9 of 37 references.
Closest ancestors · 1
Same direction, newest first
Other references · 8
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
- 2023In-context Autoencoder for Context Compression in a Large Language Modelcited by 190
- 2024Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Modelscited by 90
- 2025Reducing Cost of LLM Agents with Trajectory Reductioncited by 44
- 2025The Complexity Trap: Simple Observation Masking Is as Efficient as LLM Summarization for Agent Context Managementcited by 40
- 2025Relevance Isn't All You Need: Scaling RAG Systems With Inference-Time Compute Via Multi-Criteria Rerankingcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Can Compressed LLMs Truly Act? An Empirical Evaluation of Agentic Capabilities in LLM Compression
- 2026FOCUS: Training-Free Decision-Preserving Context Compression for LLM Agents
- 2026ActKV: Efficient LLM Agents through Action-Guided KV Cache Management
- 2025CompactPrompt: A Unified Pipeline for Prompt Data Compression in LLM Workflows
- 2026Adapting Context Compression for Long-Horizon Agents with Counterfactual Continuations
- 2026Latent Action Reparameterization for Efficient Agent Inference
- 2026Compressed-Sensing-Guided, Inference-Aware Structured Reduction for Large Language Models
- 2026Beyond Token Savings: A Systematic Study of Context Compression in LLM Agents