mlsanityData to 7 Oct 2026

AGORA: Adapter-Grounded Observation-Action Retention for Inference-Free Prompt Compression in LLM Agents

arXiv 2605.26596 ↗First posted 26 May 2026cs.AIcited by 1

On the map: LLM agents and tool use → Agent memory systems

also in 1 more
Abstract (arXiv)

The token-level extractive compressors widely used for general LM context are structurally inappropriate for LLM agents: across 17 (env, backbone, method) cells spanning two independent token-level method families, every cell collapses to mean reward <= 0.05 despite 1.3-13.3x realized compression. We name and characterize this failure mode as action-grammar destruction -- the tokens carrying action semantics (identifiers, brackets, action verbs) are exactly those self-information ranks lowest, so a general-purpose compressor reliably removes them and the environment rejects the residual. The diagnosis points to step-granularity compression. We introduce AGORA, an inference-free step-level compressor combining a structural prompt parser, an always-keep floor for format- and recency-critical content, and a 125M-parameter relevance scorer trained on counterfactual next-action-change labels (~2ms/step, zero per-step LLM toll). Across the compared inference-free and LLM-based methods, AGORA is the only one retaining >= 75% uncompressed performance in 8 of 9 cells (with the lone exception at 73%); a four-way component ablation isolates the structural floor as the dominant quality lever and the learned scorer as the source of 1.0-11.5x adaptive end-to-end compression from a single fixed keep ratio.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 9 of its 37 references that are in the map. First posted on arXiv 26 May 2026.

Builds on

9 of 37 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025ACON: Optimizing Context Compression for Long-horizon LLM Agents1 Oct

Other references · 8

  1. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  2. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  3. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
  4. 2023In-context Autoencoder for Context Compression in a Large Language Modelcited by 190
  5. 2024Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Modelscited by 90
  6. 2025Reducing Cost of LLM Agents with Trajectory Reductioncited by 44
  7. 2025The Complexity Trap: Simple Observation Masking Is as Efficient as LLM Summarization for Agent Context Managementcited by 40
  8. 2025Relevance Isn't All You Need: Scaling RAG Systems With Inference-Time Compute Via Multi-Criteria Rerankingcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Can Compressed LLMs Truly Act? An Empirical Evaluation of Agentic Capabilities in LLM Compression
  2. 2026FOCUS: Training-Free Decision-Preserving Context Compression for LLM Agents
  3. 2026ActKV: Efficient LLM Agents through Action-Guided KV Cache Management
  4. 2025CompactPrompt: A Unified Pipeline for Prompt Data Compression in LLM Workflows
  5. 2026Adapting Context Compression for Long-Horizon Agents with Counterfactual Continuations
  6. 2026Latent Action Reparameterization for Efficient Agent Inference
  7. 2026Compressed-Sensing-Guided, Inference-Aware Structured Reduction for Large Language Models
  8. 2026Beyond Token Savings: A Systematic Study of Context Compression in LLM Agents