mlsanityData to 7 Oct 2026

State Compression in Two-Agent LLM Relays: A Closed-World Study of Constraint Preservation

arXiv 2607.18265 ↗First posted 20 May 2026cs.AI cs.CLcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Long-running Large Language Model (LLM)-based agents often accumulate large intermediate traces containing audits, eliminations, and numeric calculations. In practice, this state is compressed before handing it to a downstream decision step, creating an information bottleneck in which small omissions can break strict numeric or categorical constraints. This paper evaluates hand-off compression in a closed-world travel-planning relay with two LLM agents. A Researcher audits a fixed inventory of hotels and flights for 50 goal instances, and a Booker selects a hotel--flight pair using only the goal and the hand-off payload, with the inventory withheld. We compare four hand-off conditions: no compression, narrative summarization, schema-constrained JSON extraction, and embedding-based pruning. Exhaustive enumeration over the fixed inventory provides exact feasible and optimal labels. Results show that hand-off representation strongly affects downstream feasibility under a small decision model. JSON extraction achieves the highest feasibility accuracy at 0.96, while narrative summarization, despite producing the smallest compressed hand-off payload, degrades feasibility to 0.48. Embedding-based pruning matches the uncompressed control on feasibility at 0.88 without an additional generative compression call. These findings indicate that constraint checking benefits from structured and auditable hand-off representations rather than relying on brevity alone.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 11 of its 12 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

11 of 12 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering9 Apr

Other references · 10

  1. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  2. 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 443
  3. 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 402
  4. 2024Long-context LLMs Struggle with Long In-context Learningcited by 285
  5. 2023LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Modelscited by 279
  6. 2023Compressing Context to Enhance Inference Efficiency of Large Language Modelscited by 185
  7. 2025ACON: Optimizing Context Compression for Long-horizon LLM Agentscited by 126
  8. 2026Memory in the LLM Era: Modular Architectures and Strategies in a Unified Frameworkcited by 12
  9. 2026Lightweight LLM Agent Memory with Small Language Modelscited by 12
  10. 2024Mitigating Hallucination with ZeroG: An Advanced Knowledge Management Enginecited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026When "Must" Becomes "Maybe": Constraint Weakening in LLM Agent Workflows
  2. 2025COMPASS: Benchmarking Constrained Optimization in LLM Agents
  3. 2026Beyond Token Savings: A Systematic Study of Context Compression in LLM Agents
  4. 2026The Handoff Tax: Continuing Non-Native Trajectories in LLM Agents
  5. 2026FOCUS: Training-Free Decision-Preserving Context Compression for LLM Agents
  6. 2025Analyzing Information Sharing and Coordination in Multi-Agent Planning
  7. 2025Can Compressed LLMs Truly Act? An Empirical Evaluation of Agentic Capabilities in LLM Compression
  8. 2025Optimizing LLMs for Resource-Constrained Environments: A Survey of Model Compression Techniques