mlsanityData to 14 Oct 2026

Token Optimization and Context Window Management in Multi-Agent AI Workflows

arXiv 2608.17188 ↗First posted 17 Aug 2026cs.CL cs.AIcited by 0

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

Multi-agent AI workflows are limited not only by model quality but by token cost, latency, and context-window quality. This paper presents a practitioner framework for token optimization and context-window management, grounded in an internal production dashboard that extracts structured work items from meetings, email, and chat with LLMs and routes summaries across workstreams. Six patterns are described: context stratification, fetch-once/process-locally architecture, schema-contracted prompts, token-aware fallback chains, semantic caching, and inter-agent communication compression. In production they cut measured cold-load latency to 61-116 seconds (six timed runs) from an operational baseline of roughly 3.5-10.5 minutes, with an estimated 60-70% token reduction. It also reports a controlled context-composition study: 2,420 confirmatory trials across 11 model configurations, using 661 anonymized workplace items scored for relevance. Holding the prompt at a fixed ten items, replacing some high-relevance items with same-domain low-relevance items improves the model's relevance-score concordance on the target items, versus high-relevance items only; we call this relevance-contrast context. In the all-11 paired analysis, the 50:50 signal/noise condition improved relevance accuracy by +0.077 over the 100% condition (naive 95% CI [+0.056, +0.098], Cohen's d = 0.49, Holm-adjusted p < .001, n = 220). These cells are not independent; by the nine model families the effect is +0.084 (95% interval [+0.064, +0.103]), reported as a within-corpus descriptive comparison, not a population inference. A Fusion-of-N follow-up found that learned synthesis did not beat the mechanical set union of item IDs. The contribution is a measured engineering layer between model research and production agent practice: repeatable patterns and evaluation methods for faster, cheaper, more reliable workflows.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 0 of its 15 references that are in the map. First posted on arXiv 17 Aug 2026.

Builds on

0 of 15 references.

No references here yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Solving Context Window Overflow in AI Agents
  2. 2026Beyond Token Savings: A Systematic Study of Context Compression in LLM Agents
  3. 2026Less Context, Better Agents: Efficient Context Engineering for Long-Horizon Tool-Using LLM Agents
  4. 2025OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflows
  5. 2026Protocol-Preserving Context Trimming for Agentic Workflows: Benefits, Failure Regimes, and Budget Guardrails
  6. 2026ContextPipe: Database-Inspired Context Assembly for Long-Horizon Agents
  7. 2026ACM: Agentic Context Management for Long Horizon Tasks
  8. 2025WorkTeam: Constructing Workflows from Natural Language with Multi-Agents