Agents Don't Paginate: First-Chunk Selection for LLM Tool Responses
On the map: LLM agents and tool use → Tool learning and function calling
Abstract (arXiv)
Coding agents built on large language models (LLMs), such as Claude Code, Cursor, OpenAI Codex, GitHub Copilot, and Aider, receive tool responses that routinely exceed the agent's per-turn token budget. The standard remedy, pagination, is available in every protocol that produced these responses; yet across the corpus of session logs from a public Model Context Protocol middleware we observed no agent-initiated requests for a second chunk. The first chunk is what the agent reads, so we ask how often the gold item (the one the agent needs) is placed first in it: the precision-at-1 rate p1. In a controlled offline benchmark we treat first-chunk selection as a 0/1 knapsack and compare six value functions on 500 SWE-bench Verified tasks, then test whether p1 matters with a single-turn file-localisation probe on five language models (4,800 LLM calls; not an end-to-end resolve-rate test). Two pre-registered hypotheses did not hold and are our main findings. The central one is negative: raising p1 does not systematically raise downstream accuracy. Per-model deltas stay under three percentage points (p.p.), are not consistently signed, and no model is significant; the agent recovers the gold from anywhere in the chunk, so what reaches its answer is first-chunk inclusion, not the gold's rank within it. The second: adding four file-metadata signals to a keyword scorer hurts p1 by 4.8 p.p. (paired significance test, p = 0.001). A parameter-free keyword scorer does raise p1, from a 24.2% baseline to 35.0% (+10.8 p.p., far beyond chance; p = 3.9 × 10-8), and to 35.8% with a fallback to the tool's native ordering when no keyword matches. But by our central finding this is a rank-1 gain, and rank-1 is the part that does not reach the agent's answer: downstream accuracy does not move.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 7 of its 17 references that are in the map. First posted on arXiv 23 Jun 2026.
Builds on
7 of 17 references.
References · 7
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,310
- 2022UniXcoder: Unified Cross-Modal Pre-training for Code Representationcited by 361
- 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 348
- 2025ACON: Optimizing Context Compression for Long-horizon LLM Agentscited by 136
- 2025Extending ResourceLink: Patterns for Large Dataset Processing in MCP Applicationscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026TraceLab: Characterizing Coding Agent Workloads for LLM Serving
- 2025LMR-BENCH: Evaluating LLM Agent's Ability on Reproducing Language Modeling Research
- 2026Utility-Guided Agent Orchestration for Efficient LLM Tool Use
- 2026DOCSCHISEL: Adaptive Tool Documentation Optimization Framework for LLM Agents
- 2026Action-Space Shaping for LLM Agents: Measuring and Mitigating Tool-Schema Bias
- 2026Curating Always-Loaded Context for LLM Agents: A Capacitated Assortment Model with Censored Feedback
- 2025ScaleMCP: Dynamic and Auto-Synchronizing Model Context Protocol Tools for LLM Agents
- 2026Beyond Token Savings: A Systematic Study of Context Compression in LLM Agents