LLM within MCP Matters: Measuring Inefficient Resource Utilization Driven by LLMs
On the map: LLM agents and tool use → Tool learning and function calling
Abstract (arXiv)
The Model Context Protocol (MCP) standardizes how servers expose data and tools to Large Language Models (LLMs). A common server design embeds frequently used reference data, such as identifier lookup tables, directly in the server instructions: the system-prompt text a server hands to the host application. When a query concerns an entry of the embedded table, the model can act on it immediately instead of re-discovering the same information through a search tool. We test whether client LLMs actually consume such instruction-embedded data, reporting a 54,000-trial study across 24 LLMs (9 Claude, 6 Gemini, 9 GPT) on a production legal-information MCP server. A diagnostic condition that removes the competing search tool shows that failures are dominated by behavioral preference rather than missing capability. With search unavailable, 23 of 24 models read the embedded data reliably (hit ratio at least 98%); with a search tool merely present, 9 models drop below 15%. A 2^3 factorial analysis of three instruction-level interventions reveals strong interaction effects: combining all three restores at least 86% for 20 of 24 models, but individual interventions can backfire for specific model families. Per-server prompt engineering is therefore a workaround rather than a fix; we argue that MCP host applications should provide an explicit mechanism that places server instructions ahead of tool selection in the client LLM's deliberation.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 5 of its 11 references that are in the map. First posted on arXiv 9 Aug 2026.
Builds on
5 of 11 references.
Closest ancestors · 3
Same direction, newest first
- 2025Tool Preferences in Agentic LLMs are Unreliable23 May
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs31 Jul
- 2023Toolformer: Language Models Can Teach Themselves to Use Tools9 Feb
Other references · 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Help or Hurdle? Rethinking Model Context Protocol-Augmented Large Language Models
- 2026Understanding How Enterprises Adopt the Model Context Protocol for LLM-Driven Software Engineering
- 2025A Measurement Study of Model Context Protocol Ecosystem
- 2025Network and Systems Performance Characterization of MCP-Enabled LLM Agents
- 2026An Empirical Study of Model Context Protocol Applications
- 2025Can LLM Infer Risk Information From MCP Server System Logs?
- 2026MCP-Atlas: A Large-Scale Benchmark for Tool-Use Competency with Real MCP Servers
- 2025A First Look at the Security Issues in the Model Context Protocol Ecosystem