Description-Code Inconsistency in Real-world MCP Servers: Measurement, Detection, and Security Implications
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
The Model Context Protocol (MCP) has emerged as a critical standard empowering Large Language Models (LLMs) to utilize external tools. In this ecosystem, LLMs rely on natural language descriptions provided by MCP servers to select and execute functions. This interaction implicitly assumes that tool descriptions faithfully reflect their underlying implementations, while this assumption is not mandatorily verified in practice. As a result, MCP deployments may suffer from a problem named Description-Code Inconsistency (DCI), where a tool's description of its capabilities and security boundaries is not consistent with what the code actually does. In this paper, we present a comprehensive study of DCI in real-world MCP servers. We formally define the problem and propose a comprehensive taxonomy spanning functionality inconsistencies and undeclared side effects. Guided by this taxonomy, we develop DCIChecker, an automated framework that combines structure-aware static analysis with the Direct-Reverse-Arbitration prompting method to cross-validate tool descriptions against actual code implementations. We apply this framework to a large-scale dataset comprising 19,200 description-code pairs extracted from 2,214 real-world MCP servers. Our measurement reveals that DCI is widespread, with 9.93% of these pairs exhibiting inconsistencies. We further demonstrate that DCI creates a critical defense blind spot, facilitating varied risks from operational failures to stealthy malicious behaviors. Finally, we propose mitigation strategies to enforce semantic consistency and enhance the reliability of the emerging agentic ecosystem.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 14 of its 38 references that are in the map. First posted on arXiv 3 Jun 2026.
Builds on
14 of 38 references.
Closest ancestors · 4
Same direction, newest first
- 2026Don't believe everything you read: Understanding and Measuring MCP Behavior under Misleading Tool Descriptions3 Feb
- 2025A Measurement Study of Model Context Protocol Ecosystem29 Sep
- 2025MCPTox: A Benchmark for Tool Poisoning Attack on Real-World MCP Servers19 Aug
- 2025MCPSecBench: A Systematic Security Benchmark and Playground for Testing Model Context Protocols17 Aug
Other references · 10
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 568
- 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
- 2025LLMs in Software Security: A Survey of Vulnerability Detection Techniques and Insightscited by 44
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Real Faults in Model Context Protocol (MCP) Software: a Comprehensive Taxonomy
- 2026A Taxonomy of Runtime Faults in Model Context Protocol Servers
- 2026An Empirical Study of Model Context Protocol Applications
- 2026MCP-in-SoS: Risk assessment framework for open-source MCP servers
- 2025MCP-SafetyBench: A Benchmark for Safety Evaluation of Large Language Models with Real-World MCP Servers
- 2025A First Look at the Security Issues in the Model Context Protocol Ecosystem
- 2026Mitigating Taint-Style Vulnerabilities in MCP Servers via Security-Aware Tool Descriptions
- 2025MCPGuard : Automatically Detecting Vulnerabilities in MCP Servers