mlsanityData to 14 Oct 2026

Real Faults in Model Context Protocol (MCP) Software: a Comprehensive Taxonomy

arXiv 2603.05637 ↗First posted 5 Mar 2026cs.SEcited by 6

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

The rapid adoption of foundation models has significantly expanded the capabilities of software systems, enabling them to perform complex language, reasoning, and interaction tasks that were previously difficult to automate. However, this progress has also introduced novel challenges that were largely absent in previous generations of software. In particular, the increasing integration of foundation models with external tools and resources raises new concerns regarding reliability, security, and robustness. The Model Context Protocol (MCP) has recently been proposed to standardize interactions between AI-based software systems, software tools, and external resources. Despite its growing adoption, there remains limited systematic understanding of real-world faults in MCP-based software systems. In this paper, we present the first large-scale taxonomy of faults in MCP servers, comprising five high-level fault categories derived from empirical evidence. To evaluate the completeness and generalizability of this taxonomy, we conduct a survey of MCP practitioners with diverse roles and experience levels. The results confirm that all identified fault categories occur in practice and reveal distinct characteristics that differentiate MCP-specific faults from non-MCP faults. Overall, this study provides actionable insights for researchers and practitioners by identifying the most error-prone and critical components of MCP-based systems. These insights can inform the development of more robust, reliable, and secure AI-enabled software systems that rely on MCP.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 42 of its 183 references that are in the map. First posted on arXiv 5 Mar 2026.

Builds on

42 of 183 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025A survey of agent interoperability protocols: Model Context Protocol (MCP), Agent Communication Protocol (ACP), Agent-to-Agent Protocol (A2A), and Agent Network Protocol (ANP)4 May

Other references · 41

  1. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  2. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  3. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
  4. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
  5. 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 801
  6. 2023A Comprehensive Overview of Large Language Modelscited by 648
  7. 2023Large Language Models in Finance: A Surveycited by 226
  8. 2025MMTEB: Massive Multilingual Text Embedding Benchmarkcited by 125
  9. 2024FinCon: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Makingcited by 113
  10. 2025A Survey on Code Generation with LLM-based Agentscited by 106
  11. 2025MCP-Universe: Benchmarking Large Language Models with Real-World Model Context Protocol Serverscited by 96
  12. 2025Gemini Embedding: Generalizable Embeddings from Geminicited by 94
29 more
  1. 2019Taxonomy of Real Faults in Deep Learning Systemscited by 90
  2. 2025Model Context Protocol (MCP) at First Glance: Studying the Security and Maintainability of MCP Serverscited by 65
  3. 2024Bugs in Large Language Models Generated Code: An Empirical Studycited by 60
  4. 2025LiveMCPBench: Can Agents Navigate an Ocean of MCP Tools?cited by 48
  5. 2025ScaleMCP: Dynamic and Auto-Synchronizing Model Context Protocol Tools for LLM Agentscited by 36
  6. 2025MCP-AgentBench: Evaluating Real-World Language Agent Performance with MCP-Mediated Toolscited by 32
  7. 2025AI Agentic Programming: A Survey of Techniques, Challenges, and Opportunitiescited by 28
  8. 2025A Study of LLMs' Preferences for Libraries and Programming Languagescited by 20
  9. 2025LiveMCP-101: Stress Testing and Diagnosing MCP-enabled Agents on Challenging Queriescited by 17
  10. 2022Bugs in Machine Learning-based Systems: A Faultload Benchmarkcited by 15
  11. 2024Large Language Models for Human-like Autonomous Driving: A Surveycited by 14
  12. 2023Exploring the Problems, their Causes and Solutions of AI Pair Programming: A Study on GitHub and Stack Overflowcited by 11
  13. 2021Predicting Issue Types on GitHubcited by 10
  14. 2023Bug Characterization in Machine Learning-based Systemscited by 10
  15. 2025Failure Modes in LLM Systems: A System-Level Taxonomy for Reliable AI Applicationscited by 10
  16. 2025A Taxonomy of Prompt Defects in LLM Systemscited by 8
  17. 2026When Agents Fail: A Comprehensive Study of Bugs in LLM Agents with Automated Labelingcited by 6
  18. 2023Common Challenges of Deep Reinforcement Learning Applications Development: An Empirical Studycited by 5
  19. 2025A First Look at Bugs in LLM Inference Enginescited by 5
  20. 2017Survey Research in Software Engineering: Problems and Strategiescited by 4
  21. 2022Understanding Quantum Software Engineering Challenges An Empirical Study on Stack Exchange Forums and GitHub Issuescited by 4
  22. 2022Studying the Characteristics of AIOps Projects on GitHubcited by 4
  23. 2024Fault Localization in Deep Learning-based Software: A System-level Approachcited by 4
  24. 2025The Foundation Cracks: A Comprehensive Study on Bugs and Testing Practices in LLM Librariescited by 3
  25. 2020Descriptions of issues and comments for predicting issue success in software projectscited by 1
  26. 2022Automatic Issue Classifier: A Transfer Learning Framework for Classifying Issue Reportscited by 1
  27. 2025Towards Automated Detection of Inline Code Comment Smellscited by 1
  28. 2025Exploring Zero-Shot App Review Classification with ChatGPT: Challenges and Potentialcited by 1
  29. 2025Evaluating Classical Software Process Models as Coordination Mechanisms for LLM-Based Software Generationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Taxonomy of Runtime Faults in Model Context Protocol Servers
  2. 2026Description-Code Inconsistency in Real-world MCP Servers: Measurement, Detection, and Security Implications
  3. 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions
  4. 2026Understanding How Enterprises Adopt the Model Context Protocol for LLM-Driven Software Engineering
  5. 2026MCP-in-SoS: Risk assessment framework for open-source MCP servers
  6. 2026An Empirical Study of Model Context Protocol Applications
  7. 2025MCIP: Protecting MCP Safety via Model Contextual Integrity Protocol
  8. 2026Don't believe everything you read: Understanding and Measuring MCP Behavior under Misleading Tool Descriptions