Quantifying Conversation Drift in MCP via Latent Polytope
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
The Model Context Protocol (MCP) enhances large language models (LLMs) by integrating external tools, enabling dynamic aggregation of real-time data to improve task execution. However, its non-isolated execution context introduces critical security and privacy risks. In particular, adversarially crafted content can induce tool poisoning or indirect prompt injection, leading to conversation hijacking, misinformation propagation, or data exfiltration. Existing defenses, such as rule-based filters or LLM-driven detection, remain inadequate due to their reliance on static signatures, computational inefficiency, and inability to quantify conversational hijacking. To address these limitations, we propose SecMCP, a secure framework that detects and quantifies conversation drift, deviations in latent space trajectories induced by adversarial external knowledge. By modeling LLM activation vectors within a latent polytope space, SecMCP identifies anomalous shifts in conversational dynamics, enabling proactive detection of hijacking, misleading, and data exfiltration. We evaluate SecMCP on three state-of-the-art LLMs (Llama3, Vicuna, Mistral) across benchmark datasets (MS MARCO, HotpotQA, FinQA), demonstrating robust detection with AUROC scores exceeding 0.915 while maintaining system usability. Our contributions include a systematic categorization of MCP security threats, a novel latent polytope-based methodology for quantifying conversation drift, and empirical validation of SecMCP's efficacy.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 16 of its 29 references that are in the map. First posted on arXiv 8 Aug 2025.
Builds on
16 of 29 references.
Closest ancestors · 3
Same direction, newest first
- 2025We Should Identify and Mitigate Third-Party Safety Risks in MCP-Powered Agent Systems16 Jun
- 2025MCP Safety Audit: LLMs with the Model Context Protocol Allow Major Security Exploits2 Apr
- 2025RTBAS: Defending LLM Agents Against Prompt Injection and Privacy Leakage13 Feb
Other references · 13
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
- 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
- 2023LLM Self Defense: By Self Examination, LLMs Know They Are Being Trickedcited by 244
- 2025Steering Large Language Model Activations in Sparse Spacescited by 58
- 2024Signed-Prompt: A New Approach to Prevent Prompt Injection Attacks Against LLM-Integrated Applicationscited by 54
- 2025PromptShield: Deployable Detection for Prompt Injection Attackscited by 50
- 2025SAE-SSV: Supervised Steering in Sparse Representation Spaces for Reliable Control of Language Modelscited by 29
- 2025Securing GenAI Multi-Agent Systems Against Tool Squatting: A Zero Trust Registry-Based Approachcited by 18
1 more
- 2025ControlNET: A Firewall for RAG-based LLM Systemcited by 12
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026SMCP: Secure Model Context Protocolcited by 5
- 2026ActBench: Self-Evolving Benchmark of Behavioral Safety in Cowork Agentscited by 0
- 2026ActBench: Self-Evolving Benchmark of Behavioral Safety in Cowork Agents10 Aug 2026
- 2026SMCP: Secure Model Context Protocol1 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026PrivDrift: Auditing User-Secret Leakage Under Topic Drift in Active LLM Conversations
- 2026Latent Adversarial Detection: Adaptive Probing of LLM Activations for Multi-Turn Attack Detection
- 2026TRACE: Trajectory Aware Reasoning for Multi-Turn Adversarial Conversation Evaluation
- 2025MCP-Guard: A Multi-Stage Defense-in-Depth Framework for Securing Model Context Protocol in Agentic AI
- 2024Securing Multi-turn Conversational Language Models From Distributed Backdoor Triggers
- 2026Stateful Guardrails for Multi-Turn LLM Systems: A Conversational Risk Accumulation Framework
- 2026Beyond Unsafe Detection: Counterfactually Anchored Evidence Attribution for Multi-Turn LLM Safety Failures
- 2026PsychoPass: Geometric Profiling of Multi-Turn Adversarial LLM Conversations