mlsanityData to 14 Oct 2026

Hiding in the AI Traffic: Abusing MCP for LLM-Powered Agentic Red Teaming

arXiv 2511.15998 ↗First posted 20 Nov 2025cs.CR cs.AIcited by 4

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

Generative AI is reshaping offensive cybersecurity by enabling autonomous red team agents that can plan, execute, and adapt during penetration tests. However, existing approaches face trade-offs between generality and specialization, and practical deployments reveal challenges such as hallucinations, context limitations, and ethical concerns. In this work, we introduce a novel command & control (C2) architecture leveraging the Model Context Protocol (MCP) to coordinate distributed, adaptive reconnaissance agents covertly across networks. Notably, we find that our architecture not only improves goal-directed behavior of the system as whole, but also eliminates key host and network artifacts that can be used to detect and prevent command & control behavior altogether. We begin with a comprehensive review of state-of-the-art generative red teaming methods, from fine-tuned specialist models to modular or agentic frameworks, analyzing their automation capabilities against task-specific accuracy. We then detail how our MCP-based C2 can overcome current limitations by enabling asynchronous, parallel operations and real-time intelligence sharing without periodic beaconing. We furthermore explore advanced adversarial capabilities of this architecture, its detection-evasion techniques, and address dual-use ethical implications, proposing defensive measures and controlled evaluation in lab settings. Experimental comparisons with traditional C2 show drastic reductions in manual effort and detection footprint. We conclude with future directions for integrating autonomous exploitation, defensive LLM agents, predictive evasive maneuvers, and multi-agent swarms. The proposed MCP-enabled C2 framework demonstrates a significant step toward realistic, AI-driven red team operations that can simulate advanced persistent threats while informing the development of next-generation defensive systems.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 25 of its 44 references that are in the map. First posted on arXiv 20 Nov 2025.

Builds on

25 of 44 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025RedTeamLLM: an Agentic AI framework for offensive security11 May
  2. 2025VulnBot: Autonomous Penetration Testing for A Multi-Agent Collaborative Framework23 Jan
  3. 2024HackSynth: LLM Agent and Evaluation Framework for Autonomous Penetration Testing2 Dec
  4. 2024PentestAgent: Incorporating LLM Agents to Automated Penetration Testing7 Nov
  5. 2024LLM Agents can Autonomously Exploit One-day Vulnerabilities11 Apr

Other references · 20

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
  5. 2025Why Do Multi-Agent LLM Systems Fail?cited by 604
  6. 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 332
  7. 2018The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigationcited by 165
  8. 2023PentestGPT: An LLM-empowered Automatic Penetration Testing Toolcited by 97
  9. 2024AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attackscited by 96
  10. 2024Large Language Models for Cyber Security: A Systematic Literature Reviewcited by 68
  11. 2021The Threat of Offensive AI to Organizationscited by 38
  12. 2021The Challenge of Value Alignment: from Fairer Algorithms to AI Safetycited by 35
8 more
  1. 2025Forewarned is Forearmed: A Survey on Large Language Model-based Agents in Autonomous Cyberattackscited by 16
  2. 2025On the Surprising Efficacy of LLMs for Penetration-Testingcited by 10
  3. 2024CIPHER: Cybersecurity Intelligent Penetration-testing Helper for Ethical Researchercited by 6
  4. 2025Assessing and Enhancing the Robustness of LLM-based Multi-Agent Systems Through Chaos Engineeringcited by 6
  5. 2025A Unified Framework for Human AI Collaboration in Security Operations Centers with Trusted Autonomycited by 6
  6. 2025PenTest++: Elevating Ethical Hacking with AI and Automationcited by 5
  7. 2024A Survey on Offensive AI Within Cybersecuritycited by 3
  8. 2025Towards Supporting Penetration Testing Education with Large Language Models: an Evaluation and Comparisoncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Red Teaming Framework for Evaluating Robustness of AI-enabled Security Orchestration, Automation, and Response Systems
  2. 2025Red Teaming AI Red Teaming
  3. 2025Security Challenges in AI Agent Deployment: Insights from a Large Scale Public Competition
  4. 2026AgenticRed: Evolving Agentic Systems for Red-Teaming
  5. 2026Securing the AI Agent: A Unified Framework for Multi-Layer Agent Red Teaming
  6. 2026Red-Teaming the Agentic Red-Team
  7. 2026Autonomous Adversary: Red-Teaming in the age of LLM
  8. 2024Against The Achilles' Heel: A Survey on Red Teaming for Generative Models