mlsanityData to 14 Oct 2026

A Survey of LLM-Driven AI Agent Communication: Protocols, Security Risks, and Defense Countermeasures

arXiv 2506.19676 ↗First posted 24 Jun 2025cs.CRcited by 57

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

In recent years, Large-Language-Model-driven AI agents have exhibited unprecedented intelligence and adaptability. Nowadays, agents are undergoing a new round of evolution. They no longer act as an isolated island like LLMs. Instead, they start to communicate with diverse external entities, such as other agents and tools, to perform complex tasks. Under this trend, agent communication is regarded as a foundational pillar of the next communication era, and many organizations have intensively begun to design related communication protocols (e.g., Anthropic's MCP and Google's A2A) within the past year. However, this new field exposes significant security hazards, which can cause severe damage to real-world scenarios. To help researchers quickly figure out this promising topic and benefit the future agent communication development, this paper presents a comprehensive survey of agent communication security. More precisely, we present the first clear definition of agent communication. Besides, we propose a framework that categorizes agent communication into three classes and uses a three-layered communication architecture to illustrate how each class works. Next, for each communication class, we dissect related communication protocols and analyze the security risks, illustrating which communication layer the risks arise from. Then, we provide an outlook on the possible defense countermeasures for each risk. In addition, we conduct experiments using MCP and A2A to help readers better understand the novel vulnerabilities brought by agent communication. Finally, we discuss open issues and future directions in this promising research field. We also publish a repository that maintains a list of related papers on https://github.com/theshi-1128/awesome-agent-communication-security.

Key facts. Cited by 57 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 251 of its 410 references that are in the map. First posted on arXiv 24 Jun 2025.

Builds on

251 of 410 references.

Closest ancestors · 46

Same direction, newest first

  1. 2025We Should Identify and Mitigate Third-Party Safety Risks in MCP-Powered Agent Systems16 Jun
  2. 2025DRIFT: Dynamic Rule-Based Defense with Injection Isolation for Securing LLM Agents13 Jun
  3. 2025Your Agent Can Defend Itself against Backdoor Attacks10 Jun
  4. 2025ATAG: AI-Agent Application Threat Assessment with Attack Graphs3 Jun
  5. 2025To trust or not to trust: Attention-based Trust Management for LLM Multi-Agent Systems3 Jun
  6. 2025Simple Prompt Injection Attacks Can Leak Personal Data Observed by LLM Agents During Task Execution1 Jun
  7. 2025An Adversary-Resistant Multi-Agent LLM System via Credibility Scoring30 May
  8. 2025LLM Agents Should Employ Security Principles29 May
  9. 2025Seven Security Challenges in Cross-domain Multi-agent LLM Systems28 May
  10. 2025IP Leakage Attacks Targeting LLM-Based Multi-Agent Systems18 May
  11. 2025Automated Profile Inference with Language Model Agents18 May
  12. 2025PeerGuard: Defending Multi-Agent Systems Against Backdoor Attacks Through Mutual Reasoning16 May
34 more
  1. 2025MPMA: Preference Manipulation Attack Against Model Context Protocol16 May
  2. 2025Think Twice Before You Act: Enhancing Agent Behavioral Safety with Thought Correction16 May
  3. 2025Security of Internet of Agents: Attacks and Countermeasures12 May
  4. 2025A survey of agent interoperability protocols: Model Context Protocol (MCP), Agent Communication Protocol (ACP), Agent-to-Agent Protocol (A2A), and Agent Network Protocol (ANP)4 May
  5. 2025Prompt Injection Attack to Tool Selection in LLM Agents28 Apr
  6. 2025SAGA: A Security Architecture for Governing AI Agentic Systems27 Apr
  7. 2025Building A Secure Agentic AI Application Leveraging A2A Protocol23 Apr
  8. 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
  9. 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deployment22 Apr
  10. 2025DoomArena: A framework for Testing AI Agents Against Evolving Security Threats18 Apr
  11. 2025MCP Guardian: A Security-First Layer for Safeguarding MCP-Based AI System17 Apr
  12. 2025MCP Safety Audit: LLMs with the Model Context Protocol Allow Major Security Exploits2 Apr
  13. 2025textitAgents Under Siege: Breaking Pragmatic Multi-Agent LLM Systems with Optimized Prompt Attacks31 Mar
  14. 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agents24 Mar
  15. 2025Prompt Flow Integrity to Prevent Privilege Escalation in LLM Agents17 Mar
  16. 2025Multi-Agent Systems Execute Arbitrary Malicious Code15 Mar
  17. 2025A Survey on Trustworthy LLM Agents: Threats and Countermeasures12 Mar
  18. 2025AgentSafe: Safeguarding Large Language Model-based Multi-agent Systems via Hierarchical Data Management6 Mar
  19. 2025Why Are Web AI Agents More Vulnerable Than Standalone LLMs? A Security Analysis27 Feb
  20. 2025Red-Teaming LLM Multi-Agent Systems via Communication Attacks20 Feb
  21. 2025CORBA: Contagious Recursive Blocking Attacks on Multi-Agent Systems Based on Large Language Models20 Feb
  22. 2025Unveiling Privacy Risks in LLM Agent Memory17 Feb
  23. 2025AgentGuard: Repurposing Agentic Orchestrator for Safety Evaluation of Tool Orchestration13 Feb
  24. 2024Navigating the Risks: A Survey of Security, Privacy, and Ethics Threats in LLM-Based Agents14 Nov
  25. 2024NetSafe: Exploring the Topological Safety of Multi-agent Networks21 Oct
  26. 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems9 Oct
  27. 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakage17 Sep
  28. 2024Breaking Agents: Compromising Autonomous LLM Agents Through Malfunction Amplification30 Jul
  29. 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studies28 Jul
  30. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
  31. 2024Flooding Spread of Manipulated Knowledge in LLM-Based Multi-Agent Communities10 Jul
  32. 2024GuardAgent: Safeguard LLM Agents by a Guard Agent via Knowledge-Enabled Reasoning13 Jun
  33. 2024Security of AI Agents12 Jun
  34. 2024PsySafe: A Comprehensive Framework for Psychological-based Attack, Defense, and Evaluation of Multi-agent System Safety22 Jan

Other references · 205

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2023GPT-4 Technical Reportcited by 18,396
  6. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  7. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  8. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  9. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  10. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  11. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  12. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
38 more
  1. 2023A Survey of Large Language Modelscited by 2,576
  2. 2022Emergent Abilities of Large Language Modelscited by 2,512
  3. 2021Learning to Prompt for Vision-Language Modelscited by 2,281
  4. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  5. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  6. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  7. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
  8. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  9. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
  10. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
  11. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
  12. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  13. 2019Adversarial Examples Are Not Bugs, They Are Featurescited by 953
  14. 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
  15. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
  16. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
  17. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
  18. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 698
  19. 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 651
  20. 2023A Comprehensive Overview of Large Language Modelscited by 648
  21. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 634
  22. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
  23. 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
  24. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  25. 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
  26. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
  27. 2023Jailbreaking ChatGPT via Prompt Engineering: An Empirical Studycited by 498
  28. 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 489
  29. 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 488
  30. 2022Diffusion Models for Adversarial Purificationcited by 476
  31. 2021Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributionscited by 431
  32. 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 398
  33. 2017Mitigating Adversarial Effects Through Randomizationcited by 383
  34. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 372
  35. 2023DeepInception: Hypnotize Large Language Model to Be Jailbreakercited by 367
  36. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
  37. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 354
  38. 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 332

50 most cited of 205 All 205 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 14; 2026: 43.

57 papers.

Sort:

By area:

  1. 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 74
  2. 2025AgentBound: Securing Execution Boundaries of AI Agentscited by 23
  3. 2026A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypescited by 22
  4. 2025Copyright Protection for Large Language Models: A Survey of Methods, Challenges, and Trendscited by 20
  5. 2025A Survey on Agentic Security: Applications, Threats and Defensescited by 20
  6. 2025AI Agents with Decentralized Identifiers and Verifiable Credentialscited by 18
  7. 2026AgentWorm: Self-Propagating Attacks Across LLM Agent Ecosystemscited by 17
  8. 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligencecited by 15
  9. 2026Security Threat Modeling for Emerging AI-Agent Protocols: A Comparative Analysis of MCP, A2A, Agora, and ANPcited by 15
  10. 2026Beyond Max Tokens: Stealthy Resource Amplification via Tool Calling Chains in LLM Agentscited by 14
  11. 2026From Spark to Fire: Modeling and Mitigating Error Cascades in LLM-Based Multi-Agent Collaborationcited by 14
  12. 2025Semantic Attacks on Tool-Augmented LLMs: Securing the Model Context Protocol Against Descriptor-Level Manipulationcited by 13
38 more
  1. 2025CTCC: A Robust and Stealthy Fingerprinting Framework for Large Language Models via Cross-Turn Contextual Correlation Backdoorcited by 12
  2. 2025Web Fraud Attacks Against LLM-Driven Multi-Agent Systemscited by 10
  3. 2025Security Analysis of Agentic AI Communication Protocols: A Comparative Evaluationcited by 9
  4. 2026AdaMARP: An Adaptive Multi-Agent Interaction Framework for General Immersive Role-Playingcited by 9
  5. 2026SoK: Security of Autonomous LLM Agents in Agentic Commercecited by 8
  6. 2025Federation of Agents: A Semantics-Aware Communication Fabric for Large-Scale Agentic AIcited by 7
  7. 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluationcited by 7
  8. 2025Takedown: How It's Done in Modern Coding Agent Exploitscited by 6
  9. 2025UFO3: Weaving the Digital Agent Galaxycited by 6
  10. 2026Don't believe everything you read: Understanding and Measuring MCP Behavior under Misleading Tool Descriptionscited by 5
  11. 2026CIBER: A Comprehensive Benchmark for Security Evaluation of Code Interpreter Agentscited by 5
  12. 2026TrinityGuard: A Unified Framework for Safeguarding Multi-Agent Systemscited by 5
  13. 2026Social Theory Should Be a Structural Prior for Agentic AI: A Formal Framework for Multi-Agent Social Systemscited by 5
  14. 2026Agentic Design Patterns: A System-Theoretic Frameworkcited by 4
  15. 2026AgentWebBench: Benchmarking Multi-Agent Coordination in Agentic Webcited by 4
  16. 2026Mind Viruses: Self-Propagating Ideas in Multi-Agent LLM Systemscited by 4
  17. 2026AWCP: A Workspace Delegation Protocol for Deep-Engagement Collaboration across Remote Agentscited by 3
  18. 2026CIA: Inferring the Communication Topology from LLM-based Multi-Agent Systemscited by 3
  19. 2025Multi-Stakeholder Alignment in LLM-Powered Collaborative AI Systems: A Multi-Agent Framework for Intelligent Tutoringcited by 2
  20. 2026ICPO: Illocution-Calibrated Policy Optimization for Multi-Turn Conversationcited by 2
  21. 2026Human Society-Inspired Approaches to Agentic AI Security: The 4C Frameworkcited by 2
  22. 2026Beyond Message Passing: A Semantic View of Agent Communication Protocolscited by 2
  23. 2026SecureClaw: Clawing Back Control of LLM Agentscited by 2
  24. 2025Spectral Logit Sculpting: Adaptive Low-Rank Logit Transformation for Controlled Text Generationcited by 1
  25. 2026ForgetMark: Stealthy Fingerprint Embedding via Targeted Unlearning in Language Modelscited by 1
  26. 2026Give Them an Inch and They Will Take a Mile:Understanding and Measuring Caller Identity Confusion in MCP-Based AI Systemscited by 1
  27. 2026From Thinker to Society: Security in Hierarchical Autonomy Evolution of AI Agentscited by 1
  28. 2026When the Manual Lies: A Realistic Benchmark to Evaluate MCP Poisoning Attacks for LLM Agentscited by 1
  29. 2026A Technical Taxonomy of LLM Agent Communication Protocolscited by 1
  30. 2026AutoRAS: Learning Robust Agentic Systems with Primitive Representationscited by 1
  31. 2026Before Agents Speak: Pre-hoc Failure Risk Inference in Multi-Agent Systemscited by 1
  32. 2026When Prompts Control Robots: Prompt Injection Attacks in Multi-Agent Robotic Systemscited by 1
  33. 2026Blockchain Empowered Trustworthy Agent Networks: Foundations, Taxonomy, and Future Directionscited by 1
  34. 2026SoK: When Safe Agents Fail Together: The Security of Multi Agent LLM Systemscited by 1
  35. 2026DNF: Dual-Layer Nested Fingerprinting for Large Language Model Intellectual Property Protectioncited by 0
  36. 2026Communications-Incentivized Collaborative Reasoning in NetGPT through Agentic Reinforcement Learningcited by 0
  37. 2026When Agents Handle Secrets: A Survey of Confidential Computing for Agentic AIcited by 0
  38. 2026Swarm-Driven Multi-Agent Reasoning for Smart City Securitycited by 0

50 most cited of 57 All 57 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges
  2. 2026The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey
  3. 2025TRiSM for Agentic AI: A Review of Trust, Risk, and Security Management in LLM-based Agentic Multi-Agent Systems
  4. 2026Toward Secure AI-Powered Penetration Testing Agents: Security Threats, Guardrails, and Architectural Perspectives
  5. 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMs
  6. 2026A Systematic Survey of Security Threats and Defenses in LLM-Based AI Agents: A Layered Attack Surface Framework
  7. 2025From Prompt Injections to Protocol Exploits: Threats in LLM-Powered AI Agents Workflows
  8. 2026Toward Securing AI Agents Like Operating Systems