Architecture Matters for Multi-Agent Security
Not on the map. Why?
Abstract (arXiv)
Multi-agent systems (MAS), composed of networks of two or more autonomous AI agents, have become increasingly popular in production deployments, yet introduce security risks that do not arise in single-agent settings. Even if individual agents exhibit robust security, architectural decisions governing their coordination can create attack surfaces that have not been systematically characterized. In this work, we present an empirical study of how MAS design decisions shape the tradeoff between task performance and attack resistance. Across three agentic environments (browser, desktop, and code) and 13 architectural configurations, we use stagewise evaluations that distinguish planning refusal, execution-stage interception, partial harmful execution, and successful attack completion to study three key design choices: (i) agent roles, which determine how authority and responsibility are allocated; (ii) communication topology, which shapes how and when agents interact; and (iii) memory, which determines the context and state visibility accessible to each agent. We find that multi-agent architectures are more vulnerable than standalone agents in the majority of configurations, with attack success rates varying by up to 3.8x at comparable or higher benign accuracy, and that no single design is universally safer. These results motivate the development of further evaluations that move beyond the security properties of a single agent.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 32 of its 47 references that are in the map. First posted on arXiv 25 Apr 2026.
Builds on
32 of 47 references.
References · 32
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 527
- 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attackscited by 450
- 2025Defeating Prompt Injections by Designcited by 256
- 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 179
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agentscited by 169
- 2025Multi-Agent Risks from Advanced AIcited by 150
- 2024Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fastcited by 149
- 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systemscited by 126
- 2024Secret Collusion among AI Agents: Multi-Agent Deception via Steganographycited by 107
20 more
- 2025OS-Harm: A Benchmark for Measuring Safety of Computer Use Agentscited by 104
- 2024RedCode: Risky Code Execution and Generation Benchmark for Code Agentscited by 87
- 2024Flooding Spread of Manipulated Knowledge in LLM-Based Multi-Agent Communitiescited by 84
- 2025Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agentscited by 66
- 2024Navigating the Risks: A Survey of Security, Privacy, and Ethics Threats in LLM-Based Agentscited by 63
- 2024Refusal-Trained LLMs Are Easily Jailbroken As Browser Agentscited by 61
- 2024MultiAgent Collaboration Attack: Investigating Adversarial Attacks in Large Language Model Collaborations via Debatecited by 54
- 2024Hidden in Plain Text: Emergence & Mitigation of Steganographic Collusion in LLMscited by 52
- 2023PoisonPrompt: Backdoor Attack on Prompt-based Large Language Modelscited by 40
- 2025Multi-Agent Security Tax: Trading Off Security and Collaboration Capabilities in Multi-Agent Systemscited by 27
- 2025Why Are Web AI Agents More Vulnerable Than Standalone LLMs? A Security Analysiscited by 27
- 2024Systematically Analyzing Prompt Injection Vulnerabilities in Diverse LLM Architecturescited by 12
- 2025Evolving Security in LLMs: A Study of Jailbreak Attacks and Defensescited by 8
- 2025Amplified Vulnerabilities: Structured Jailbreak Attacks on LLM-based Multi-Agent Debatecited by 8
- 2025LLM Security: Vulnerabilities, Attacks, Defenses, and Countermeasurescited by 8
- 2025A Systematic Review of Poisoning Attacks Against Large Language Modelscited by 8
- 2026Thought Virus: Viral Misalignment via Subliminal Prompting in Multi-Agent Systemscited by 7
- 2025MASTER: Multi-Agent Security Through Exploration of Roles and Topological Structures -- A Comprehensive Frameworkcited by 6
- 2025Architecting Resilient LLM Agents: A Guide to Secure Plan-then-Execute Implementationscited by 6
- 2026Security Considerations for Multi-agent Systemscited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026MasDrift: Benchmarking Authorization Preservation Across Multi-Agent Architecturescited by 3
- 2026SoK: When Safe Agents Fail Together: The Security of Multi Agent LLM Systemscited by 1
- 2026Poisoning Agentic Alpha: Adversarial Vulnerabilities Across Roles and Architectures in Multi-Agent Trading Systemscited by 0
- 2026SoK: When Safe Agents Fail Together: The Security of Multi Agent LLM Systems1 Sep 2026
- 2026Poisoning Agentic Alpha: Adversarial Vulnerabilities Across Roles and Architectures in Multi-Agent Trading Systems25 Aug 2026
- 2026MasDrift: Benchmarking Authorization Preservation Across Multi-Agent Architectures2 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2025Toward a Safe Internet of Agents
- 2026A Systematic Survey of Security Threats and Defenses in LLM-Based AI Agents: A Layered Attack Surface Framework
- 2026From Monoliths to Swarms: A Study of Attack Surface Evolution in the Transition to Multi-Agent Web Systems
- 2026AgentWard: A Lifecycle Security Architecture for Autonomous AI Agents
- 2025A Survey on Autonomy-Induced Security Risks in Large Model-Based Agents
- 2026Attack Selection in Agentic AI Control Evaluations Meaningfully Decreases Safety
- 2026Architecting Secure AI Agents: Perspectives on System-Level Defenses Against Indirect Prompt Injection Attacks
- 2026Securing Agentic AI: From Per-Action Checks to Trajectory Assurance