CORBA: Contagious Recursive Blocking Attacks on Multi-Agent Systems Based on Large Language Models
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Large Language Model-based Multi-Agent Systems (LLM-MASs) have demonstrated remarkable real-world capabilities, effectively collaborating to complete complex tasks. While these systems are designed with safety mechanisms, such as rejecting harmful instructions through alignment, their security remains largely unexplored. This gap leaves LLM-MASs vulnerable to targeted disruptions. In this paper, we introduce Contagious Recursive Blocking Attacks (Corba), a novel and simple yet highly effective attack that disrupts interactions between agents within an LLM-MAS. Corba leverages two key properties: its contagious nature allows it to propagate across arbitrary network topologies, while its recursive property enables sustained depletion of computational resources. Notably, these blocking attacks often involve seemingly benign instructions, making them particularly challenging to mitigate using conventional alignment methods. We evaluate Corba on two widely-used LLM-MASs, namely, AutoGen and Camel across various topologies and commercial models. Additionally, we conduct more extensive experiments in open-ended interactive LLM-MASs, demonstrating the effectiveness of Corba in complex topology structures and open-source models. Our code is available at: https://github.com/zhrli324/Corba.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 24 of its 43 references that are in the map. First posted on arXiv 20 Feb 2025.
Builds on
24 of 43 references.
Closest ancestors · 6
Same direction, newest first
- 2024Breaking Agents: Compromising Autonomous LLM Agents Through Malfunction Amplification30 Jul
- 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studies28 Jul
- 2024Flooding Spread of Manipulated Knowledge in LLM-Based Multi-Agent Communities10 Jul
- 2024AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks2 Mar
- 2024Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fast13 Feb
- 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agents18 Jan
Other references · 18
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 651
- 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 573
- 2023Detecting Language Model Attacks with Perplexitycited by 431
6 more
- 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 333
- 2023War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Warscited by 145
- 2024Cooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agentscited by 125
- 2024Coercing LLMs to do and reveal (almost) anythingcited by 89
- 2024Crabs: Consuming Resource via Auto-generation for LLM-DoS Attack under Black-box Settingscited by 35
- 2024An Engorgio Prompt Makes Large Language Model Babble oncited by 30
Built on by
Citing papers per year: 2025: 10; 2026: 10.
20 papers.
Sort:
By area:
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
- 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deploymentcited by 116
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 77
- 2025From Prompt Injections to Protocol Exploits: Threats in LLM-Powered AI Agents Workflowscited by 58
- 2025A Survey of LLM-Driven AI Agent Communication: Protocols, Security Risks, and Defense Countermeasurescited by 57
- 2025Copyright Protection for Large Language Models: A Survey of Methods, Challenges, and Trendscited by 20
- 2025Attack the Messages, Not the Agents: A Multi-round Adaptive Stealthy Tampering Framework for LLM-MAScited by 17
- 2025BlockA2A: Towards Secure and Verifiable Agent-to-Agent Interoperabilitycited by 15
- 2026ACIArena: Toward Unified Evaluation for Agent Cascading Injectioncited by 7
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluationcited by 7
- 2025Evo-MARL: Co-Evolutionary Multi-Agent Reinforcement Learning for Internalized Safetycited by 4
- 2026MCPShield: A Security Cognition Layer for Adaptive Trust Calibration in Model Context Protocol Agentscited by 3
8 more
- 2025Towards Unifying Quantitative Security Benchmarking for Multi Agent Systemscited by 2
- 2026GAMMAF: A Common Framework for Graph-Based Anomaly Monitoring Benchmarking in LLM Multi-Agent Systemscited by 2
- 2026Hierarchical Attacks for Multi-Modal Multi-Agent Reasoningcited by 1
- 2026AutoRAS: Learning Robust Agentic Systems with Primitive Representationscited by 1
- 2026When Agents Go Rogue: Activation-Based Detection of Malicious Behaviors in Multi-Agent Systemscited by 1
- 2026SoK: When Safe Agents Fail Together: The Security of Multi Agent LLM Systemscited by 1
- 2026MADBench: Benchmarking the Security of Multi-Agent Debatecited by 0
- 2026Agent-Canary-Mas: End-to-End Evaluation of Protocol Risk in Long-Horizon Multi-Agent Systemscited by 0
- 2026Agent-Canary-Mas: End-to-End Evaluation of Protocol Risk in Long-Horizon Multi-Agent Systems11 Oct 2026
- 2026MADBench: Benchmarking the Security of Multi-Agent Debate30 Sep 2026
- 2026SoK: When Safe Agents Fail Together: The Security of Multi Agent LLM Systems1 Sep 2026
- 2026When Agents Go Rogue: Activation-Based Detection of Malicious Behaviors in Multi-Agent Systems7 Jul 2026
- 2026AutoRAS: Learning Robust Agentic Systems with Primitive Representations19 Jun 2026
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation9 Jun 2026
- 2026Hierarchical Attacks for Multi-Modal Multi-Agent Reasoning13 May 2026
- 2026GAMMAF: A Common Framework for Graph-Based Anomaly Monitoring Benchmarking in LLM Multi-Agent Systems27 Apr 2026
- 2026ACIArena: Toward Unified Evaluation for Agent Cascading Injection9 Apr 2026
- 2026MCPShield: A Security Cognition Layer for Adaptive Trust Calibration in Model Context Protocol Agents15 Feb 2026
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discovery18 Aug 2025
- 2025Copyright Protection for Large Language Models: A Survey of Methods, Challenges, and Trends15 Aug 2025
8 more
- 2025Evo-MARL: Co-Evolutionary Multi-Agent Reinforcement Learning for Internalized Safety5 Aug 2025
- 2025Attack the Messages, Not the Agents: A Multi-round Adaptive Stealthy Tampering Framework for LLM-MAS5 Aug 2025
- 2025BlockA2A: Towards Secure and Verifiable Agent-to-Agent Interoperability2 Aug 2025
- 2025Towards Unifying Quantitative Security Benchmarking for Multi Agent Systems23 Jul 2025
- 2025From Prompt Injections to Protocol Exploits: Threats in LLM-Powered AI Agents Workflows29 Jun 2025
- 2025A Survey of LLM-Driven AI Agent Communication: Protocols, Security Risks, and Defense Countermeasures24 Jun 2025
- 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deployment22 Apr 2025
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges27 Mar 2025
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 77
- 2025From Prompt Injections to Protocol Exploits: Threats in LLM-Powered AI Agents Workflowscited by 58
- 2025A Survey of LLM-Driven AI Agent Communication: Protocols, Security Risks, and Defense Countermeasurescited by 57
- 2025Attack the Messages, Not the Agents: A Multi-round Adaptive Stealthy Tampering Framework for LLM-MAScited by 17
- 2025BlockA2A: Towards Secure and Verifiable Agent-to-Agent Interoperabilitycited by 15
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluationcited by 7
- 2025Evo-MARL: Co-Evolutionary Multi-Agent Reinforcement Learning for Internalized Safetycited by 4
- 2026MCPShield: A Security Cognition Layer for Adaptive Trust Calibration in Model Context Protocol Agentscited by 3
- 2025Towards Unifying Quantitative Security Benchmarking for Multi Agent Systemscited by 2
- 2026GAMMAF: A Common Framework for Graph-Based Anomaly Monitoring Benchmarking in LLM Multi-Agent Systemscited by 2
- 2026When Agents Go Rogue: Activation-Based Detection of Malicious Behaviors in Multi-Agent Systemscited by 1
12 most cited of 14 All 14 (JSON)
- 2026Agent-Canary-Mas: End-to-End Evaluation of Protocol Risk in Long-Horizon Multi-Agent Systems11 Oct 2026
- 2026SoK: When Safe Agents Fail Together: The Security of Multi Agent LLM Systems1 Sep 2026
- 2026When Agents Go Rogue: Activation-Based Detection of Malicious Behaviors in Multi-Agent Systems7 Jul 2026
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation9 Jun 2026
- 2026GAMMAF: A Common Framework for Graph-Based Anomaly Monitoring Benchmarking in LLM Multi-Agent Systems27 Apr 2026
- 2026MCPShield: A Security Cognition Layer for Adaptive Trust Calibration in Model Context Protocol Agents15 Feb 2026
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discovery18 Aug 2025
- 2025Evo-MARL: Co-Evolutionary Multi-Agent Reinforcement Learning for Internalized Safety5 Aug 2025
- 2025Attack the Messages, Not the Agents: A Multi-round Adaptive Stealthy Tampering Framework for LLM-MAS5 Aug 2025
- 2025BlockA2A: Towards Secure and Verifiable Agent-to-Agent Interoperability2 Aug 2025
- 2025Towards Unifying Quantitative Security Benchmarking for Multi Agent Systems23 Jul 2025
- 2025From Prompt Injections to Protocol Exploits: Threats in LLM-Powered AI Agents Workflows29 Jun 2025
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Red-Teaming LLM Multi-Agent Systems via Communication Attacks
- 2026Don't Trust Stubborn Neighbors: A Security Framework for Agentic Networks
- 2025MASTER: Multi-Agent Security Through Exploration of Roles and Topological Structures -- A Comprehensive Framework
- 2026PropGuard: Safeguarding LLM-MAS via Propagation-Aware Exploration and Remediation
- 2025The Dark Side of LLMs: Agent-based Attack Vectors for System-level Compromise
- 2026GroupGuard: A Framework for Modeling and Defending Collusive Attacks in Multi-Agent Systems
- 2026Defending LLM-based Multi-Agent Systems Against Cooperative Attacks with Sentence-Level Rectification
- 2025Collaborative Shadows: Distributed Backdoor Attacks in LLM-Based Multi-Agent Systems