mlsanityData to 7 Oct 2026

MAStrike: Shapley-Guided Collusive Red-Teaming on Multi-Agent Systems

arXiv 2606.12918 ↗First posted 11 Jun 2026cs.CR cs.AIcited by 0

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

Hierarchical multi-agent systems (MAS) are rapidly being deployed in high-stakes workflows across domains such as finance and software engineering. In these systems, safety and security are inherently distributed across role-specialized agents, significantly expanding the attack surface, particularly under coordinated adversarial behaviors such as privilege escalation and cross-agent collusion. Existing red-teaming approaches for MAS remain limited: they rely on heuristic selection of target agents and perturb isolated message streams, leaving critical questions unanswered as which agents are most responsible for system safety, and how compromised agents can coordinate to bypass defenses. We propose MAStrike, a closed-loop framework for collusive red-teaming in hierarchical MAS. We propose the first agent-level Shapley value analysis for MAS, quantifying each agent's marginal contribution to system robustness under task-specific distributions. GGuided by this attribution, MAStrike identifies vulnerable agent coalitions and generates coordinated, role-aware adversarial manipulations. These attacks are iteratively refined through structured causal diagnosis, attributing failure cases to uncompromised agents that block adversarial attempts. We further build a comprehensive MAS red-teaming benchmark and controllable environments spanning diverse hierarchical topologies and domains, including finance, software engineering, and CRM. Extensive experiments across MAS built on multiple frontier models show that MAStrike substantially outperforms heuristic baselines. Our analysis further uncovers non-trivial Shapley value distributions and higher-order interaction structures among agents, revealing critical vulnerabilities and coordination patterns that are overlooked by prior single-agent or template-based methods.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 20 of its 27 references that are in the map. First posted on arXiv 11 Jun 2026.

Builds on

20 of 27 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Red-Teaming LLM Multi-Agent Systems via Communication Attacks20 Feb
  2. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct

Other references · 18

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  2. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  3. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
  4. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 514
  5. 2023Jailbreaking ChatGPT via Prompt Engineering: An Empirical Studycited by 478
  6. 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 311
  7. 2019Towards Efficient Data Valuation Based on the Shapley Valuecited by 279
  8. 2025Multi-Agent Risks from Advanced AIcited by 150
  9. 2024Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fastcited by 149
  10. 2024On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agentscited by 92
  11. 2024PsySafe: A Comprehensive Framework for Psychological-based Attack, Defense, and Evaluation of Multi-agent System Safetycited by 79
  12. 2019Shapley Q-value: A Local Reward Approach to Solve Global Reward Gamescited by 71
6 more
  1. 2024MultiAgent Collaboration Attack: Investigating Adversarial Attacks in Large Language Model Collaborations via Debatecited by 54
  2. 2025TAMAS: Benchmarking Adversarial Risks in Multi-Agent LLM Systemscited by 24
  3. 2025TokenShapley: Token Level Context Attribution with Shapley Valuecited by 14
  4. 2024SyntaxShap: Syntax-aware Explainability Method for Text Generationcited by 11
  5. 2025LiRA: A Multi-Agent Framework for Reliable and Readable Literature Review Generationcited by 8
  6. 2026GroupGuard: A Framework for Modeling and Defending Collusive Attacks in Multi-Agent Systemscited by 4

Built on by

Not cited yet.