mlsanityData to 14 Oct 2026

Attack the Messages, Not the Agents: A Multi-round Adaptive Stealthy Tampering Framework for LLM-MAS

arXiv 2508.03125 ↗First posted 5 Aug 2025cs.CR cs.AI cs.MAcited by 17

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Large language model-based multi-agent systems (LLM-MAS) effectively accomplish complex and dynamic tasks through inter-agent communication, but this reliance introduces substantial safety vulnerabilities. Existing attack methods targeting LLM-MAS either compromise agent internals or rely on direct and overt persuasion, which limit their effectiveness, adaptability, and stealthiness. In this paper, we propose MAST, a Multi-round Adaptive Stealthy Tampering framework designed to exploit communication vulnerabilities within the system. MAST integrates Monte Carlo Tree Search with Direct Preference Optimization to train an attack policy model that adaptively generates effective multi-round tampering strategies. Furthermore, to preserve stealthiness, we impose dual semantic and embedding similarity constraints during the tampering process. Comprehensive experiments across diverse tasks, communication architectures, and LLMs demonstrate that MAST consistently achieves high attack success rates while significantly enhancing stealthiness compared to baselines. These findings highlight the effectiveness, stealthiness, and adaptability of MAST, underscoring the need for robust communication safeguards in LLM-MAS.

Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 26 of its 40 references that are in the map. First posted on arXiv 5 Aug 2025.

Builds on

26 of 40 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025AgentSafe: Safeguarding Large Language Model-based Multi-agent Systems via Hierarchical Data Management6 Mar
  2. 2025Red-Teaming LLM Multi-Agent Systems via Communication Attacks20 Feb
  3. 2025CORBA: Contagious Recursive Blocking Attacks on Multi-Agent Systems Based on Large Language Models20 Feb
  4. 2025G-Safeguard: A Topology-Guided Security Lens and Treatment on LLM-based Multi-agent Systems16 Feb
  5. 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safety2 Feb
  6. 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems9 Oct
  7. 2024Flooding Spread of Manipulated Knowledge in LLM-Based Multi-Agent Communities10 Jul

Other references · 19

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2023Mistral 7Bcited by 3,164
  6. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  7. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  8. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
  9. 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
  10. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 333
  11. 2023Defending Against Alignment-Breaking Attacks via Robustly Aligned LLMcited by 192
  12. 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agentscited by 178
7 more
  1. 2024On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agentscited by 99
  2. 2024Unveiling the Truth and Facilitating Change: Towards Agent-based Large-scale Social Movement Simulationcited by 71
  3. 2025Beyond Self-Talk: A Communication-Centric Survey of LLM-Based Multi-Agent Systemscited by 62
  4. 2023Experiential Co-Learning of Software-Developing Agentscited by 57
  5. 2024MultiAgent Collaboration Attack: Investigating Adversarial Attacks in Large Language Model Collaborations via Debatecited by 56
  6. 2024UniDebugger: Hierarchical Multi-Agent Framework for Unified Software Debuggingcited by 35
  7. 2025GameChat: Multi-LLM Dialogue for Safe, Agile, and Socially Optimal Multi-Agent Navigation in Constrained Environmentscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 14.

17 papers.

Sort:

By area:

  1. 2025Explainable and Fine-Grained Safeguarding of LLM Multi-Agent Systems via Bi-Level Graph Anomaly Detectioncited by 9
  2. 2026Among Us: Measuring and Mitigating Malicious Contributions in Model Collaboration Systemscited by 7
  3. 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluationcited by 7
  4. 2026TrinityGuard: A Unified Framework for Safeguarding Multi-Agent Systemscited by 5
  5. 2025Securing Multi-Agent Systems Against Corruptions via Node Contribution Backpropagationcited by 4
  6. 2026GAMMAF: A Common Framework for Graph-Based Anomaly Monitoring Benchmarking in LLM Multi-Agent Systemscited by 2
  7. 2026When Agents Go Rogue: Activation-Based Detection of Malicious Behaviors in Multi-Agent Systemscited by 1
  8. 2026SoK: When Safe Agents Fail Together: The Security of Multi Agent LLM Systemscited by 1
  9. 2026Misleading the Planner through Deceptive Resumes: Registration-Time Injection in Centralized Multi-Agent Systemscited by 1
  10. 2025SIEVE: Selective Integrity Verification and Escalation for Defending LLM Agents against Indirect Prompt Injectioncited by 0
  11. 2026Is Monitoring Enough? Strategic Agent Selection For Stealthy Attack in Multi-Agent Discussionscited by 0
  12. 2026OpenEvoShield: Dual Non-Stationary Continual Defense for Open-World Multi-Agent System Attackscited by 0
5 more
  1. 2026Attacking and Defending Multi-Agent Collaborative Filtering Systems Through Connectivitycited by 0
  2. 2026Breadcrumbing Search Agentscited by 0
  3. 2026ClawSentry: A Progressive Multi-Tier Security Monitor for Safeguarding Autonomous LLM Agentscited by 0
  4. 2026Concealing LLM-Based Multi-Agent Topology via Phantom Structure Injectioncited by 0
  5. 2026Safety of Latent Communication in Multi-Agent Systemscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026When Embedding-Based Defenses Fail: Rethinking Safety in LLM-Based Multi-Agent Systems
  2. 2025Comprehensive Vulnerability Analysis is Necessary for Trustworthy LLM-MAS
  3. 2026Beyond Max Tokens: Stealthy Resource Amplification via Tool Calling Chains in LLM Agents
  4. 2026Defending LLM-based Multi-Agent Systems Against Cooperative Attacks with Sentence-Level Rectification
  5. 2025The Dark Side of LLMs: Agent-based Attack Vectors for System-level Compromise
  6. 2025DRIFT: Dynamic Rule-Based Defense with Injection Isolation for Securing LLM Agents
  7. 2025MCP Security Bench (MSB): Benchmarking Attacks Against Model Context Protocol in LLM Agents
  8. 2025Bilevel Optimization for Covert Memory Tampering in Heterogeneous Multi-Agent Architectures (XAMT)