mlsanityData to 7 Oct 2026

When Local Monitors Miss Compositional Harm: Diagnosing Distributed Backdoors in Multi-Agent Systems

arXiv 2607.11751 ↗First posted 13 Jul 2026cs.CR cs.LG cs.MAcited by 2

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

As multi-agent, tool-using LLM systems are deployed, a common safety net is a runtime monitor that checks each message, tool call, or step on its own. We show this net has a fundamental hole. A distributed backdoor splits a harmful payload across agents, so every local check passes while the assembled object is the attack. The monitor can be right on every step and still miss the attack. The problem is not splitting itself: split fragments can still leak suspicious tokens or provenance edges. The hard case is local benignness. No fragment carries the harm, and what is left looks like ordinary benign traffic. We formalize this as an observability boundary: a monitor catches only what its view can tell apart from benign traffic. We prove that once the fragments look benign in the monitored view, no detector on that view can catch them, however strong it is. Across a controlled testbed, an external benchmark, and end-to-end agent runs, local monitors lose the signal exactly as local evidence disappears, and it returns only when the monitor sees the assembled object. A monitor trained only on benign traffic recovers the attack's code structure across held-out encodings (0.874 mean AUROC). A decoded-view gate, given the encoding family, blocks every tested attack. But seeing more is not enough: full-trace monitors and decoders still fail unless they reach the representation where the payload is exposed. Local safety is not global safety when harm is compositional, and the open problem is finding that representation.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 27 of its 41 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

27 of 41 references.

Closest ancestors · 13

Same direction, newest first

  1. 2026Ghost in the Agent: Redefining Information Flow Tracking for LLM Agents25 Apr
  2. 2026SkillTrojan: Backdoor Attacks on Skill-Based Agent Systems8 Apr
  3. 2026SafetyDrift: Predicting When AI Agents Cross the Line Before They Actually Do28 Mar
  4. 2026When Benchmarks Lie: Evaluating Malicious Prompt Classifiers Under True Distribution Shift15 Feb
  5. 2026BackdoorAgent: A Unified Framework for Backdoor Attacks on LLM-based Agents8 Jan
  6. 2026Lying with Truths: Open-Channel Multi-Agent Collusion for Belief Manipulation via Generative Montage4 Jan
  7. 2025AgentArmor: Enforcing Program Analysis on Agent Runtime Trace to Defend Against Prompt Injection2 Aug
  8. 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safety8 Jul
  9. 2025From Prompt Injections to Protocol Exploits: Threats in LLM-Powered AI Agents Workflows29 Jun
  10. 2025Your Agent Can Defend Itself against Backdoor Attacks10 Jun
  11. 2025PeerGuard: Defending Multi-Agent Systems Against Backdoor Attacks Through Mutual Reasoning16 May
  12. 2025DemonAgent: Dynamically Encrypted Multi-Backdoor Implantation Attack on LLM-based Agent18 Feb
1 more
  1. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agents18 Jan

Other references · 14

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  3. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  4. 2020Shortcut Learning in Deep Neural Networkscited by 1,928
  5. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
  6. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
  7. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  8. 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 864
  9. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
  10. 2018Annotation Artifacts in Natural Language Inference Datacited by 656
  11. 2024DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakerscited by 91
  12. 2023LLM Censorship: A Machine Learning Challenge or a Computer Security Problem?cited by 47
2 more
  1. 2026Most LLM Conformity Needs No Speaker: Measuring the Speaker-Free Floor in Peer-Pressure Benchmarkscited by 4
  2. 2026When Better Codebooks Are Not Enough: Predictive Performance and Behavioral Reliability in LLM Political Event Codingcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Stateful Online Monitoring Catches Distributed Agent Attacks
  2. 2026Towards a Unified Misuse Monitoring Benchmark
  3. 2025Collaborative Shadows: Distributed Backdoor Attacks in LLM-Based Multi-Agent Systems
  4. 2025Reliable Weak-to-Strong Monitoring of LLM Agents
  5. 2026Structurally Close, Temporally Distant: Measuring Security Exposure in Long-Horizon LLM Agents
  6. 2026ChannelGuard: Safe Models Do Not Compose into Safe Multi-Agent Systems
  7. 2026Why Formal Monitors Fail: Attack Distribution Entropy as a Coverage Bound for LTL-Based LLM Agent Safety
  8. 2026ClawSentry: A Progressive Multi-Tier Security Monitor for Safeguarding Autonomous LLM Agents