Trust propagation and structural containment in Multi-agent LLM pipelines
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Multi-agent LLM systems increasingly automate tasks involving agents with different levels of privilege, creating a security risk in which a compromised low-privilege agent can influence a higher-privilege agent and trigger an unauthorized action. We study attack propagation in a four-agent LangGraph pipeline comprising a Supervisor, Researcher, Validator, and Executor. We evaluate shared-memory poisoning and indirect prompt injection through a forged approval embedded in a retrieved document. We compare the Validator's judgment with an independent authorization layer using task-bound signed tokens and a separately verified policy oracle. Our contribution is an empirical study of attack propagation, a component-level ablation of the authorization boundary, and the Judgment Bypass Rate (JBR), which measures compromise at the attacked agent rather than at the final action. Across three seeds and 60 labeled tasks, memory poisoning reaches execution in every undefended trial. With authorization enabled, it achieves 100% JBR but 0% Unsafe Action Rate, showing that the Validator can remain compromised while execution is contained. Against an attacker possessing the signing secret, the policy oracle provides the observed containment, while an independently authored least privilege policy preserves this result. An Observer layer reduces the false-positive rate for agent hijacking from 49% to 7% without weakening execution-level security. These results show that structural authorization can contain compromised agent behavior even when upstream LLM judgment fails.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 19 of its 29 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
19 of 29 references.
Closest ancestors · 9
Same direction, newest first
- 2026ADR: An Agentic Detection System for Enterprise Agentic AI Security17 May
- 2026SoK: The Attack Surface of Agentic AI - Tools and Autonomy24 Mar
- 2025ASTRIDE: A Security Threat Modeling Platform for Agentic-AI Applications4 Dec
- 2025AgentBound: Securing Execution Boundaries of AI Agents24 Oct
- 2025ThreatGPT: An Agentic AI Framework for Enhancing Public Safety through Threat Modeling4 Sep
- 2025Securing Agentic AI: Threat Modeling and Risk Analysis for Network Monitoring Agentic AI System12 Aug
- 2025LLM Agents Should Employ Security Principles29 May
- 2025Firewalls to Secure Dynamic LLM Agentic Networks3 Feb
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
Other references · 10
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
- 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
- 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 264
- 2024AI Agents Under Threat: A Survey of Key Security Challenges and Future Pathwayscited by 127
- 2023Jatmo: Prompt Injection Defense by Task-Specific Finetuningcited by 106
- 2024Signed-Prompt: A New Approach to Prevent Prompt Injection Attacks Against LLM-Integrated Applicationscited by 54
- 2026Dive into Claude Code: The Design Space of Today's and Future AI Agent Systemscited by 38
- 2026Visual Confused Deputy: Exploiting and Defending Perception Failures in Computer-Using Agentscited by 7
- 2026Are AI-assisted Development Tools Immune to Prompt Injection?cited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Adversarial Attacks in Multi-Agent LLM Pipelines: Unveiling Structural Vulnerabilities in Agentic AI Architectures
- 2026Securing LLM-Agent Long-Term Memory Against Poisoning: Non-Malleable, Origin-Bound Authority with Machine-Checked Guarantees
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation
- 2026Kill-Chain Canaries: Stage-Level Tracking of Prompt Injection Across Attack Surfaces and Model Safety Tiers
- 2026Early Detection of Distributed Backdoors in Multi-Agent LLM Systems: A Characterization Study
- 2026PRISM: Generation-Time Detection and Mitigation of Secret Leakage in Multi-Agent LLM Pipelines
- 2025A Multi-Agent LLM Defense Pipeline Against Prompt Injection Attacks
- 2026TraceGrant: A Contract-Governed Security Framework for the Task-Effect Lifecycle of Networked LLM Agents