Conjunctive Prompt Attacks in Multi-Agent LLM Systems
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 1 more
Abstract (arXiv)
Most LLM safety work studies single-agent models, but many real applications rely on multiple interacting agents. In these systems, prompt segmentation and inter-agent routing create attack surfaces that single-agent evaluations miss. We study conjunctive prompt attacks, where a trigger key in the user query and a hidden adversarial template in one compromised remote agent each appear benign alone but activate harmful behavior when routing brings them together. We consider an attacker who changes neither model weights nor the client agent and instead controls only trigger placement and template insertion. Across star, chain, and DAG topologies, routing-aware optimization substantially increases attack success over non-optimized baselines while keeping false activations low. Existing defenses, including PromptGuard, Llama-Guard variants, and system-level controls such as tool restrictions, do not reliably stop the attack because no single component appears malicious in isolation. These results expose a structural vulnerability in agentic LLM pipelines and motivate defenses that reason over routing and cross-agent composition. Code is available at https://github.com/UCF-ML-Research/ConjunctiveAgents.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 24 of its 42 references that are in the map. First posted on arXiv 17 Apr 2026.
Builds on
24 of 42 references.
Closest ancestors · 10
Same direction, newest first
- 2025TAMAS: Benchmarking Adversarial Risks in Multi-Agent LLM Systems7 Nov
- 2025The Trust Paradox in LLM-Based Multi-Agent Systems: When Collaboration Becomes a Security Vulnerability21 Oct
- 2025RL Is a Hammer and LLMs Are Nails: A Simple Reinforcement Learning Recipe for Strong Prompt Injection6 Oct
- 2025Malice in Agentland: Down the Rabbit Hole of Backdoors in the AI Supply Chain3 Oct
- 2025A Multi-Agent LLM Defense Pipeline Against Prompt Injection Attacks16 Sep
- 2025IPIGuard: A Novel Tool Dependency Graph-Based Defense Against Indirect Prompt Injection in LLM Agents21 Aug
- 2025Extending the OWASP Multi-Agentic System Threat Modeling Guide: Insights from Multi-Agent Security Research13 Aug
- 2025Attractive Metadata Attack: Inducing LLM Agents to Invoke Malicious Tools4 Aug
- 2025X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agents15 Apr
- 2025Multi-Agent Systems Execute Arbitrary Malicious Code15 Mar
Other references · 14
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
- 2022Language model compression with weighted low-rank factorizationcited by 192
- 2022TrojViT: Trojan Insertion in Vision Transformerscited by 30
- 2025Adaptive Graph Pruning for Multi-Agent Communicationcited by 28
- 2023TrojText: Test-time Invisible Textual Trojan Insertioncited by 26
- 2025Defense against Prompt Injection Attacks via Mixture of Encodingscited by 10
- 2025Jailbreak Mimicry: Automated Discovery of Narrative-Based Jailbreaks for Large Language Modelscited by 5
- 2024Improving Discrete Optimisation Via Decoupled Straight-Through Estimatorcited by 4
- 2025STRIDE: A Systematic Framework for Selecting AI Modalities -- Agentic AI, AI Assistants, or LLM Callscited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Exposing Weak Links in Multi-Agent Systems under Adversarial Prompting
- 2025textitAgents Under Siege: Breaking Pragmatic Multi-Agent LLM Systems with Optimized Prompt Attacks
- 2026When Prompts Control Robots: Prompt Injection Attacks in Multi-Agent Robotic Systems
- 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems
- 2026Assessing Automated Prompt Injection Attacks in Agentic Environments
- 2026The Landscape of Prompt Injection Threats in LLM Agents: From Taxonomy to Analysis
- 2024Imprompter: Tricking LLM Agents into Improper Tool Use
- 2026ChannelGuard: Safe Models Do Not Compose into Safe Multi-Agent Systems