FlowSteer: Prompt-Only Workflow Steering Exposes Planning-Time Vulnerabilities in Multi-Agent LLM Systems
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Multi-agent systems (MAS) powered by large language models (LLMs) increasingly adopt planner--executor architectures, where planners convert prompts into subtasks, roles, dependencies, and routing paths. This flexibility enables adaptive coordination, but exposes an attack surface in workflow formation: prompts can shape agent organization without modifying MAS infrastructure. We study this risk through social influence probing workflows to identify high-impact subtasks and malicious-signal propagation. The analysis reveals two vulnerabilities: workflow position can amplify or suppress a malicious signal, and sycophantic framing makes downstream agents more likely to relay it. We translate these findings into FlowSteer, a prompt-only workflow steering attack that converts vulnerability priors into one crafted prompt. FlowSteer aligns a malicious signal with influential task components and guides replanning toward dependencies that preserve propagation. Experiments show that FlowSteer increases malicious success by up to 55% over naive prompting, transfers across MAS setups, and remains effective with black-box topology inference. As FlowSteer biases the planning signals that generate the workflow, MAS defenses that inspect only the generated workflow provide limited protection. As such, we introduce FlowGuard, an input-side defense that reduces malicious success by up to 34% while preserving prompt utility. Our results position workflow formation as a new safety frontier for multi-agent LLM systems, opening a planning-time security perspective on how agent coordination itself can be attacked and defended.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 53 of its 64 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
53 of 64 references.
Closest ancestors · 14
Same direction, newest first
- 2026AgentSentry: Mitigating Indirect Prompt Injection in LLM Agents via Temporal Causal Diagnostics and Context Purification26 Feb
- 2025TAMAS: Benchmarking Adversarial Risks in Multi-Agent LLM Systems7 Nov
- 2025PEAR: Planner-Executor Agent Robustness Benchmark8 Oct
- 2025BlindGuard: Safeguarding LLM-based Multi-Agent Systems under Unknown Attacks11 Aug
- 2025GUARDIAN: Safeguarding LLM Multi-Agent Collaborations with Temporal Graph Modeling25 May
- 2025IP Leakage Attacks Targeting LLM-Based Multi-Agent Systems18 May
- 2025Prompt Injection Attack to Tool Selection in LLM Agents28 Apr
- 2025Multi-Agent Systems Execute Arbitrary Malicious Code15 Mar
- 2025Memory Injection Attacks on LLM Agents via Query-Only Interaction5 Mar
- 2025Red-Teaming LLM Multi-Agent Systems via Communication Attacks20 Feb
- 2025G-Safeguard: A Topology-Guided Security Lens and Treatment on LLM-based Multi-agent Systems16 Feb
- 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems9 Oct
2 more
Other references · 39
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
- 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
27 more
- 2024AFlow: Automating Agentic Workflow Generationcited by 432
- 2024Automated Design of Agentic Systemscited by 407
- 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 257
- 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Taskscited by 195
- 2024TradingAgents: Multi-Agents LLM Financial Trading Frameworkcited by 188
- 2024Agent S: An Open Agentic Framework that Uses Computers Like a Humancited by 187
- 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Societycited by 186
- 2024Emergent social conventions and collective bias in LLM populationscited by 123
- 2024Automatic and Universal Prompt Injection Attacks against Large Language Modelscited by 119
- 2025GuardReasoner: Towards Reasoning-based LLM Safeguardscited by 100
- 2025MasRouter: Learning to Route LLMs for Multi-Agent Systemscited by 88
- 2024MultiAgent Collaboration Attack: Investigating Adversarial Attacks in Large Language Model Collaborations via Debatecited by 56
- 2025Do as We Do, Not as You Think: the Conformity of Large Language Modelscited by 53
- 2024AgentOps: Enabling Observability of LLM Agentscited by 46
- 2024OSCAR: Operating System Control via State-Aware Reasoning and Re-Planningcited by 38
- 2025Peacemaker or Troublemaker: How Sycophancy Shapes Multi-Agent Debatecited by 29
- 2025When One LLM Drools, Multi-LLM Collaboration Rulescited by 28
- 2026"Humans welcome to observe": A First Look at the Agent Social Network Moltbookcited by 26
- 2025Division-of-Thoughts: Harnessing Hybrid Language Model Synergy for Efficient On-Device Agentscited by 25
- 2025Heterogeneous Swarms: Jointly Optimizing Model Roles and Weights for Multi-LLM Systemscited by 23
- 2025LLM Economist: Large Population Models and Mechanism Design in Multi-Agent Generative Simulacracited by 22
- 2025LLMs Can't Handle Peer Pressure: Crumbling under Multi-Agent Social Interactionscited by 16
- 2026Conformity and Social Impact on AI Agentscited by 16
- 2025Herd Behavior: Investigating Peer Influence in LLM-based Multi-Agent Systemscited by 15
- 2025Goal-Aware Identification and Rectification of Misinformation in Multi-Agent Systemscited by 8
- 2025An Empirical Study of Group Conformity in Multi-Agent Systemscited by 7
- 2026Epistemic Context Learning: Building Trust the Right Way in LLM-Based Multi-Agent Systemscited by 6
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Operational Reframing and Approval-Framed Delegation in Multi-Agent LLM Safetycited by 3
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligencecited by 3
- 2026CollabSim: A CSCW-Grounded Methodology for Investigating Collaborative Competence of LLM Agents through Controlled Multi-Agent Experimentscited by 2
- 2026The Deliberative Illusion: Diagnosing Factual Attrition and Stance Homogenization in Multi-Agent LLM Deliberationcited by 1
- 2026Agent Harness Distillation: Inference-Time Harness Extraction and Exploitation in Autonomous Multi-Agent Systemscited by 1
- 2026SoK: When Safe Agents Fail Together: The Security of Multi Agent LLM Systemscited by 1
- 2026Right Answers, Wrong States: Hidden Information Failures in Multi-Agent Collaborationcited by 0
- 2026Right Answers, Wrong States: Hidden Information Failures in Multi-Agent Collaboration1 Oct 2026
- 2026SoK: When Safe Agents Fail Together: The Security of Multi Agent LLM Systems1 Sep 2026
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence21 Aug 2026
- 2026Agent Harness Distillation: Inference-Time Harness Extraction and Exploitation in Autonomous Multi-Agent Systems30 Jul 2026
- 2026Operational Reframing and Approval-Framed Delegation in Multi-Agent LLM Safety8 Jul 2026
- 2026CollabSim: A CSCW-Grounded Methodology for Investigating Collaborative Competence of LLM Agents through Controlled Multi-Agent Experiments4 Jun 2026
- 2026The Deliberative Illusion: Diagnosing Factual Attrition and Stance Homogenization in Multi-Agent LLM Deliberation2 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026ChainFuzzer: Greybox Fuzzing for Workflow-Level Multi-Tool Vulnerabilities in LLM Agents
- 2026Smarter Saboteurs, Better Fixers: Scaling & Security in Linear Multi-Agent Workflows
- 2026PlanFlip: Attacking Multi-Agent LLM Systems via Planning-Phase Prompt Injection
- 2026HARP: Measuring Harm Amplification in Multi-Agent LLM Systems
- 2026Skynet: Workflow-Level Anomaly Detection for Agentic AI via Semantic and Structural Modeling
- 2026Agent-Canary-Mas: End-to-End Evaluation of Protocol Risk in Long-Horizon Multi-Agent Systems
- 2025Les Dissonances: Cross-Tool Harvesting and Polluting in Pool-of-Tools Empowered LLM Agents
- 2026Hiding in Plain Sight: Decoupling Pretext from Actuation for Skill Poisoning in LLM Agents