mlsanityData to 14 Oct 2026

FlowSteer: Prompt-Only Workflow Steering Exposes Planning-Time Vulnerabilities in Multi-Agent LLM Systems

arXiv 2605.11514 ↗First posted 12 May 2026cs.CRcited by 7

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Multi-agent systems (MAS) powered by large language models (LLMs) increasingly adopt planner--executor architectures, where planners convert prompts into subtasks, roles, dependencies, and routing paths. This flexibility enables adaptive coordination, but exposes an attack surface in workflow formation: prompts can shape agent organization without modifying MAS infrastructure. We study this risk through social influence probing workflows to identify high-impact subtasks and malicious-signal propagation. The analysis reveals two vulnerabilities: workflow position can amplify or suppress a malicious signal, and sycophantic framing makes downstream agents more likely to relay it. We translate these findings into FlowSteer, a prompt-only workflow steering attack that converts vulnerability priors into one crafted prompt. FlowSteer aligns a malicious signal with influential task components and guides replanning toward dependencies that preserve propagation. Experiments show that FlowSteer increases malicious success by up to 55% over naive prompting, transfers across MAS setups, and remains effective with black-box topology inference. As FlowSteer biases the planning signals that generate the workflow, MAS defenses that inspect only the generated workflow provide limited protection. As such, we introduce FlowGuard, an input-side defense that reduces malicious success by up to 34% while preserving prompt utility. Our results position workflow formation as a new safety frontier for multi-agent LLM systems, opening a planning-time security perspective on how agent coordination itself can be attacked and defended.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 53 of its 64 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

53 of 64 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026AgentSentry: Mitigating Indirect Prompt Injection in LLM Agents via Temporal Causal Diagnostics and Context Purification26 Feb
  2. 2025TAMAS: Benchmarking Adversarial Risks in Multi-Agent LLM Systems7 Nov
  3. 2025PEAR: Planner-Executor Agent Robustness Benchmark8 Oct
  4. 2025BlindGuard: Safeguarding LLM-based Multi-Agent Systems under Unknown Attacks11 Aug
  5. 2025GUARDIAN: Safeguarding LLM Multi-Agent Collaborations with Temporal Graph Modeling25 May
  6. 2025IP Leakage Attacks Targeting LLM-Based Multi-Agent Systems18 May
  7. 2025Prompt Injection Attack to Tool Selection in LLM Agents28 Apr
  8. 2025Multi-Agent Systems Execute Arbitrary Malicious Code15 Mar
  9. 2025Memory Injection Attacks on LLM Agents via Query-Only Interaction5 Mar
  10. 2025Red-Teaming LLM Multi-Agent Systems via Communication Attacks20 Feb
  11. 2025G-Safeguard: A Topology-Guided Security Lens and Treatment on LLM-based Multi-agent Systems16 Feb
  12. 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems9 Oct
2 more
  1. 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
  2. 2024Flooding Spread of Manipulated Knowledge in LLM-Based Multi-Agent Communities10 Jul

Other references · 39

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  2. 2024GPT-4o System Cardcited by 4,588
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  5. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  6. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  7. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
  8. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  9. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  10. 2023ChatDev: Communicative Agents for Software Developmentcited by 919
  11. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
  12. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
27 more
  1. 2024AFlow: Automating Agentic Workflow Generationcited by 432
  2. 2024Automated Design of Agentic Systemscited by 407
  3. 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 257
  4. 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Taskscited by 195
  5. 2024TradingAgents: Multi-Agents LLM Financial Trading Frameworkcited by 188
  6. 2024Agent S: An Open Agentic Framework that Uses Computers Like a Humancited by 187
  7. 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Societycited by 186
  8. 2024Emergent social conventions and collective bias in LLM populationscited by 123
  9. 2024Automatic and Universal Prompt Injection Attacks against Large Language Modelscited by 119
  10. 2025GuardReasoner: Towards Reasoning-based LLM Safeguardscited by 100
  11. 2025MasRouter: Learning to Route LLMs for Multi-Agent Systemscited by 88
  12. 2024MultiAgent Collaboration Attack: Investigating Adversarial Attacks in Large Language Model Collaborations via Debatecited by 56
  13. 2025Do as We Do, Not as You Think: the Conformity of Large Language Modelscited by 53
  14. 2024AgentOps: Enabling Observability of LLM Agentscited by 46
  15. 2024OSCAR: Operating System Control via State-Aware Reasoning and Re-Planningcited by 38
  16. 2025Peacemaker or Troublemaker: How Sycophancy Shapes Multi-Agent Debatecited by 29
  17. 2025When One LLM Drools, Multi-LLM Collaboration Rulescited by 28
  18. 2026"Humans welcome to observe": A First Look at the Agent Social Network Moltbookcited by 26
  19. 2025Division-of-Thoughts: Harnessing Hybrid Language Model Synergy for Efficient On-Device Agentscited by 25
  20. 2025Heterogeneous Swarms: Jointly Optimizing Model Roles and Weights for Multi-LLM Systemscited by 23
  21. 2025LLM Economist: Large Population Models and Mechanism Design in Multi-Agent Generative Simulacracited by 22
  22. 2025LLMs Can't Handle Peer Pressure: Crumbling under Multi-Agent Social Interactionscited by 16
  23. 2026Conformity and Social Impact on AI Agentscited by 16
  24. 2025Herd Behavior: Investigating Peer Influence in LLM-based Multi-Agent Systemscited by 15
  25. 2025Goal-Aware Identification and Rectification of Misinformation in Multi-Agent Systemscited by 8
  26. 2025An Empirical Study of Group Conformity in Multi-Agent Systemscited by 7
  27. 2026Epistemic Context Learning: Building Trust the Right Way in LLM-Based Multi-Agent Systemscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ChainFuzzer: Greybox Fuzzing for Workflow-Level Multi-Tool Vulnerabilities in LLM Agents
  2. 2026Smarter Saboteurs, Better Fixers: Scaling & Security in Linear Multi-Agent Workflows
  3. 2026PlanFlip: Attacking Multi-Agent LLM Systems via Planning-Phase Prompt Injection
  4. 2026HARP: Measuring Harm Amplification in Multi-Agent LLM Systems
  5. 2026Skynet: Workflow-Level Anomaly Detection for Agentic AI via Semantic and Structural Modeling
  6. 2026Agent-Canary-Mas: End-to-End Evaluation of Protocol Risk in Long-Horizon Multi-Agent Systems
  7. 2025Les Dissonances: Cross-Tool Harvesting and Polluting in Pool-of-Tools Empowered LLM Agents
  8. 2026Hiding in Plain Sight: Decoupling Pretext from Actuation for Skill Poisoning in LLM Agents