Comment and Control: Hijacking Agentic Workflows via Context-Grounded Evolution
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Automation platforms such as GitHub Actions and n8n are increasingly adopting so-called agentic workflows, which integrate Large Language Model (LLM) agents for tasks such as code review and data synchronization. While bringing convenience for developers, this integration exposes a new risk: An adversary may control and craft certain inputs, such as GitHub issue comments, to manipulate the LLM agent for unwanted actions, such as credential exfiltration and arbitrary command execution. To our knowledge, no prior academic work has studied such a risk in agentic workflows. In this paper, we design the first detection and exploitation framework, called JAW, to hijack agentic workflows hosted on automation platforms via a novel approach called Context-Grounded Evolution. Our key idea is to evolve agentic workflow inputs under the contexts derived from hybrid program analysis for hijacking purposes. Specifically, JAW generates agentic workflow contexts through three analyses: (i) static path-feasibility analysis to identify feasible agent-invocation paths and the input constraints required to trigger them, (ii) dynamic prompt-provenance analysis to determine how that input is transformed and embedded into the LLM context, and (iii) capability analysis to identify the actions and restrictions available to the agent at runtime. Our evaluation of JAW on GitHub workflows and n8n templates showed that 4714 GitHub workflows and eight n8n templates can be successfully hijacked, for example, to leak user credentials. Our findings span 15 widely-used GitHub Actions, including official GitHub Actions for Claude Code, Gemini CLI, Qwen CLI, and Cursor CLI, and two official n8n nodes. We responsibly disclosed all findings to the affected vendors and received many acknowledgements, fixes, and bug bounties, notably from GitHub, Google, and Anthropic.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 11 of its 34 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
11 of 34 references.
References · 11
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,326
- 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 233
- 2024AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to Jailbreak LLMscited by 185
- 2023AutoDAN: Interpretable Gradient-Based Adversarial Attacks on Large Language Modelscited by 102
- 2024Don't Listen To Me: Understanding and Exploring Jailbreak Prompts of Large Language Modelscited by 77
- 2025MCPSecBench: A Systematic Security Benchmark and Playground for Testing Model Context Protocolscited by 47
- 2025AgentVigil: Generic Black-Box Red-teaming for Indirect Prompt Injection against LLM Agentscited by 42
- 2025MCP Security Bench (MSB): Benchmarking Attacks Against Model Context Protocol in LLM Agentscited by 37
- 2026Towards Verifiably Safe Tool Use for LLM Agentscited by 34
- 2021How Do Software Developers Use GitHub Actions to Automate Their Workflows?cited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Specifying and Maintaining Agentic Workflows: An Empirical Study of GitHub Agentic Workflows
- 2026Demystifying and Detecting Agentic Workflow Injection Vulnerabilities in GitHub Actions
- 2025AgentGuard: Repurposing Agentic Orchestrator for Safety Evaluation of Tool Orchestration
- 2026Natural-Language Workflows Are Not Software Yet: Artifact-Driven Compilation for Reliable Agent Execution
- 2026XAgent: eXecution-guided Agentic AI for Effective Localization and Resolution of GitHub Issues
- 2025AgentCompass: Towards Reliable Evaluation of Agentic Workflows in Production
- 2026Skynet: Workflow-Level Anomaly Detection for Agentic AI via Semantic and Structural Modeling
- 2026Security in the Age of AI Teammates: An Empirical Study of Agentic Pull Requests on GitHub