Prompt Injection 2.0: Hybrid AI Threats
On the map: LLM safety and security → Prompt injection and agent security
Abstract (arXiv)
Prompt injection attacks, where malicious input is designed to manipulate AI systems into ignoring their original instructions and following unauthorized commands instead, were first discovered by Preamble, Inc. in May 2022 and responsibly disclosed to OpenAI. Over the last three years, these attacks have continued to pose a critical security threat to LLM-integrated systems. The emergence of agentic AI systems, where LLMs autonomously perform multistep tasks through tools and coordination with other agents, has fundamentally transformed the threat landscape. Modern prompt injection attacks can now combine with traditional cybersecurity exploits to create hybrid threats that systematically evade traditional security controls. This paper presents a comprehensive analysis of Prompt Injection 2.0, examining how prompt injections integrate with Cross-Site Scripting (XSS), Cross-Site Request Forgery (CSRF), and other web security vulnerabilities to bypass traditional security measures. We build upon Preamble's foundational research and mitigation technologies, evaluating them against contemporary threats, including AI worms, multi-agent infections, and hybrid cyber-AI attacks. Our analysis incorporates recent benchmarks that demonstrate how traditional web application firewalls, XSS filters, and CSRF tokens fail against AI-enhanced attacks. We also present architectural solutions that combine prompt isolation, runtime security, and privilege separation with novel threat detection capabilities.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 21 of its 29 references that are in the map. First posted on arXiv 17 Jul 2025.
Builds on
21 of 29 references.
Closest ancestors · 11
Same direction, newest first
- 2025Design Patterns for Securing LLM Agents against Prompt Injections10 Jun
- 2025Invisible Prompts, Visible Threats: Malicious Font Injection in External Resources for Large Language Models22 May
- 2025Defeating Prompt Injections by Design24 Mar
- 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems9 Oct
- 2024Defending Against Indirect Prompt Injection Attacks With Spotlighting20 Mar
- 2024Automatic and Universal Prompt Injection Attacks against Large Language Models7 Mar
- 2024Here Comes The AI Worm: Unleashing Zero-click Worms that Target GenAI-Powered Applications5 Mar
- 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Models21 Dec
- 2023Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of LLMs through a Global Scale Prompt Hacking Competition24 Oct
- 2023From Prompt Injections to SQL Injection Attacks: How Protected is Your LLM-Integrated Web Application?3 Aug
- 2023Prompt Injection attack against LLM-integrated Applications8 Jun
Other references · 10
- 2023Abusing Images and Sounds for Indirect Instruction Injection in Multi-Modal LLMscited by 117
- 2024LLM Agents can Autonomously Hack Websitescited by 108
- 2022Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examplescited by 65
- 2025Manipulating Multimodal Agents via Cross-Modal Prompt Injectioncited by 42
- 2024Human-Imperceptible Retrieval Poisoning Attacks in LLM-Powered Applicationscited by 32
- 2024Backdoored Retrievers for Prompt Injection Attacks on Retrieval Augmented Generation of Large Language Modelscited by 21
- 2024Learning to Poison Large Language Models for Downstream Manipulationcited by 15
- 2025The Hidden Dangers of Browsing AI Agentscited by 11
- 2025XOXO: Stealthy Cross-Origin Context Poisoning Attacks against AI Coding Assistantscited by 4
- 2024AI Ethics by Design: Implementing Customizable Guardrails for Responsible AI Developmentcited by 1
Built on by
Citing papers per year: 2025: 4; 2026: 8.
12 papers.
- 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challengescited by 26
- 2026A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypescited by 19
- 2026A Framework for Formalizing LLM Agent Securitycited by 16
- 2026MCP-ITP: An Automated Framework for Implicit Tool Poisoning in MCPcited by 13
- 2025Semantic Attacks on Tool-Augmented LLMs: Securing the Model Context Protocol Against Descriptor-Level Manipulationcited by 12
- 2025POT: Inducing Overthinking in LLMs via Black-Box Iterative Optimizationcited by 11
- 2026SOK: A Taxonomy of Attack Vectors and Defense Strategies for Agentic Supply Chain Runtimecited by 8
- 2026StealthGraph: Exposing Domain-Specific Risks in LLMs through Knowledge-Graph-Guided Harmful Prompt Generationcited by 4
- 2025Neuro-Symbolic AI for Cybersecurity: State of the Art, Challenges, and Opportunitiescited by 2
- 2026How do AI agents talk about science and research? An exploration of scientific discussions on Moltbook using BERTopiccited by 1
- 2026The Anatomy of a Prompt Injection: A Component Model for Structured Analysiscited by 0
- 2026Beyond Single-Model Injection: A Threat Model and Defense Architecture for Prompt Injection in Multi-Agent Systemscited by 0
- 2026Beyond Single-Model Injection: A Threat Model and Defense Architecture for Prompt Injection in Multi-Agent Systems19 Sep 2026
- 2026The Anatomy of a Prompt Injection: A Component Model for Structured Analysis7 Aug 2026
- 2026A Framework for Formalizing LLM Agent Security19 Mar 2026
- 2026How do AI agents talk about science and research? An exploration of scientific discussions on Moltbook using BERTopic11 Mar 2026
- 2026SOK: A Taxonomy of Attack Vectors and Defense Strategies for Agentic Supply Chain Runtime23 Feb 2026
- 2026MCP-ITP: An Automated Framework for Implicit Tool Poisoning in MCP12 Jan 2026
- 2026A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypes8 Jan 2026
- 2026StealthGraph: Exposing Domain-Specific Risks in LLMs through Knowledge-Graph-Guided Harmful Prompt Generation8 Jan 2026
- 2025Semantic Attacks on Tool-Augmented LLMs: Securing the Model Context Protocol Against Descriptor-Level Manipulation6 Dec 2025
- 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges27 Oct 2025
- 2025Neuro-Symbolic AI for Cybersecurity: State of the Art, Challenges, and Opportunities8 Sep 2025
- 2025POT: Inducing Overthinking in LLMs via Black-Box Iterative Optimization23 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025BrowseSafe: Understanding and Preventing Prompt Injection Within AI Browser Agents
- 2026Your Agent is More Brittle Than You Think: Uncovering Indirect Injection Vulnerabilities in Agentic LLMs
- 2026When Prompts Control Robots: Prompt Injection Attacks in Multi-Agent Robotic Systems
- 2025From Prompt Injections to Protocol Exploits: Threats in LLM-Powered AI Agents Workflows
- 2026What If Prompt Injection Never Left? Rethinking Agent Security through Cross-Session Stored Prompt Injection
- 2025A Multi-Agent LLM Defense Pipeline Against Prompt Injection Attacks
- 2026Defense Against Indirect Prompt Injection via Tool Result Parsing
- 2026Assessing Automated Prompt Injection Attacks in Agentic Environments