mlsanityData to 7 Oct 2026

Prompt Injection 2.0: Hybrid AI Threats

arXiv 2507.13169 ↗First posted 17 Jul 2025cs.CR cs.AIcited by 12

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

Prompt injection attacks, where malicious input is designed to manipulate AI systems into ignoring their original instructions and following unauthorized commands instead, were first discovered by Preamble, Inc. in May 2022 and responsibly disclosed to OpenAI. Over the last three years, these attacks have continued to pose a critical security threat to LLM-integrated systems. The emergence of agentic AI systems, where LLMs autonomously perform multistep tasks through tools and coordination with other agents, has fundamentally transformed the threat landscape. Modern prompt injection attacks can now combine with traditional cybersecurity exploits to create hybrid threats that systematically evade traditional security controls. This paper presents a comprehensive analysis of Prompt Injection 2.0, examining how prompt injections integrate with Cross-Site Scripting (XSS), Cross-Site Request Forgery (CSRF), and other web security vulnerabilities to bypass traditional security measures. We build upon Preamble's foundational research and mitigation technologies, evaluating them against contemporary threats, including AI worms, multi-agent infections, and hybrid cyber-AI attacks. Our analysis incorporates recent benchmarks that demonstrate how traditional web application firewalls, XSS filters, and CSRF tokens fail against AI-enhanced attacks. We also present architectural solutions that combine prompt isolation, runtime security, and privilege separation with novel threat detection capabilities.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 21 of its 29 references that are in the map. First posted on arXiv 17 Jul 2025.

Builds on

21 of 29 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025Design Patterns for Securing LLM Agents against Prompt Injections10 Jun
  2. 2025Invisible Prompts, Visible Threats: Malicious Font Injection in External Resources for Large Language Models22 May
  3. 2025Defeating Prompt Injections by Design24 Mar
  4. 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems9 Oct
  5. 2024Defending Against Indirect Prompt Injection Attacks With Spotlighting20 Mar
  6. 2024Automatic and Universal Prompt Injection Attacks against Large Language Models7 Mar
  7. 2024Here Comes The AI Worm: Unleashing Zero-click Worms that Target GenAI-Powered Applications5 Mar
  8. 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Models21 Dec
  9. 2023Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of LLMs through a Global Scale Prompt Hacking Competition24 Oct
  10. 2023From Prompt Injections to SQL Injection Attacks: How Protected is Your LLM-Integrated Web Application?3 Aug
  11. 2023Prompt Injection attack against LLM-integrated Applications8 Jun

Other references · 10

  1. 2023Abusing Images and Sounds for Indirect Instruction Injection in Multi-Modal LLMscited by 117
  2. 2024LLM Agents can Autonomously Hack Websitescited by 108
  3. 2022Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examplescited by 65
  4. 2025Manipulating Multimodal Agents via Cross-Modal Prompt Injectioncited by 42
  5. 2024Human-Imperceptible Retrieval Poisoning Attacks in LLM-Powered Applicationscited by 32
  6. 2024Backdoored Retrievers for Prompt Injection Attacks on Retrieval Augmented Generation of Large Language Modelscited by 21
  7. 2024Learning to Poison Large Language Models for Downstream Manipulationcited by 15
  8. 2025The Hidden Dangers of Browsing AI Agentscited by 11
  9. 2025XOXO: Stealthy Cross-Origin Context Poisoning Attacks against AI Coding Assistantscited by 4
  10. 2024AI Ethics by Design: Implementing Customizable Guardrails for Responsible AI Developmentcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 8.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025BrowseSafe: Understanding and Preventing Prompt Injection Within AI Browser Agents
  2. 2026Your Agent is More Brittle Than You Think: Uncovering Indirect Injection Vulnerabilities in Agentic LLMs
  3. 2026When Prompts Control Robots: Prompt Injection Attacks in Multi-Agent Robotic Systems
  4. 2025From Prompt Injections to Protocol Exploits: Threats in LLM-Powered AI Agents Workflows
  5. 2026What If Prompt Injection Never Left? Rethinking Agent Security through Cross-Session Stored Prompt Injection
  6. 2025A Multi-Agent LLM Defense Pipeline Against Prompt Injection Attacks
  7. 2026Defense Against Indirect Prompt Injection via Tool Result Parsing
  8. 2026Assessing Automated Prompt Injection Attacks in Agentic Environments