PromptLocate: Localizing Prompt Injection Attacks
On the map: LLM safety and security → Prompt injection and agent security
Abstract (arXiv)
Prompt injection attacks deceive a large language model into completing an attacker-specified task instead of its intended task by contaminating its input data with an injected prompt, which consists of injected instruction(s) and data. Localizing the injected prompt within contaminated data is crucial for post-attack forensic analysis and data recovery. Despite its growing importance, prompt injection localization remains largely unexplored. In this work, we bridge this gap by proposing PromptLocate, the first method for localizing injected prompts. PromptLocate comprises three steps: (1) splitting the contaminated data into semantically coherent segments, (2) identifying segments contaminated by injected instructions, and (3) pinpointing segments contaminated by injected data. We show PromptLocate accurately localizes injected prompts across eight existing and eight adaptive attacks.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 32 of its 49 references that are in the map. First posted on arXiv 14 Oct 2025.
Builds on
32 of 49 references.
Closest ancestors · 20
Same direction, newest first
- 2025A Critical Evaluation of Defenses against Prompt Injection Attacks23 May
- 2025Lessons from Defending Gemini Against Indirect Prompt Injections20 May
- 2025WebInject: Prompt Injection Attack to Web Agents16 May
- 2025Prompt Injection Attack to Tool Selection in LLM Agents28 Apr
- 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attacks15 Apr
- 2025Defeating Prompt Injections by Design24 Mar
- 2025Can Indirect Prompt Injection Attacks Be Detected and Removed?23 Feb
- 2024Enhancing Prompt Injection Attacks to LLMs via Poisoning Alignment18 Oct
- 2024Instructional Segment Embedding: Improving LLM Safety with Instruction Hierarchy9 Oct
- 2024SecAlign: Defending Against Prompt Injection with Preference Optimization7 Oct
- 2024System-Level Defense against Indirect Prompt Injection Attacks: An Information Flow Control Perspective27 Sep
- 2024Get my drift? Catching LLM Task Drift with Activation Deltas2 Jun
8 more
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions19 Apr
- 2024Optimization-based Prompt Injection Attack to LLM-as-a-Judge26 Mar
- 2024Automatic and Universal Prompt Injection Attacks against Large Language Models7 Mar
- 2024Neural Exec: Learning (and Learning from) Execution Triggers for Prompt Injection Attacks6 Mar
- 2024StruQ: Defending Against Prompt Injection with Structured Queries9 Feb
- 2023Jatmo: Prompt Injection Defense by Task-Specific Finetuning29 Dec
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defenses19 Oct
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection23 Feb
Other references · 12
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2023Mistral 7Bcited by 3,164
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 838
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
- 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 593
- 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
- 2024PLeak: Prompt Leaking Attacks against Large Language Model Applicationscited by 127
- 2025Securing AI Agents with Information-Flow Controlcited by 121
- 2024Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?cited by 81
- 2025Fun-tuning: Characterizing the Vulnerability of Proprietary LLMs to Optimization-based Prompt Injection Attacks via the Fine-Tuning Interfacecited by 17
Built on by
Citing papers per year: 2025: 4; 2026: 24.
28 papers.
Sort:
By area:
- 2025Defending Against Prompt Injection with DataFiltercited by 35
- 2026The Landscape of Prompt Injection Threats in LLM Agents: From Taxonomy to Analysiscited by 30
- 2026ClawGuard: A Runtime Security Framework for Tool-Augmented LLM Agents Against Indirect Prompt Injectioncited by 27
- 2025PIShield: Detecting Prompt Injection Attacks via Intrinsic LLM Featurescited by 20
- 2025ObliInjection: Order-Oblivious Prompt Injection Attack to LLM Agents with Multi-source Datacited by 18
- 2026PISmith: Reinforcement Learning-based Red Teaming for Prompt Injection Defensescited by 16
- 2026A Framework for Formalizing LLM Agent Securitycited by 16
- 2026Towards Secure Agent Skills: Architecture, Threat Taxonomy, and Security Analysiscited by 13
- 2026WebSentinel: Detecting and Localizing Prompt Injection Attacks for Web Agentscited by 11
- 2026Your Agentic LLMs Secretly Encode Indirect Prompt-Injection Exposure in Hidden Statescited by 7
- 2026AgentWatcher: A Rule-based Prompt Injection Monitorcited by 6
- 2026AgentVisor: Defending LLM Agents Against Prompt Injection via Semantic Virtualizationcited by 6
16 more
- 2026AlignSentinel: Alignment-Aware Detection of Prompt Injection Attackscited by 5
- 2026Measuring Real-World Prompt Injection Attacks in LLM-based Resume Screeningcited by 5
- 2025AI Security Beyond Core Domains: Resume Screening as a Case Study of Adversarial Vulnerabilities in Specialized LLM Applicationscited by 3
- 2026RedVisor: Reasoning-Aware Prompt Injection Defense via Zero-Copy KV Cache Reusecited by 2
- 2026Who Broke the System? Failure Localization in LLM-Based Multi-Agent Systemscited by 2
- 2026Beyond Over-Refusal: Defending Indirect Prompt Injection via Latent Instruction Manifoldscited by 1
- 2026Efficient and Adaptable Detection of Malicious LLM Prompts via Bootstrap Aggregationcited by 0
- 2026A Sentence Relation-Based Approach to Sanitizing Malicious Instructionscited by 0
- 2026Cordyceps: Covert Control Attacks on LLMs via Data Poisoningcited by 0
- 2026Safe to Check, Unsafe to Use: Relinking at the Compression Boundary of LLM Agentscited by 0
- 2026CPInj: Uncovering Prompt Injection Risks in Textual Collaborative Prompt Optimizationcited by 0
- 2026Piggybacking on Perception: Stealthy Concurrent Audio Prompt Injections against Multimodal LLM Agentscited by 0
- 2026ContextLeak: Exfiltrating LLM Agent Context via Malicious Toolscited by 0
- 2026Detecting and Localizing Segment-Level Poisoning in Multi-Source LLM-Agent Inputscited by 0
- 2026Origin Is All You Need: Provenance-Aware Transformers for Structural Trust-Boundary Separationcited by 0
- 2026Render Before Reading: Visual Rendering as a Prompt Injection Defensecited by 0
- 2026Render Before Reading: Visual Rendering as a Prompt Injection Defense28 Sep 2026
- 2026Origin Is All You Need: Provenance-Aware Transformers for Structural Trust-Boundary Separation17 Sep 2026
- 2026Detecting and Localizing Segment-Level Poisoning in Multi-Source LLM-Agent Inputs13 Sep 2026
- 2026ContextLeak: Exfiltrating LLM Agent Context via Malicious Tools28 Aug 2026
- 2026Beyond Over-Refusal: Defending Indirect Prompt Injection via Latent Instruction Manifolds23 Aug 2026
- 2026Your Agentic LLMs Secretly Encode Indirect Prompt-Injection Exposure in Hidden States1 Aug 2026
- 2026Piggybacking on Perception: Stealthy Concurrent Audio Prompt Injections against Multimodal LLM Agents30 Jul 2026
- 2026CPInj: Uncovering Prompt Injection Risks in Textual Collaborative Prompt Optimization21 Jul 2026
- 2026Who Broke the System? Failure Localization in LLM-Based Multi-Agent Systems8 Jul 2026
- 2026Safe to Check, Unsafe to Use: Relinking at the Compression Boundary of LLM Agents19 Jun 2026
- 2026Measuring Real-World Prompt Injection Attacks in LLM-based Resume Screening27 May 2026
- 2026Cordyceps: Covert Control Attacks on LLMs via Data Poisoning26 May 2026
16 more
- 2026A Sentence Relation-Based Approach to Sanitizing Malicious Instructions1 May 2026
- 2026AgentVisor: Defending LLM Agents Against Prompt Injection via Semantic Virtualization27 Apr 2026
- 2026ClawGuard: A Runtime Security Framework for Tool-Augmented LLM Agents Against Indirect Prompt Injection13 Apr 2026
- 2026Towards Secure Agent Skills: Architecture, Threat Taxonomy, and Security Analysis3 Apr 2026
- 2026AgentWatcher: A Rule-based Prompt Injection Monitor1 Apr 2026
- 2026A Framework for Formalizing LLM Agent Security19 Mar 2026
- 2026PISmith: Reinforcement Learning-based Red Teaming for Prompt Injection Defenses13 Mar 2026
- 2026AlignSentinel: Alignment-Aware Detection of Prompt Injection Attacks14 Feb 2026
- 2026The Landscape of Prompt Injection Threats in LLM Agents: From Taxonomy to Analysis11 Feb 2026
- 2026Efficient and Adaptable Detection of Malicious LLM Prompts via Bootstrap Aggregation8 Feb 2026
- 2026WebSentinel: Detecting and Localizing Prompt Injection Attacks for Web Agents3 Feb 2026
- 2026RedVisor: Reasoning-Aware Prompt Injection Defense via Zero-Copy KV Cache Reuse2 Feb 2026
- 2025AI Security Beyond Core Domains: Resume Screening as a Case Study of Adversarial Vulnerabilities in Specialized LLM Applications23 Dec 2025
- 2025ObliInjection: Order-Oblivious Prompt Injection Attack to LLM Agents with Multi-source Data10 Dec 2025
- 2025Defending Against Prompt Injection with DataFilter22 Oct 2025
- 2025PIShield: Detecting Prompt Injection Attacks via Intrinsic LLM Features15 Oct 2025
- 2026The Landscape of Prompt Injection Threats in LLM Agents: From Taxonomy to Analysiscited by 30
- 2026ClawGuard: A Runtime Security Framework for Tool-Augmented LLM Agents Against Indirect Prompt Injectioncited by 27
- 2025ObliInjection: Order-Oblivious Prompt Injection Attack to LLM Agents with Multi-source Datacited by 18
- 2026A Framework for Formalizing LLM Agent Securitycited by 16
- 2026Towards Secure Agent Skills: Architecture, Threat Taxonomy, and Security Analysiscited by 13
- 2026WebSentinel: Detecting and Localizing Prompt Injection Attacks for Web Agentscited by 11
- 2026Your Agentic LLMs Secretly Encode Indirect Prompt-Injection Exposure in Hidden Statescited by 7
- 2026AgentVisor: Defending LLM Agents Against Prompt Injection via Semantic Virtualizationcited by 6
- 2026Who Broke the System? Failure Localization in LLM-Based Multi-Agent Systemscited by 2
- 2026Safe to Check, Unsafe to Use: Relinking at the Compression Boundary of LLM Agentscited by 0
- 2026Piggybacking on Perception: Stealthy Concurrent Audio Prompt Injections against Multimodal LLM Agentscited by 0
- 2026ContextLeak: Exfiltrating LLM Agent Context via Malicious Toolscited by 0
12 most cited of 13 All 13 (JSON)
- 2026Detecting and Localizing Segment-Level Poisoning in Multi-Source LLM-Agent Inputs13 Sep 2026
- 2026ContextLeak: Exfiltrating LLM Agent Context via Malicious Tools28 Aug 2026
- 2026Your Agentic LLMs Secretly Encode Indirect Prompt-Injection Exposure in Hidden States1 Aug 2026
- 2026Piggybacking on Perception: Stealthy Concurrent Audio Prompt Injections against Multimodal LLM Agents30 Jul 2026
- 2026Who Broke the System? Failure Localization in LLM-Based Multi-Agent Systems8 Jul 2026
- 2026Safe to Check, Unsafe to Use: Relinking at the Compression Boundary of LLM Agents19 Jun 2026
- 2026AgentVisor: Defending LLM Agents Against Prompt Injection via Semantic Virtualization27 Apr 2026
- 2026ClawGuard: A Runtime Security Framework for Tool-Augmented LLM Agents Against Indirect Prompt Injection13 Apr 2026
- 2026Towards Secure Agent Skills: Architecture, Threat Taxonomy, and Security Analysis3 Apr 2026
- 2026A Framework for Formalizing LLM Agent Security19 Mar 2026
- 2026The Landscape of Prompt Injection Threats in LLM Agents: From Taxonomy to Analysis11 Feb 2026
- 2026WebSentinel: Detecting and Localizing Prompt Injection Attacks for Web Agents3 Feb 2026
12 newest of 13 All 13 (JSON)
- 2025Defending Against Prompt Injection with DataFiltercited by 35
- 2025PIShield: Detecting Prompt Injection Attacks via Intrinsic LLM Featurescited by 20
- 2026PISmith: Reinforcement Learning-based Red Teaming for Prompt Injection Defensescited by 16
- 2026AgentWatcher: A Rule-based Prompt Injection Monitorcited by 6
- 2026AlignSentinel: Alignment-Aware Detection of Prompt Injection Attackscited by 5
- 2026Measuring Real-World Prompt Injection Attacks in LLM-based Resume Screeningcited by 5
- 2026Beyond Over-Refusal: Defending Indirect Prompt Injection via Latent Instruction Manifoldscited by 1
- 2026Cordyceps: Covert Control Attacks on LLMs via Data Poisoningcited by 0
- 2026CPInj: Uncovering Prompt Injection Risks in Textual Collaborative Prompt Optimizationcited by 0
- 2026Origin Is All You Need: Provenance-Aware Transformers for Structural Trust-Boundary Separationcited by 0
- 2026Render Before Reading: Visual Rendering as a Prompt Injection Defensecited by 0
- 2026Render Before Reading: Visual Rendering as a Prompt Injection Defense28 Sep 2026
- 2026Origin Is All You Need: Provenance-Aware Transformers for Structural Trust-Boundary Separation17 Sep 2026
- 2026Beyond Over-Refusal: Defending Indirect Prompt Injection via Latent Instruction Manifolds23 Aug 2026
- 2026CPInj: Uncovering Prompt Injection Risks in Textual Collaborative Prompt Optimization21 Jul 2026
- 2026Measuring Real-World Prompt Injection Attacks in LLM-based Resume Screening27 May 2026
- 2026Cordyceps: Covert Control Attacks on LLMs via Data Poisoning26 May 2026
- 2026AgentWatcher: A Rule-based Prompt Injection Monitor1 Apr 2026
- 2026PISmith: Reinforcement Learning-based Red Teaming for Prompt Injection Defenses13 Mar 2026
- 2026AlignSentinel: Alignment-Aware Detection of Prompt Injection Attacks14 Feb 2026
- 2025Defending Against Prompt Injection with DataFilter22 Oct 2025
- 2025PIShield: Detecting Prompt Injection Attacks via Intrinsic LLM Features15 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026The Anatomy of a Prompt Injection: A Component Model for Structured Analysis
- 2025System Prompt Poisoning: Persistent Attacks on Large Language Models Beyond User Injection
- 2025PromptShield: Deployable Detection for Prompt Injection Attacks
- 2026BASIS: Breach-Aware Selective Prompt Injection Shielding with Prefill Attention Probes
- 2025PromptSleuth: Detecting Prompt Injection via Semantic Intent Invariance
- 2026LongPIBench: A Long-Context Benchmark for Prompt Injection
- 2023Evaluating the Instruction-Following Robustness of Large Language Models to Prompt Injection
- 2025Defending against Indirect Prompt Injection by Instruction Detection