Systematically Analyzing Prompt Injection Vulnerabilities in Diverse LLM Architectures
On the map: LLM safety and security → Prompt injection and agent security
Abstract (arXiv)
This study systematically analyzes the vulnerability of 36 large language models (LLMs) to various prompt injection attacks, a technique that leverages carefully crafted prompts to elicit malicious LLM behavior. Across 144 prompt injection tests, we observed a strong correlation between model parameters and vulnerability, with statistical analyses, such as logistic regression and random forest feature analysis, indicating that parameter size and architecture significantly influence susceptibility. Results revealed that 56 percent of tests led to successful prompt injections, emphasizing widespread vulnerability across various parameter sizes, with clustering analysis identifying distinct vulnerability profiles associated with specific model configurations. Additionally, our analysis uncovered correlations between certain prompt injection techniques, suggesting potential overlaps in vulnerabilities. These findings underscore the urgent need for robust, multi-layered defenses in LLMs deployed across critical infrastructure and sensitive industries. Successful prompt injection attacks could result in severe consequences, including data breaches, unauthorized access, or misinformation. Future research should explore multilingual and multi-step defenses alongside adaptive mitigation strategies to strengthen LLM security in diverse, real-world environments.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. First posted on arXiv 28 Oct 2024.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2025: 8; 2026: 4.
12 papers.
- 2025When Models Reason in Your Language: Controlling Thinking Language Comes at the Cost of Accuracycited by 13
- 2025SoK: Trust-Authorization Mismatch in LLM Agent Interactionscited by 11
- 2026Crosslingual On-Policy Self-Distillation for Multilingual Reasoningcited by 10
- 2026Large Reasoning Models Are (Not Yet) Multilingual Latent Reasonerscited by 8
- 2025A Comprehensive Evaluation of Multilingual Chain-of-Thought Reasoning: Performance, Consistency, and Faithfulness Across Languagescited by 6
- 2025Multimodal Prompt Injection Attacks: Risks and Defenses for Modern LLMscited by 4
- 2026Architecture Matters for Multi-Agent Securitycited by 3
- 2025Distractor Injection Attacks on Large Reasoning Models: Characterization and Defensecited by 2
- 2025Please Don't Kill My Vibe: Empowering Agents with Data Flow Controlcited by 2
- 2026Zero-Shot Embedding Drift Detection: A Lightweight Defense Against Prompt Injections in LLMscited by 2
- 2025VSF-Med:A Vulnerability Scoring Framework for Medical Vision-Language Modelscited by 1
- 2025LLM in the Middle: A Systematic Review of Threats and Mitigations to Real-World LLM-based Systemscited by 1
- 2026Crosslingual On-Policy Self-Distillation for Multilingual Reasoning10 May 2026
- 2026Architecture Matters for Multi-Agent Security25 Apr 2026
- 2026Zero-Shot Embedding Drift Detection: A Lightweight Defense Against Prompt Injections in LLMs18 Jan 2026
- 2026Large Reasoning Models Are (Not Yet) Multilingual Latent Reasoners6 Jan 2026
- 2025SoK: Trust-Authorization Mismatch in LLM Agent Interactions7 Dec 2025
- 2025Please Don't Kill My Vibe: Empowering Agents with Data Flow Control5 Dec 2025
- 2025Distractor Injection Attacks on Large Reasoning Models: Characterization and Defense17 Oct 2025
- 2025A Comprehensive Evaluation of Multilingual Chain-of-Thought Reasoning: Performance, Consistency, and Faithfulness Across Languages10 Oct 2025
- 2025LLM in the Middle: A Systematic Review of Threats and Mitigations to Real-World LLM-based Systems12 Sep 2025
- 2025Multimodal Prompt Injection Attacks: Risks and Defenses for Modern LLMs7 Sep 2025
- 2025VSF-Med:A Vulnerability Scoring Framework for Medical Vision-Language Models25 Jun 2025
- 2025When Models Reason in Your Language: Controlling Thinking Language Comes at the Cost of Accuracy28 May 2025