Phishing Email Detection Using Large Language Models
On the map: LLM safety and security → Prompt injection and agent security
Abstract (arXiv)
Email phishing is one of the most prevalent and globally consequential vectors of cyber intrusion. As systems increasingly deploy Large Language Models (LLMs) applications, these systems face evolving phishing email threats that exploit their fundamental architectures. Current LLMs require substantial hardening before deployment in email security systems, particularly against coordinated multi-vector attacks that exploit architectural vulnerabilities. This paper proposes LLMPEA, an LLM-based framework to detect phishing email attacks across multiple attack vectors, including prompt injection, text refinement, and multilingual attacks. We evaluate three frontier LLMs (e.g., GPT-4o, Claude Sonnet 4, and Grok-3) and comprehensive prompting design to assess their feasibility, robustness, and limitations against phishing email attacks. Our empirical analysis reveals that LLMs can detect the phishing email over 90% accuracy while we also highlight that LLM-based phishing email detection systems could be exploited by adversarial attack, prompt injection, and multilingual attacks. Our findings provide critical insights for LLM-based phishing detection in real-world settings where attackers exploit multiple vulnerabilities in combination.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 18 of its 37 references that are in the map. First posted on arXiv 10 Dec 2025.
Builds on
18 of 37 references.
Closest ancestors · 3
Same direction, newest first
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defenses19 Oct
- 2023Prompt Injection attack against LLM-integrated Applications8 Jun
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection23 Feb
Other references · 15
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
- 2019How multilingual is Multilingual BERT?cited by 645
- 2020BERT-ATTACK: Adversarial Attack Against BERT Using BERTcited by 491
- 2021Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translationcited by 338
- 2020Translation Artifacts in Cross-lingual Transfer Learningcited by 96
- 2025MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluationcited by 79
- 2024Language Ranker: A Metric for Quantifying LLM Performance Across High and Low-Resource Languagescited by 38
- 2024ChatSpamDetector: Leveraging Large Language Models for Effective Phishing Email Detectioncited by 25
- 2019SOK: A Comprehensive Reexamination of Phishing Research from the Security Perspectivecited by 15
- 2024An Explainable Transformer-based Model for Phishing Email Detection: A Large Language Model Approachcited by 9
3 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Next-Generation Phishing: How LLM Agents Empower Cyber Attackers
- 2025Phishing Detection in the Gen-AI Era: Quantized LLMs vs Classical Models
- 2025An Investigation of Large Language Models and Their Vulnerabilities in Spam Detection
- 2026An Empirical Evaluation of Prompt Injection Vulnerabilities in Large Language Models Across Multilingual and Obfuscated Attack Scenarios
- 2026Clouding the Mirror: Stealthy Prompt Injection Attacks Targeting LLM-based Phishing Detection
- 2025Evaluating Large Language Models for Phishing Detection, Self-Consistency, Faithfulness, and Explainability
- 2026User-Centric Phishing Detection: A RAG and LLM-Based Approach ↗
- 2025LLMail-Inject: A Dataset from a Realistic Adaptive Prompt Injection Challenge