mlsanityData to 14 Oct 2026

Phishing Email Detection Using Large Language Models

arXiv 2512.10104 ↗First posted 10 Dec 2025cs.CR cs.AI cs.IRcited by 0

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

Email phishing is one of the most prevalent and globally consequential vectors of cyber intrusion. As systems increasingly deploy Large Language Models (LLMs) applications, these systems face evolving phishing email threats that exploit their fundamental architectures. Current LLMs require substantial hardening before deployment in email security systems, particularly against coordinated multi-vector attacks that exploit architectural vulnerabilities. This paper proposes LLMPEA, an LLM-based framework to detect phishing email attacks across multiple attack vectors, including prompt injection, text refinement, and multilingual attacks. We evaluate three frontier LLMs (e.g., GPT-4o, Claude Sonnet 4, and Grok-3) and comprehensive prompting design to assess their feasibility, robustness, and limitations against phishing email attacks. Our empirical analysis reveals that LLMs can detect the phishing email over 90% accuracy while we also highlight that LLM-based phishing email detection systems could be exploited by adversarial attack, prompt injection, and multilingual attacks. Our findings provide critical insights for LLM-based phishing detection in real-world settings where attackers exploit multiple vulnerabilities in combination.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 18 of its 37 references that are in the map. First posted on arXiv 10 Dec 2025.

Builds on

18 of 37 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defenses19 Oct
  2. 2023Prompt Injection attack against LLM-integrated Applications8 Jun
  3. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection23 Feb

Other references · 15

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  3. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
  4. 2019How multilingual is Multilingual BERT?cited by 645
  5. 2020BERT-ATTACK: Adversarial Attack Against BERT Using BERTcited by 491
  6. 2021Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translationcited by 338
  7. 2020Translation Artifacts in Cross-lingual Transfer Learningcited by 96
  8. 2025MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluationcited by 79
  9. 2024Language Ranker: A Metric for Quantifying LLM Performance Across High and Low-Resource Languagescited by 38
  10. 2024ChatSpamDetector: Leveraging Large Language Models for Effective Phishing Email Detectioncited by 25
  11. 2019SOK: A Comprehensive Reexamination of Phishing Research from the Security Perspectivecited by 15
  12. 2024An Explainable Transformer-based Model for Phishing Email Detection: A Large Language Model Approachcited by 9
3 more
  1. 2023Bridging the Language Gap: Dynamic Learning Strategies for Improving Multilingual Performance in LLMscited by 8
  2. 2024Zero-Shot Spam Email Classification Using Pre-trained Large Language Modelscited by 2
  3. 2025Multilingual Email Phishing Attacks Detection using OSINT and Machine Learningcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Next-Generation Phishing: How LLM Agents Empower Cyber Attackers
  2. 2025Phishing Detection in the Gen-AI Era: Quantized LLMs vs Classical Models
  3. 2025An Investigation of Large Language Models and Their Vulnerabilities in Spam Detection
  4. 2026An Empirical Evaluation of Prompt Injection Vulnerabilities in Large Language Models Across Multilingual and Obfuscated Attack Scenarios
  5. 2026Clouding the Mirror: Stealthy Prompt Injection Attacks Targeting LLM-based Phishing Detection
  6. 2025Evaluating Large Language Models for Phishing Detection, Self-Consistency, Faithfulness, and Explainability
  7. 2026User-Centric Phishing Detection: A RAG and LLM-Based Approach ↗
  8. 2025LLMail-Inject: A Dataset from a Realistic Adaptive Prompt Injection Challenge