Debate-Driven Multi-Agent LLMs for Phishing Email Detection
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Phishing attacks remain a critical cybersecurity threat. Attackers constantly refine their methods, making phishing emails harder to detect. Traditional detection methods, including rule-based systems and supervised machine learning models, either rely on predefined patterns like blacklists, which can be bypassed with slight modifications, or require large datasets for training and still can generate false positives and false negatives. In this work, we propose a multi-agent large language model (LLM) prompting technique that simulates debates among agents to detect whether the content presented on an email is phishing. Our approach uses two LLM agents to present arguments for or against the classification task, with a judge agent adjudicating the final verdict based on the quality of reasoning provided. This debate mechanism enables the models to critically analyze contextual cue and deceptive patterns in text, which leads to improved classification accuracy. The proposed framework is evaluated on multiple phishing email datasets and demonstrate that mixed-agent configurations consistently outperform homogeneous configurations. Results also show that the debate structure itself is sufficient to yield accurate decisions without extra prompting strategies.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 6 of its 20 references that are in the map. First posted on arXiv 27 Mar 2025.
Builds on
6 of 20 references.
References · 6
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?cited by 159
- 2024ChatSpamDetector: Leveraging Large Language Models for Effective Phishing Email Detectioncited by 25
- 2025Enhancing Phishing Email Identification with Large Language Modelscited by 6
- 2022Phishing Attacks Detection -- A Machine Learning-Based Approachcited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 6.
9 papers.
- 2026A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypescited by 22
- 2026LLM Agents in Law: Taxonomy, Applications, and Challengescited by 5
- 2025PhishDebate: An LLM-Based Multi-Agent Framework for Phishing Website Detectioncited by 3
- 2026Yes FLoReNce, I Will Do Better Next Time! Agentic Feedback Reasoning for Humorous Meme Detectioncited by 3
- 2026Multi-Agent Debate Strategies: Survey, Taxonomy, and Challengescited by 3
- 2025Improving Phishing Email Detection Performance of Small Large Language Modelscited by 1
- 2025Trustworthiness Calibration Framework for Phishing Email Detection Using Large Language Modelscited by 0
- 2026Prompt Injection Detection for Email Agents Through Attack Chain Modelingcited by 0
- 2026Collaborative Principle Evolution via Evidence Transfer for Scientific Discoverycited by 0
- 2026Collaborative Principle Evolution via Evidence Transfer for Scientific Discovery28 Sep 2026
- 2026Prompt Injection Detection for Email Agents Through Attack Chain Modeling25 Sep 2026
- 2026Multi-Agent Debate Strategies: Survey, Taxonomy, and Challenges28 Jul 2026
- 2026Yes FLoReNce, I Will Do Better Next Time! Agentic Feedback Reasoning for Humorous Meme Detection12 Jan 2026
- 2026LLM Agents in Law: Taxonomy, Applications, and Challenges8 Jan 2026
- 2026A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypes8 Jan 2026
- 2025Trustworthiness Calibration Framework for Phishing Email Detection Using Large Language Models6 Nov 2025
- 2025PhishDebate: An LLM-Based Multi-Agent Framework for Phishing Website Detection18 Jun 2025
- 2025Improving Phishing Email Detection Performance of Small Large Language Models29 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2025MultiPhishGuard: An Explainable and Adaptive Multi-Agent LLM System for Phishing Email Detection
- 2024Next-Generation Phishing: How LLM Agents Empower Cyber Attackers
- 2025Evaluating Large Language Models for Phishing Detection, Self-Consistency, Faithfulness, and Explainability
- 2024Automated Phishing Detection Using URLs and Webpages
- 2025CLASP: Cost-Optimized LLM-based Agentic System for Phishing Detection
- 2025Phishing Email Detection Using Large Language Models
- 2024Prompted Contextual Vectors for Spear-Phishing Detection
- 2026User-Centric Phishing Detection: A RAG and LLM-Based Approach ↗