PhishDebate: An LLM-Based Multi-Agent Framework for Phishing Website Detection
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Phishing websites remain a major cybersecurity threat, exploiting deceptive structures, brand impersonation, and social engineering to evade detection. Recent advances in large language models (LLMs) have improved phishing detection through contextual understanding, yet most existing approaches rely on single-agent classification, which is prone to hallucination and often lacks interpretability and robustness. To address these limitations, we propose PhishDebate, a modular multi-agent LLM-based debate framework for phishing website detection. Four specialized agents independently analyze webpage aspects, including URL structure, HTML composition, semantic content, and brand impersonation, under the coordination of a Moderator and final Judge. Through structured debate and divergent reasoning, the framework achieves more accurate and interpretable decisions. By reducing uncertain predictions and providing transparent reasoning, PhishDebate functions as an analyst-augmentation system that lowers cognitive load and supports early, left-of-exploit detection of phishing threats. Evaluations on commercial LLMs show that PhishDebate achieves 98.2 % recall on a real-world phishing dataset and outperforms single-agent and Chain-of-Thought (CoT) baselines. Its modular design enables agent-level configurability, allowing adaptation to varying resource and application requirements, and offers scalability to high-velocity, large-scale security data environments.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 12 of its 40 references that are in the map. First posted on arXiv 18 Jun 2025.
Builds on
12 of 40 references.
Closest ancestors · 1
Same direction, newest first
Other references · 11
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Qwen Technical Reportcited by 3,344
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
- 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 742
- 2018Tranco: A Research-Oriented Top Sites Ranking Hardened Against Manipulationcited by 63
- 2024KnowPhish: Large Language Models Meet Multimodal Knowledge Graphs for Enhancing Reference-Based Phishing Detectioncited by 33
- 2021URLTran: Improving Phishing URL Detection Using Transformerscited by 18
- 2024Interpreting and Mitigating Hallucination in MLLMs through Multi-agent Debatecited by 16
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025PhishIntentionLLM: Uncovering Phishing Website Intentions through Multi-Agent Retrieval-Augmented Generation
- 2024PhishAgent: A Robust Multimodal Agent for Phishing Webpage Detection
- 2025CLASP: Cost-Optimized LLM-based Agentic System for Phishing Detection
- 2025MultiPhishGuard: An Explainable and Adaptive Multi-Agent LLM System for Phishing Email Detection
- 2024Automated Phishing Detection Using URLs and Webpages
- 2026MemoPhishAgent: Memory-Augmented Multi-Modal LLM Agent for Phishing URL Detection
- 2024Large Multimodal Agents for Accurate Phishing Detection with Enhanced Token Optimization and Cost Reduction
- 2025PhishLumos: An Adaptive Multi-Agent System for Proactive Phishing Campaign Mitigation