Bot Wars Evolved: Orchestrating Competing LLMs in a Counterstrike Against Phone Scams
Not on the map. Why?
Abstract (arXiv)
We present "Bot Wars," a framework using Large Language Models (LLMs) scam-baiters to counter phone scams through simulated adversarial dialogues. Our key contribution is a formal foundation for strategy emergence through chain-of-thought reasoning without explicit optimization. Through a novel two-layer prompt architecture, our framework enables LLMs to craft demographically authentic victim personas while maintaining strategic coherence. We evaluate our approach using a dataset of 3,200 scam dialogues validated against 179 hours of human scam-baiting interactions, demonstrating its effectiveness in capturing complex adversarial dynamics. Our systematic evaluation through cognitive, quantitative, and content-specific metrics shows that GPT-4 excels in dialogue naturalness and persona authenticity, while Deepseek demonstrates superior engagement sustainability.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 4 of its 13 references that are in the map. First posted on arXiv 10 Mar 2025.
Builds on
4 of 13 references.
References · 4
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2019Challenges in Building Intelligent Open-domain Dialog Systemscited by 147
- 2017A Deep Reinforcement Learning Chatbotcited by 36
- 2023Automatic Scam-Baiting Using ChatGPTcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypescited by 22
- 2025Send to which account? Evaluation of an LLM-based Scambaiting Systemcited by 3
- 2026DIALEVAL: Automated Type-Theoretic Evaluation of LLM Instruction Followingcited by 0
- 2026ORACLE: Anticipating Scams from Partial Trajectories in Streaming App Usagecited by 0
- 2026An Expanded Synthetic Conversation Dataset for Multi-Turn Smishing Detectioncited by 0
- 2026An Expanded Synthetic Conversation Dataset for Multi-Turn Smishing Detection5 Jun 2026
- 2026ORACLE: Anticipating Scams from Partial Trajectories in Streaming App Usage9 May 2026
- 2026DIALEVAL: Automated Type-Theoretic Evaluation of LLM Instruction Following10 Feb 2026
- 2026A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypes8 Jan 2026
- 2025Send to which account? Evaluation of an LLM-based Scambaiting System10 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025ScamAgents: How AI Agents Can Simulate Human-Level Scam Calls
- 2026The Anatomy of Conversational Scams: A Topic-Based Red Teaming Analysis of Multi-Turn Interactions in LLMs
- 2026ScamPilot: Simulating Conversations with LLMs to Protect Against Online Scams ↗
- 2025Anticipate, Simulate, Reason (ASR): A Comprehensive Generative AI Framework for Combating Messaging Scams
- 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs
- 2026Hidden in Plain Text: Measuring LLM Deception Quality Against Human Baselines Using Social Deduction Games
- 2026Adversarial Arena: Crowdsourcing Data Generation through Interactive Competition
- 2026A Low-Latency Fraud Detection Layer for Detecting Adversarial Interaction Patterns in LLM-Powered Agents