Voice-Enabled AI Agents can Perform Common Scams
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Recent advances in multi-modal, highly capable LLMs have enabled voice-enabled AI agents. These agents are enabling new applications, such as voice-enabled autonomous customer service. However, with all AI capabilities, these new capabilities have the potential for dual use. In this work, we show that voice-enabled AI agents can perform the actions necessary to perform common scams. To do so, we select a list of common scams collected by the government and construct voice-enabled agents with directions to perform these scams. We conduct experiments on our voice-enabled agents and show that they can indeed perform the actions necessary to autonomously perform such scams. Our results raise questions around the widespread deployment of voice-enabled AI agents.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 8 of its 14 references that are in the map. First posted on arXiv 21 Oct 2024.
Builds on
8 of 14 references.
Closest ancestors · 2
Same direction, newest first
- 2024Teams of LLM Agents can Exploit Zero-Day Vulnerabilities2 Jun
- 2024LLM Agents can Autonomously Hack Websites6 Feb
Other references · 6
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2021Ethical and social risks of harm from Language Modelscited by 957
- 2023Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attackscited by 268
- 2024On the Conversational Persuasiveness of Large Language Models: A Randomized Controlled Trialcited by 105
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025Levels of Autonomy for AI Agentscited by 45
- 2025Infrastructure for AI Agentscited by 40
- 2026A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypescited by 19
- 2026Open-Jev Judgments on CallScreenBench: Calibrated One-Pass Scam Screening with a Small Language Modelcited by 7
- 2025From Turing to Tomorrow: The UK's Approach to AI Regulationcited by 0
- 2026Open-Jev Judgments on CallScreenBench: Calibrated One-Pass Scam Screening with a Small Language Model21 Sep 2026
- 2026A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypes8 Jan 2026
- 2025From Turing to Tomorrow: The UK's Approach to AI Regulation3 Jul 2025
- 2025Levels of Autonomy for AI Agents14 Jun 2025
- 2025Infrastructure for AI Agents17 Jan 2025
Similar, not cited
Close in wording, no citation either way
- 2025ScamAgents: How AI Agents Can Simulate Human-Level Scam Calls
- 2026Aegis: Towards Governance, Integrity, and Security of AI Voice Agents
- 2025CASE: An Agentic AI Framework for Enhancing Scam Intelligence in Digital Payments
- 2025Love, Lies, and Language Models: Investigating AI's Role in Romance-Baiting Scams
- 2026Black-Box Forensics for Conversational LLM Agents
- 2026ScamPilot: Simulating Conversations with LLMs to Protect Against Online Scams ↗
- 2025Cloning a Conversational Voice AI Agent from Call,Recording Datasets for Telesales
- 2025A Survey of AI Agent Protocols