From Assistants to Adversaries: Exploring the Security Risks of Mobile LLM Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
The growing adoption of large language models (LLMs) has led to a new paradigm in mobile computing--LLM-powered mobile AI agents--capable of decomposing and automating complex tasks directly on smartphones. However, the security implications of these agents remain largely unexplored. In this paper, we present the first comprehensive security analysis of mobile LLM agents, encompassing three representative categories: System-level AI Agents developed by original equipment manufacturers (e.g., YOYO Assistant), Third-party Universal Agents (e.g., Zhipu AI AutoGLM), and Emerging Agent Frameworks (e.g., Alibaba Mobile Agent). We begin by analyzing the general workflow of mobile agents and identifying security threats across three core capability dimensions: language-based reasoning, GUI-based interaction, and system-level execution. Our analysis reveals 11 distinct attack surfaces, all rooted in the unique capabilities and interaction patterns of mobile LLM agents, and spanning their entire operational lifecycle. To investigate these threats in practice, we introduce AgentScan, a semi-automated security analysis framework that systematically evaluates mobile LLM agents across all 11 attack scenarios. Applying AgentScan to nine widely deployed agents, we uncover a concerning trend: every agent is vulnerable to targeted attacks. In the most severe cases, agents exhibit vulnerabilities across eight distinct attack vectors. These attacks can cause behavioral deviations, privacy leakage, or even full execution hijacking. Based on these findings, we propose a set of defensive design principles and practical recommendations for building secure mobile LLM agents. Our disclosures have received positive feedback from two major device vendors. Overall, this work highlights the urgent need for standardized security practices in the fast-evolving landscape of LLM-driven mobile automation.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 39 of its 69 references that are in the map. First posted on arXiv 19 May 2025.
Builds on
39 of 69 references.
Closest ancestors · 5
Same direction, newest first
- 2024AdvAgent: Controllable Blackbox Red-teaming on Web Agents22 Oct
- 2024When LLMs Go Online: The Emerging Threat of Web-Enabled LLMs18 Oct
- 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakage17 Sep
- 2024WIPI: A New Web Threat for LLM-Driven Web Agents26 Feb
- 2024Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents17 Feb
Other references · 34
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 489
- 2023AppAgent: Multimodal Agents as Smartphone Userscited by 415
- 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 399
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
- 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 319
- 2023Role-Play with Large Language Modelscited by 294
- 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perceptioncited by 293
- 2024Jailbreak Attacks and Defenses Against Large Language Models: A Surveycited by 230
- 2024Trial and Error: Exploration-Based Trajectory Optimization for LLM Agentscited by 197
- 2024Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaborationcited by 189
22 more
- 2023Simple synthetic data reduces sycophancy in large language modelscited by 187
- 2023AutoDroid: LLM-powered Task Automation in Androidcited by 184
- 2024Large Language Model-Brained GUI Agents: A Surveycited by 162
- 2023Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injectioncited by 157
- 2024UFO: A UI-Focused Agent for Windows OS Interactioncited by 148
- 2024Optimization-based Prompt Injection Attack to LLM-as-a-Judgecited by 143
- 2023Translating Natural Language to Planning Goals with Large-Language Modelscited by 133
- 2024GUI Agents with Foundation Models: A Comprehensive Surveycited by 111
- 2024ScreenAgent: A Vision Language Model-driven Computer Control Agentcited by 102
- 2024Sycophancy in Large Language Models: Causes and Mitigationscited by 101
- 2024AutoGLM: Autonomous Foundation Agents for GUIscited by 100
- 2024Don't Listen To Me: Understanding and Exploring Jailbreak Prompts of Large Language Modelscited by 86
- 2024AppAgent v2: Advanced Agent for Flexible Mobile Interactionscited by 68
- 2024MobileAgentBench: An Efficient and User-Friendly Benchmark for Mobile LLM Agentscited by 63
- 2024Instruction Backdoor Attacks Against Customized LLMscited by 62
- 2024Mobile-Bench: An Evaluation Benchmark for LLM-based Mobile Agentscited by 56
- 2023DroidBot-GPT: GPT-powered UI Automation for Androidcited by 47
- 2024An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities against Strong Detectioncited by 40
- 2024Foundations and Recent Trends in Multimodal Mobile Agents: A Surveycited by 31
- 2024Glitch Tokens in Large Language Models: Categorization Taxonomy and Effective Detectioncited by 29
- 2023VisionTasker: Mobile Task Automation Using Vision Based UI Understanding and LLM Task Planningcited by 28
- 2024Learn to Disguise: Avoid Refusal Responses in LLM's Defense via a Multi-agent Attacker-Disguiser Gamecited by 5
Built on by
Citing papers per year: 2025: 5; 2026: 5.
10 papers.
- 2025SafeMobile: Chain-level Jailbreak Detection and Automated Evaluation for Multimodal Mobile Agentscited by 15
- 2025Exposing LLM User Privacy via Traffic Fingerprint Analysis: A Study of Privacy Risks in LLM Agent Interactionscited by 10
- 2026Mind the Gap: Action Rebinding Attacks against Android GUI Agentscited by 6
- 2026Blind Gods and Broken Screens: Architecting a Secure, Intent-Centric Mobile Agent Operating Systemcited by 4
- 2025Invisible to Humans, Triggered by Agents: Stealthy Jailbreak Attacks on Mobile Vision-Language Agentscited by 3
- 2025Countermind: A Multi-Layered Security Architecture for Large Language Modelscited by 2
- 2025Measuring the Security of Mobile LLM Agents under Adversarial Prompts from Untrusted Third-Party Channelscited by 0
- 2026ActReal: System-Level Mobile Agents Challenge Mobile Automation Detectioncited by 0
- 2026When Agents See Differently: Exposing UI Desynchronization Threats in Mobile Agentscited by 0
- 2026From Tapping to Hopping: Augmenting Mobile GUI Agents with App-Native Deeplinkscited by 0
- 2026From Tapping to Hopping: Augmenting Mobile GUI Agents with App-Native Deeplinks25 Sep 2026
- 2026When Agents See Differently: Exposing UI Desynchronization Threats in Mobile Agents15 Sep 2026
- 2026ActReal: System-Level Mobile Agents Challenge Mobile Automation Detection30 Aug 2026
- 2026Blind Gods and Broken Screens: Architecting a Secure, Intent-Centric Mobile Agent Operating System11 Feb 2026
- 2026Mind the Gap: Action Rebinding Attacks against Android GUI Agents18 Jan 2026
- 2025Measuring the Security of Mobile LLM Agents under Adversarial Prompts from Untrusted Third-Party Channels31 Oct 2025
- 2025Countermind: A Multi-Layered Security Architecture for Large Language Models13 Oct 2025
- 2025Invisible to Humans, Triggered by Agents: Stealthy Jailbreak Attacks on Mobile Vision-Language Agents9 Oct 2025
- 2025Exposing LLM User Privacy via Traffic Fingerprint Analysis: A Study of Privacy Risks in LLM Agent Interactions8 Oct 2025
- 2025SafeMobile: Chain-level Jailbreak Detection and Automated Evaluation for Multimodal Mobile Agents1 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation
- 2025Commercial LLM Agents Are Already Vulnerable to Simple Yet Dangerous Attacks
- 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studies
- 2026Toward Securing AI Agents Like Operating Systems
- 2026LLM-Based Agents for Software and Systems Security: Approaches, Applications, and Assessment
- 2025Bridging AI and Software Security: A Comparative Vulnerability Assessment of LLM Agent Deployment Paradigms
- 2024Understanding the Weakness of Large Language Model Agents within a Complex Android Environment
- 2026Taming OpenClaw: Security Analysis and Mitigation of Autonomous LLM Agent Threats