Measuring the Security of Mobile LLM Agents under Adversarial Prompts from Untrusted Third-Party Channels
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 1 more
Abstract (arXiv)
Large Language Models (LLMs) have transformed software development, enabling AI-powered applications known as LLM-based agents that promise to automate tasks across diverse apps and workflows. Yet, the security implications of deploying such agents in adversarial mobile environments remain poorly understood. In this paper, we present the first systematic study of security risks in mobile LLM agents. We design and evaluate a suite of adversarial case studies, ranging from opportunistic manipulations such as pop-up advertisements to advanced, end-to-end workflows involving malware installation and cross-app data exfiltration. Our evaluation covers eight state-of-the-art mobile agents across three architectures, with over 2,000 adversarial and paired benign trials. The results reveal systemic vulnerabilities: low-barrier vectors such as fraudulent ads succeed with over 80% reliability, while even workflows requiring the circumvention of operating-system warnings, such as malware installation, are consistently completed by advanced multi-app agents. By mapping these attacks to the MITRE ATT&CK Mobile framework, we uncover novel privilege-escalation and persistence pathways unique to LLM-driven automation. Collectively, our findings provide the first end-to-end evidence that mobile LLM agents are exploitable in realistic adversarial settings, where untrusted third-party channels (e.g., ads, embedded webviews, cross-app notifications) are an inherent part of the mobile ecosystem.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 41 of its 70 references that are in the map. First posted on arXiv 31 Oct 2025.
Builds on
41 of 70 references.
Closest ancestors · 14
Same direction, newest first
- 2025Simple Prompt Injection Attacks Can Leak Personal Data Observed by LLM Agents During Task Execution1 Jun
- 2025LLM Agents Should Employ Security Principles29 May
- 2025From Assistants to Adversaries: Exploring the Security Risks of Mobile LLM Agents19 May
- 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
- 2025SafeArena: Evaluating the Safety of Autonomous Web Agents6 Mar
- 2025Commercial LLM Agents Are Already Vulnerable to Simple Yet Dangerous Attacks12 Feb
- 2024Attacking Vision-Language Computer Agents via Pop-ups4 Nov
- 2024Refusal-Trained LLMs Are Easily Jailbroken As Browser Agents11 Oct
- 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
- 2024Dissecting Adversarial Robustness of Multimodal LM Agents18 Jun
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
2 more
Other references · 27
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2023Large Language Modelscited by 774
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 547
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 441
- 2023AppAgent: Multimodal Agents as Smartphone Userscited by 407
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 328
- 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perceptioncited by 283
- 2023AutoDroid: LLM-powered Task Automation in Androidcited by 178
- 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Taskscited by 128
- 2025AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectoriescited by 99
15 more
- 2024AutoGLM: Autonomous Foundation Agents for GUIscited by 96
- 2024SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluationcited by 79
- 2022Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examplescited by 65
- 2024MobileAgentBench: An Efficient and User-Friendly Benchmark for Mobile LLM Agentscited by 63
- 2025AgentRL: Scaling Agentic Reinforcement Learning with a Multi-Turn, Multi-Task Frameworkcited by 58
- 2024Mobile-Bench: An Evaluation Benchmark for LLM-based Mobile Agentscited by 56
- 2025ComputerRL: Scaling End-to-End Online Reinforcement Learning for Computer Use Agentscited by 49
- 2023DroidBot-GPT: GPT-powered UI Automation for Androidcited by 47
- 2025MobileRL: Online Agentic Reinforcement Learning for Mobile GUI Agentscited by 43
- 2025AutoEval: A Practical Framework for Autonomous Evaluation of Mobile Agentscited by 9
- 2025sudo rm -rf agentic_securitycited by 8
- 2020MadDroid: Characterising and Detecting Devious Ad Content for Android Appscited by 5
- 2021Research on Third-Party Libraries in AndroidApps: A Taxonomy and Systematic LiteratureReviewcited by 3
- 2024Careful About What App Promotion Ads Recommend! Detecting and Explaining Malware Promotion via App Promotion Graphcited by 3
- 2017BabelView: Evaluating the Impact of Code Injection Attacks in Mobile Webviewscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025A Survey of Attacks on Large Language Models
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation
- 2024Targeting the Core: A Simple and Effective Method to Attack RAG-based Agents via Direct LLM Manipulation
- 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Models
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attacks
- 2025TAMAS: Benchmarking Adversarial Risks in Multi-Agent LLM Systems
- 2025Breaking Agent Backbones: Evaluating the Security of Backbone LLMs in AI Agents
- 2025The Dark Side of LLMs: Agent-based Attack Vectors for System-level Compromise