MATE: Policy-Aware Security Auditing for Mobile Agents via Synthesis-Driven Trajectory Learning
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Mobile agents powered by foundation models now automate complex, multi-step workflows on real devices, but their trajectories can violate app-specific security policies. Existing trajectory-level defenses rely on LLM prompting or rigid rules, and thus fail to support fine-grained, natural-language policies that generalize across apps and tasks. In this work, we introduce MATE, a lightweight, policy-conditioned auditor that encodes both agent trajectories and natural-language security policies to determine whether a trajectory violates a given policy and to explain why. Treating policies as editable text rather than fixed model parameters allows MATE to handle user-defined and evolving requirements without retraining. To construct MATE, we build a knowledge base by extracting app descriptions, workflows, and policies from hundreds of popular mobile apps worldwide, and synthesizing over 140K semantically realistic, policy-conditioned trajectories with a multi-stage pipeline. We further release MATEBench, a trajectory-level auditing benchmark with two synthetic subsets and one real-world subset of manually collected trajectories. Models trained with our synthesis-driven trajectory learning achieve over 95% accuracy on MATEBench, retain strong performance on external safety benchmarks, and audit trajectories from Zhipu's AutoGLM and Alibaba's Mobile-Agent on real devices with over 95% accuracy, outperforming prior methods by over 20%. MATE shows that practical, fine-grained security auditing for heterogeneous mobile agents is both feasible and effective.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 47 of its 57 references that are in the map. First posted on arXiv 19 Sep 2026.
Builds on
47 of 57 references.
Closest ancestors · 13
Same direction, newest first
- 2025Building a Foundational Guardrail for General Agentic Systems via Synthetic Data10 Oct
- 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safety8 Jul
- 2025AgentAuditor: Human-Level Safety and Security Evaluation for LLM Agents31 May
- 2025RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agents31 May
- 2025Think Twice Before You Act: Enhancing Agent Behavioral Safety with Thought Correction16 May
- 2025SafeArena: Evaluating the Safety of Autonomous Web Agents6 Mar
- 2024Agent-SafetyBench: Evaluating the Safety of LLM Agents19 Dec
- 2024SafeAgentBench: A Benchmark for Safe Task Planning of Embodied LLM Agents17 Dec
- 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct
- 2024ST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agents9 Oct
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
- 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agents18 Jan
1 more
Other references · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 563
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
- 2023AppAgent: Multimodal Agents as Smartphone Userscited by 415
- 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 295
- 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perceptioncited by 293
22 more
- 2024ShieldGemma: Generative AI Content Moderation Based on Gemmacited by 243
- 2024Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaborationcited by 189
- 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learningcited by 168
- 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesiscited by 163
- 2025Qwen3Guard Technical Reportcited by 155
- 2024Aria-UI: Visual Grounding for GUI Instructionscited by 140
- 2025InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasonerscited by 140
- 2024Autonomous Evaluation and Refinement of Digital Agentscited by 137
- 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Taskscited by 131
- 2024ScreenAgent: A Vision Language Model-driven Computer Control Agentcited by 102
- 2024AutoGLM: Autonomous Foundation Agents for GUIscited by 100
- 2025GUI-Actor: Coordinate-Free Visual Grounding for GUI Agentscited by 95
- 2024SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluationcited by 81
- 2024ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectorscited by 51
- 2024MobileSafetyBench: Evaluating Safety of Autonomous Agents in Mobile Device Controlcited by 51
- 2024HAICOSYSTEM: An Ecosystem for Sandboxing Safety Risks in Human-AI Interactionscited by 44
- 2024Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scalecited by 43
- 2025Step-GUI Technical Reportcited by 39
- 2025VeriSafe Agent: Safeguarding Mobile GUI Agent via Logic-based Action Verificationcited by 22
- 2025RealWebAssist: A Benchmark for Long-Horizon Web Assistance with Real-World Userscited by 21
- 2025ProBench: Benchmarking GUI Agents with Accurate Process Informationcited by 15
- 2025MVISU-Bench: Benchmarking Mobile Agents for Real-World Tasks by Multi-App, Vague, Interactive, Single-App and Unethical Instructionscited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesis
- 2026Jev-Guard: Fast Routing and Auditing Agent Actions over Editable Policy Trees
- 2026StepGuard: Learning Step-Level Guardrails with Scalable Supervision and Safety-Utility Balancing
- 2026Automated Trajectory Evaluation for Mobile Agents via Step-Level Consequence Reasoning and Aggregation
- 2025Learning Efficient Guardrails for Compliance
- 2026Towards Security-Auditable LLM Agents: A Unified Graph Representation
- 2025OS-Sentinel: Towards Safety-Enhanced Mobile GUI Agents via Hybrid Validation in Realistic Workflows
- 2026ActGov: Governing LLM Agent Actions via Policy-Constrained Validation