mlsanityData to 14 Oct 2026

MATE: Policy-Aware Security Auditing for Mobile Agents via Synthesis-Driven Trajectory Learning

arXiv 2609.22724 ↗First posted 19 Sep 2026cs.CR cs.AIcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Mobile agents powered by foundation models now automate complex, multi-step workflows on real devices, but their trajectories can violate app-specific security policies. Existing trajectory-level defenses rely on LLM prompting or rigid rules, and thus fail to support fine-grained, natural-language policies that generalize across apps and tasks. In this work, we introduce MATE, a lightweight, policy-conditioned auditor that encodes both agent trajectories and natural-language security policies to determine whether a trajectory violates a given policy and to explain why. Treating policies as editable text rather than fixed model parameters allows MATE to handle user-defined and evolving requirements without retraining. To construct MATE, we build a knowledge base by extracting app descriptions, workflows, and policies from hundreds of popular mobile apps worldwide, and synthesizing over 140K semantically realistic, policy-conditioned trajectories with a multi-stage pipeline. We further release MATEBench, a trajectory-level auditing benchmark with two synthetic subsets and one real-world subset of manually collected trajectories. Models trained with our synthesis-driven trajectory learning achieve over 95% accuracy on MATEBench, retain strong performance on external safety benchmarks, and audit trajectories from Zhipu's AutoGLM and Alibaba's Mobile-Agent on real devices with over 95% accuracy, outperforming prior methods by over 20%. MATE shows that practical, fine-grained security auditing for heterogeneous mobile agents is both feasible and effective.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 47 of its 57 references that are in the map. First posted on arXiv 19 Sep 2026.

Builds on

47 of 57 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025Building a Foundational Guardrail for General Agentic Systems via Synthetic Data10 Oct
  2. 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safety8 Jul
  3. 2025AgentAuditor: Human-Level Safety and Security Evaluation for LLM Agents31 May
  4. 2025RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agents31 May
  5. 2025Think Twice Before You Act: Enhancing Agent Behavioral Safety with Thought Correction16 May
  6. 2025SafeArena: Evaluating the Safety of Autonomous Web Agents6 Mar
  7. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agents19 Dec
  8. 2024SafeAgentBench: A Benchmark for Safe Task Planning of Embodied LLM Agents17 Dec
  9. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct
  10. 2024ST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agents9 Oct
  11. 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
  12. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agents18 Jan
1 more
  1. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep

Other references · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  4. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  5. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  6. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
  7. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  8. 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 563
  9. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
  10. 2023AppAgent: Multimodal Agents as Smartphone Userscited by 415
  11. 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 295
  12. 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perceptioncited by 293
22 more
  1. 2024ShieldGemma: Generative AI Content Moderation Based on Gemmacited by 243
  2. 2024Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaborationcited by 189
  3. 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learningcited by 168
  4. 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesiscited by 163
  5. 2025Qwen3Guard Technical Reportcited by 155
  6. 2024Aria-UI: Visual Grounding for GUI Instructionscited by 140
  7. 2025InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasonerscited by 140
  8. 2024Autonomous Evaluation and Refinement of Digital Agentscited by 137
  9. 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Taskscited by 131
  10. 2024ScreenAgent: A Vision Language Model-driven Computer Control Agentcited by 102
  11. 2024AutoGLM: Autonomous Foundation Agents for GUIscited by 100
  12. 2025GUI-Actor: Coordinate-Free Visual Grounding for GUI Agentscited by 95
  13. 2024SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluationcited by 81
  14. 2024ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectorscited by 51
  15. 2024MobileSafetyBench: Evaluating Safety of Autonomous Agents in Mobile Device Controlcited by 51
  16. 2024HAICOSYSTEM: An Ecosystem for Sandboxing Safety Risks in Human-AI Interactionscited by 44
  17. 2024Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scalecited by 43
  18. 2025Step-GUI Technical Reportcited by 39
  19. 2025VeriSafe Agent: Safeguarding Mobile GUI Agent via Logic-based Action Verificationcited by 22
  20. 2025RealWebAssist: A Benchmark for Long-Horizon Web Assistance with Real-World Userscited by 21
  21. 2025ProBench: Benchmarking GUI Agents with Accurate Process Informationcited by 15
  22. 2025MVISU-Bench: Benchmarking Mobile Agents for Real-World Tasks by Multi-App, Vague, Interactive, Single-App and Unethical Instructionscited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesis
  2. 2026Jev-Guard: Fast Routing and Auditing Agent Actions over Editable Policy Trees
  3. 2026StepGuard: Learning Step-Level Guardrails with Scalable Supervision and Safety-Utility Balancing
  4. 2026Automated Trajectory Evaluation for Mobile Agents via Step-Level Consequence Reasoning and Aggregation
  5. 2025Learning Efficient Guardrails for Compliance
  6. 2026Towards Security-Auditable LLM Agents: A Unified Graph Representation
  7. 2025OS-Sentinel: Towards Safety-Enhanced Mobile GUI Agents via Hybrid Validation in Realistic Workflows
  8. 2026ActGov: Governing LLM Agent Actions via Policy-Constrained Validation