mlsanityData to 7 Oct 2026

Turing Test on Screen: A Benchmark for Mobile GUI Agent Humanization

arXiv 2604.09574 ↗First posted 24 Feb 2026cs.AI cs.LGcited by 3

On the map: LLM agents and tool use → GUI and mobile agents

Abstract (arXiv)

The rise of autonomous GUI agents has triggered adversarial countermeasures from digital platforms, yet existing research prioritizes utility and robustness over the critical dimension of anti-detection. We argue that for agents to survive in human-centric ecosystems, they must evolve Humanization capabilities. We introduce the ``Turing Test on Screen,'' formally modeling the interaction as a MinMax optimization problem between a detector and an agent aiming to minimize behavioral divergence. We then collect a new high-fidelity dataset of mobile touch dynamics, and conduct our analysis that vanilla LMM-based agents are easily detectable due to unnatural kinematics. Consequently, we establish the Agent Humanization Benchmark (AHB) and detection metrics to quantify the trade-off between imitability and utility. Finally, we propose methods ranging from heuristic noise to data-driven behavioral matching, demonstrating that agents can achieve high imitability theoretically and empirically without sacrificing performance. This work shifts the paradigm from whether an agent can perform a task to how it performs it within a human-centric ecosystem, laying the groundwork for seamless coexistence in adversarial digital environments.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 34 of its 59 references that are in the map. First posted on arXiv 24 Feb 2026.

Builds on

34 of 59 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025VeriOS: Query-Driven Proactive Human-Agent-GUI Interaction for Trustworthy OS Agents9 Sep
  2. 2025Mobile-R1: Towards Interactive Capability for VLM-Based Mobile Agent via Systematic Training25 Jun
  3. 2025ARPO:End-to-End Policy Optimization for GUI Agents with Experience Replay22 May
  4. 2025OS-Kairos: Adaptive Interaction for MLLM-Powered GUI Agents26 Feb
  5. 2024Caution for the Environment: Multimodal LLM Agents are Susceptible to Environmental Distractions5 Aug
  6. 2024CoCo-Agent: A Comprehensive Cognitive MLLM Agent for Smartphone GUI Automation19 Feb
  7. 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception29 Jan
  8. 2023AppAgent: Multimodal Agents as Smartphone Users21 Dec
  9. 2023CogAgent: A Visual Language Model for GUI Agents14 Dec

Other references · 25

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  4. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  5. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  6. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  7. 2023How Robust is Google's Bard to Adversarial Image Attacks?cited by 177
  8. 2024Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fastcited by 149
  9. 2024Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agentscited by 135
  10. 2024Dissecting Adversarial Robustness of Multimodal LM Agentscited by 118
  11. 2024Attacking Vision-Language Computer Agents via Pop-upscited by 112
  12. 2024BadAgent: Inserting and Activating Backdoor Attacks in LLM Agentscited by 106
13 more
  1. 2023On the Robustness of Large Multimodal Models Against Image Adversarial Attackscited by 89
  2. 2024AdvAgent: Controllable Blackbox Red-teaming on Web Agentscited by 57
  3. 2025The Obvious Invisible Threat: LLM-Powered GUI Agents' Vulnerability to Fine-Print Injectionscited by 55
  4. 2025Foot-In-The-Door: A Multi-turn Jailbreak for LLMscited by 50
  5. 2025Evaluating the Robustness of Multimodal Agents Against Active Environmental Injection Attackscited by 21
  6. 2024CLIP-Guided Generative Networks for Transferable Targeted Adversarial Attackscited by 19
  7. 2025What Is Your AI Agent Buying? Evaluation, Biases, Model Dependence, & Emerging Implications for Agentic E-Commercecited by 18
  8. 2025Evolutionary Perspectives on the Evaluation of LLM-Based AI Agents: A Comprehensive Surveycited by 12
  9. 2024Exploring the Adversarial Robustness of CLIP for AI-generated Image Detectioncited by 11
  10. 2022Mouse Dynamics Behavioral Biometrics: A Surveycited by 4
  11. 2015Forgery-Resistant Touch-based Authentication on Mobile Devicescited by 3
  12. 2025Superplatforms Have to Attack AI Agentscited by 3
  13. 2022GANTouch: An Attack-Resilient Framework for Touch-based Continuous Authentication Systemcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Darwin Mobile Agent: A Roadmap for Self-Evolution
  2. 2025MobiBench: Multi-Branch, Modular Benchmark for Mobile GUI Agents
  3. 2026VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnostics
  4. 2026APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents
  5. 2026SwipeGen: Bridging the Execution Gap in GUI Agents via Human-like Swipe Synthesis
  6. 2026Can Agents Work for Everyone? Cross-User Reliability for Mobile GUI Agents in Personalized User Interfaces
  7. 2026OmegaUse: Building a General-Purpose GUI Agent for Autonomous Task Execution
  8. 2026Darwinian Memory: A Training-Free Self-Regulating Memory System for GUI Agent Evolution