# GUI and mobile agents Area: [LLM agents and tool use](https://mlsanity.com/agents/index.md). HTML: https://mlsanity.com/agents/gui-and-mobile-agents/ ## Key facts - GUI and mobile agents: 504 papers on arXiv since 2023 (data through 14 Oct 2026). - 210 of its 504 mapped papers (42%) cite “UI-TARS: Pioneering Automated GUI Interaction with Native Agents” (2025, arXiv 2501.12326). - 201 of its 504 mapped papers (40%) cite “CogAgent: A Visual Language Model for GUI Agents” (2023, arXiv 2312.08914). - 51 new papers 17 Sep–14 Oct. ## Most cited here - [UI-TARS: Pioneering Automated GUI Interaction with Native Agents](https://mlsanity.com/paper/2501.12326/) (2025), cited by 210 papers here - [CogAgent: A Visual Language Model for GUI Agents](https://mlsanity.com/paper/2312.08914/) (2023), cited by 201 papers here - [SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents](https://mlsanity.com/paper/2401.10935/) (2024), cited by 195 papers here - [OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments](https://mlsanity.com/paper/2404.07972/) (2024), cited by 179 papers here - [AppAgent: Multimodal Agents as Smartphone Users](https://mlsanity.com/paper/2312.13771/) (2023), cited by 156 papers here - [OS-ATLAS: A Foundation Action Model for Generalist GUI Agents](https://mlsanity.com/paper/2410.23218/) (2024), cited by 154 papers here - [Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents](https://mlsanity.com/paper/2410.05243/) (2024), cited by 149 papers here - [Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception](https://mlsanity.com/paper/2401.16158/) (2024), cited by 114 papers here - [On the Effects of Data Scale on UI Control Agents](https://mlsanity.com/paper/2406.03679/) (2024), cited by 101 papers here - [ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use](https://mlsanity.com/paper/2504.07981/) (2025), cited by 90 papers here ## New (17 Sep–14 Oct) - [MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer Environments](https://mlsanity.com/paper/2610.20939/) (2026-10-14) - [STP-GUI: Spatially-Aware Token Pruning for Efficient Web-GUI Agents](https://mlsanity.com/paper/2610.20390/) (2026-10-14) - [Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent Execution](https://mlsanity.com/paper/2610.20100/) (2026-10-14) - [How GUI Agents Fail: GraceBench for Execution Stability Diagnosis](https://mlsanity.com/paper/2610.19900/) (2026-10-14) - [GroundGUI: GUI Grounding by High-Quality Data and Distillation-to-Reinforcement Learning](https://mlsanity.com/paper/2610.19100/) (2026-10-13) - [MHVF: Training-Free GUI Grounding via Verification-Guided Multi-Hypothesis Search](https://mlsanity.com/paper/2610.17792/) (2026-10-13) - [Adaptive-Group Process Rewards for GUI Agents](https://mlsanity.com/paper/2610.17710/) (2026-10-13) - [Learn from Move: the Next Step for GUI Agents](https://mlsanity.com/paper/2610.16720/) (2026-10-12) - [Seg2Click: Learning Pixel-Level Action Masks for GUI Visual Grounding](https://mlsanity.com/paper/2610.16234/) (2026-10-12) - [A Decade in a Day: Synthesizing Agent-Native Interfaces from Human-Oriented Software Evolution](https://mlsanity.com/paper/2610.15765/) (2026-10-11) - [Latent World Action Model for GUI Agents](https://mlsanity.com/paper/2610.14228/) (2026-10-09) - [OpenMobile-2: Building Versatile Mobile Agents with Scalable Environments and App-Native Tools](https://mlsanity.com/paper/2610.14157/) (2026-10-09) - [ConClick: Element-Wise Contrastive Learning Improves GUI Grounding](https://mlsanity.com/paper/2610.13268/) (2026-10-09) - [Work2Skill: Capturing Human GUI Experience for Reusable Agent Skill Induction](https://mlsanity.com/paper/2610.12984/) (2026-10-09) - [Right Screen, Wrong Transition: World Models as Verifiers for GUI Agents](https://mlsanity.com/paper/2610.11942/) (2026-10-08) - [DeltaReplay: Task-Relative Memory Reuse for Mobile GUI Agents](https://mlsanity.com/paper/2610.11707/) (2026-10-08) - [AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use Tasks](https://mlsanity.com/paper/2610.11050/) (2026-10-08) - [Can Agents Work for Everyone? Cross-User Reliability for Mobile GUI Agents in Personalized User Interfaces](https://mlsanity.com/paper/2610.07972/) (2026-10-06) - [Imagine to Act: High-Fidelity Data Synthesis via Image Editing World Model for Scalable GUI Agent Training](https://mlsanity.com/paper/2610.05861/) (2026-10-05) - [Recurrent Latent Visual Search for GUI Grounding](https://mlsanity.com/paper/2610.05185/) (2026-10-04) - [CUAWright: A Minimal Unified Interface for Digital Agents](https://mlsanity.com/paper/2610.04116/) (2026-10-02) - [WebUIProof: Benchmarking WebUI Code Generators with UI-Agent Execution Harness](https://mlsanity.com/paper/2610.02617/) (2026-10-02) - [DeskForge: Dense Supervision from Desktop Environments for Computer-Use Agents](https://mlsanity.com/paper/2610.02320/) (2026-10-01) - [Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agents](https://mlsanity.com/paper/2610.01787/) (2026-10-01) - [AutoGUIWorld: Image Generators as Visual World Models for GUI Agent](https://mlsanity.com/paper/2610.01215/) (2026-10-01) - [GUI-HARVEST: Self-Improving GUI Agents through Evidence-Driven Harness Evolution](https://mlsanity.com/paper/2610.00948/) (2026-10-01) - [cua-speedrun: Standardized Benchmarking of the Speed of Computer-Use Agents](https://mlsanity.com/paper/2609.40284/) (2026-09-30) - [Learning Reliable GUI Agents under Imperfect Priors](https://mlsanity.com/paper/2609.39547/) (2026-09-30) - [HybridCUA: Learning to Orchestrate GUI and CLI for Computer-Use Agents](https://mlsanity.com/paper/2609.38008/) (2026-09-29) - [Absorbed in Inertia: Activation Analysis for Computer-Use Agents](https://mlsanity.com/paper/2609.37176/) (2026-09-29)