MAI-UI Technical Report: Real-World Centric Foundation GUI Agents
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
The development of GUI agents could revolutionize the next generation of human-computer interaction. Motivated by this vision, we present MAI-UI, a family of foundation GUI agents spanning the full spectrum of sizes, including 2B, 8B, 32B, and 235B-A22B variants. We identify four key challenges to realistic deployment: the lack of native agent-user interaction, the limits of UI-only operation, the absence of a practical deployment architecture, and brittleness in dynamic environments. MAI-UI addresses these issues with a unified methodology: a self-evolving data pipeline that expands the navigation data to include user interaction and MCP tool calls, a native device-cloud collaboration system routes execution by task state, and an online RL framework with advanced optimizations to scale parallel environments and context length. MAI-UI establishes new state-of-the-art across GUI grounding and mobile navigation. On grounding benchmarks, it reaches 73.5% on ScreenSpot-Pro, 91.3% on MMBench GUI L2, 70.9% on OSWorld-G, and 49.2% on UI-Vision, surpassing Gemini-3-Pro and Seed1.8 on ScreenSpot-Pro. On mobile GUI navigation, it sets a new SOTA of 76.7% on AndroidWorld, surpassing UI-Tars-2, Gemini-2.5-Pro and Seed1.8. On MobileWorld, MAI-UI obtains 41.7% success rate, significantly outperforming end-to-end GUI models and competitive with Gemini-3-Pro based agentic frameworks. Our online RL experiments show significant gains from scaling parallel environments from 32 to 512 (+5.2 points) and increasing environment step budget from 15 to 50 (+4.3 points). Finally, the native device-cloud collaboration system improves on-device performance by 33%, reduces cloud model calls by over 40%, and preserves user privacy.
Key facts. Cited by 91 papers in the map (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 45 of its 56 references that are in the map. First posted on arXiv 26 Dec 2025.
Builds on
45 of 56 references.
Closest ancestors · 27
Same direction, newest first
- 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments22 Dec
- 2025Step-GUI Technical Report17 Dec
- 2025OpenPhone: Mobile Agentic Foundation Models24 Oct
- 2025UI-Ins: Enhancing GUI Grounding with Multi-Perspective Instruction-as-Reasoning23 Oct
- 2025Ferret-UI Lite: Lessons from Building Small On-Device GUI Agents30 Sep
- 2025ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Data18 Sep
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning2 Sep
- 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation21 Aug
- 2025UI-Venus Technical Report: Building High-performance UI Agents with RFT14 Aug
- 2025Phi-Ground Tech Report: Advancing Perception in GUI Grounding31 Jul
- 2025MMBench-GUI: Hierarchical Multi-Platform Evaluation Framework for GUI Agents25 Jul
- 2025GUI-Actor: Coordinate-Free Visual Grounding for GUI Agents3 Jun
15 more
- 2025AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning2 Jun
- 2025GUI-G1: Understanding R1-Zero-Like Training for Visual Grounding in GUI Agents21 May
- 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis19 May
- 2025Enhancing Visual Grounding for GUI Agents via Self-Evolutionary Reinforcement Learning18 May
- 2025InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasoners19 Apr
- 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agents14 Apr
- 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use4 Apr
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
- 2024GUI Agents with Foundation Models: A Comprehensive Survey7 Nov
- 2024AndroidLab: Training and Systematic Benchmarking of Android Autonomous Agents31 Oct
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
- 2024On the Effects of Data Scale on UI Control Agents6 Jun
- 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception29 Jan
- 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents17 Jan
Other references · 18
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024Qwen2 Technical Reportcited by 2,120
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
- 2025Seed1.5-VL Technical Reportcited by 373
- 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 278
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
6 more
- 2024GUIOdyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devicescited by 194
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 146
- 2024Aria-UI: Visual Grounding for GUI Instructionscited by 140
- 2024Symbolic Learning Enables Self-Evolving Agentscited by 106
- 2025GTA1: GUI Test-time Scaling Agentcited by 106
- 2025InfiGUI-G1: Advancing GUI Grounding with Adaptive Exploration Policy Optimizationcited by 27
Built on by
Citing papers per year: 2026: 91.
91 papers.
Sort:
By area:
- 2026Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agentscited by 79
- 2026UI-Venus-1.5 Technical Reportcited by 41
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decodingcited by 28
- 2026RLAnything: Forge Environment, Policy, and Reward Model in Completely Dynamic RL Systemcited by 24
- 2026KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluationcited by 21
- 2026GUI-Libra: Training Native GUI Agents to Reason and Act with Action-aware Supervision and Partially Verifiable RLcited by 16
- 2026MolmoPoint: Better Pointing for VLMs with Grounding Tokenscited by 15
- 2026ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agentscited by 14
- 2026OmegaUse: Building a General-Purpose GUI Agent for Autonomous Task Executioncited by 13
- 2026MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Researchcited by 13
- 2026UI-Mem: Self-Evolving Experience Memory for Online Reinforcement Learning in Mobile GUI Agentscited by 12
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agentscited by 12
38 more
- 2026UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experiencecited by 11
- 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesiscited by 11
- 2026MementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agentscited by 11
- 2026Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agentscited by 11
- 2026AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applicationscited by 10
- 2026How Mobile World Model Guides GUI Agents?cited by 8
- 2026PIRA-Bench: A Transition from Reactive GUI Agents to GUI-based Proactive Intent Recommendation Agentscited by 7
- 2026Video2GUI: Synthesizing Large-Scale Interaction Trajectories for Generalized GUI Agent Pretrainingcited by 7
- 2026MobileForge: Annotation-Free Adaptation for Mobile GUI Agents with Hierarchical Feedback-Guided Policy Optimizationcited by 7
- 2026AdaZoom-GUI: Adaptive Zoom-based GUI Grounding with Instruction Refinementcited by 6
- 2026Android Coach: Improve Online Agentic Training Efficiency with Single State Multiple Actionscited by 6
- 2026MobileBench-OL: A Comprehensive Chinese Benchmark for Evaluating Mobile GUI Agents in Real-World Environmentcited by 5
- 2026CUA-Suite: Massive Human-annotated Video Demonstrations for Computer-Use Agentscited by 5
- 2026VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnosticscited by 5
- 2026VLAA-GUI: Knowing When to Stop, Recover, and Search, A Modular Framework for GUI Automationcited by 5
- 2026Xiaomi-GUI-0 Technical Reportcited by 5
- 2026What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving Statescited by 5
- 2026Agentic Reward Modeling: Verifying GUI Agent via Progressive Trajectory-Grounded Interactioncited by 4
- 2026Avenir-Web: Human-Experience-Imitating Multimodal Web Agents with Mixture of Grounding Expertscited by 4
- 2026What Happens Before Decoding? Prefill Determines GUI Grounding in VLMscited by 4
- 2026SE-GA: Memory-Augmented Self-Evolution for GUI Agentscited by 4
- 2026UI-KOBE: Knowledge-Oriented Behavior Exploration for Lightweight Graph-Guided GUI Agentscited by 4
- 2026PhoneBuddy: Training Open Models for Agentic Phone Usecited by 4
- 2026Scaling GUI Agents with Visual State Transitionscited by 4
- 2026GUI Agents with Reinforcement Learning: Toward Digital Inhabitantscited by 3
- 2026Mem-W: Latent Memory-Native GUI Agentscited by 3
- 2026VISTA: View-Consistent Self-Verified Training for GUI Groundingcited by 3
- 2026MemGUI-Agent: An End-to-End Long-Horizon Mobile GUI Agent with Proactive Context Managementcited by 3
- 2026MAGA: Multi-Platform Self-Fusion of GUI Agents via Structured Action Distillationcited by 3
- 2026ClawMobile: Rethinking Smartphone-Native Agentic Systemscited by 2
- 2026ScaleWoB: Guiding GUI Agents with Coding Agents via Large-Scale Environmental Synthesiscited by 2
- 2026Agent Skills Should Go Beyond Text: The Case for Visual Skillscited by 2
- 2026StainFlow: Entity-Stain Tracking and Evidence Linking for Process Rewards in GUI Agentscited by 2
- 2026One Forward Beats Two: InnerZoom for Accurate and Efficient GUI Groundingcited by 2
- 2026UI-Venus-2 Technical Reportcited by 2
- 2026Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agentscited by 2
- 2026Coding with Eyes: Visual Feedback Unlocks Reliable GUI Code Generating and Debuggingcited by 1
- 2026Safe, or Simply Incapable? Rethinking Safety Evaluation for Phone-Use Agentscited by 1
50 most cited of 91 All 91 (JSON)
- 2026GroundGUI: GUI Grounding by High-Quality Data and Distillation-to-Reinforcement Learning13 Oct 2026
- 2026OpenMobile-2: Building Versatile Mobile Agents with Scalable Environments and App-Native Tools9 Oct 2026
- 2026Can Agents Work for Everyone? Cross-User Reliability for Mobile GUI Agents in Personalized User Interfaces6 Oct 2026
- 2026ComputerSD: Online Self-Distillation from Real-Time Feedback for Computer-Use Agents30 Sep 2026
- 2026Learning Reliable GUI Agents under Imperfect Priors30 Sep 2026
- 2026PastForward: Faster On-Device GUI Agents via Computational Experience Reuse26 Sep 2026
- 2026From Tapping to Hopping: Augmenting Mobile GUI Agents with App-Native Deeplinks25 Sep 2026
- 2026How Many Pixels Is a Digit Worth? Place-Aware Coordinate Entropy for GUI Agent Confidence Estimation21 Sep 2026
- 2026MintAct: A Unified Visual Agent for Digital Environments18 Sep 2026
- 2026Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agents15 Sep 2026
- 2026Learning from Reliable Negatives: Confidence-Anchored Test-Time Adaptation for GUI Grounding14 Sep 2026
- 2026BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents11 Sep 2026
38 more
- 2026LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents9 Sep 2026
- 2026iCoder-27B: Recursive AI-Led Development of Frontier Industrial Coding Model28 Aug 2026
- 2026UI-Venus-2 Technical Report27 Aug 2026
- 2026WM-R1: Training GUI Agents to Reason and leverage World Models with Reinforcement Learning27 Aug 2026
- 2026Task-Adaptive Rubrics for GUI Reward Modeling25 Aug 2026
- 2026Are Android GUI Agents Robust Against Runtime Anomalies? AnTrap: Evaluating Agents in Dynamic Adversarial Environments25 Aug 2026
- 2026MobileWorldSafety: Benchmarking GUI Agent Safety Against Environmental Injection Attacks in Android Apps18 Aug 2026
- 2026UI-Mate: Advancing Open-Weight Foundation GUI Agents with In-Context Demonstrations16 Aug 2026
- 2026StepReflect: Structured UI Transition Reflection for Mobile GUI Agents6 Aug 2026
- 2026GUI-Lens: Coarse-to-Fine Cropping for GUI Grounding with General-Purpose VLMs4 Aug 2026
- 2026MAGA: Multi-Platform Self-Fusion of GUI Agents via Structured Action Distillation31 Jul 2026
- 2026Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agents30 Jul 2026
- 2026Piggybacking on Perception: Stealthy Concurrent Audio Prompt Injections against Multimodal LLM Agents30 Jul 2026
- 2026Scaling GUI Agents with Visual State Transitions27 Jul 2026
- 2026KnowAct-GUIClaw: Know Deeply, Act Perfectly, Personal GUI Assistant with Self-Evolving Memory and Skill14 Jul 2026
- 2026What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving States30 Jun 2026
- 2026Xiaomi-GUI-0 Technical Report30 Jun 2026
- 2026One Forward Beats Two: InnerZoom for Accurate and Efficient GUI Grounding29 Jun 2026
- 2026GUICrafter: Weakly-Supervised GUI Agent Leveraging Massive Unannotated Screenshots29 Jun 2026
- 2026PhoneBuddy: Training Open Models for Agentic Phone Use22 Jun 2026
- 2026MobileForge: Annotation-Free Adaptation for Mobile GUI Agents with Hierarchical Feedback-Guided Policy Optimization18 Jun 2026
- 2026MemGUI-Agent: An End-to-End Long-Horizon Mobile GUI Agent with Proactive Context Management18 Jun 2026
- 2026Beyond the GUI Paradigm: Do Mobile Agents Need the Phone Screen?16 Jun 2026
- 2026VISTA: View-Consistent Self-Verified Training for GUI Grounding12 Jun 2026
- 2026AliyunConsoleAgent: Training Web Agents in Real-World Cloud Environments via Distillation and Reinforcement Learning8 Jun 2026
- 2026StainFlow: Entity-Stain Tracking and Evidence Linking for Process Rewards in GUI Agents5 Jun 2026
- 2026DragOn: A Benchmark and Dataset for Drag-Based GUI Interactions4 Jun 2026
- 2026MIRAGE: Mobile Agents with Implicit Reasoning and Generative World Models3 Jun 2026
- 2026Joint Agent Memory and Exploration Learning via Novelty Signals1 Jun 2026
- 2026Agent Skills Should Go Beyond Text: The Case for Visual Skills31 May 2026
- 2026When Cloud Agents Meet Device Agents: Lessons from Hybrid Multi-Agent Systems28 May 2026
- 2026UI-KOBE: Knowledge-Oriented Behavior Exploration for Lightweight Graph-Guided GUI Agents28 May 2026
- 2026PhoneWorld: From Real-App Trajectories to Dynamic and Verifiable Environments for Phone-Use Agents28 May 2026
- 2026STAMP: Training Explicit Memory for Mobile GUI Agents in Controllable and Scalable Virtual Environments28 May 2026
- 2026AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applications26 May 2026
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding26 May 2026
- 2026MobileExplorer: Accelerating On-Device Inference for Mobile GUI Agents via Online Exploration26 May 2026
- 2026MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research25 May 2026
50 newest of 91 All 91 (JSON)
- 2026Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agentscited by 79
- 2026UI-Venus-1.5 Technical Reportcited by 41
- 2026RLAnything: Forge Environment, Policy, and Reward Model in Completely Dynamic RL Systemcited by 24
- 2026KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluationcited by 21
- 2026GUI-Libra: Training Native GUI Agents to Reason and Act with Action-aware Supervision and Partially Verifiable RLcited by 16
- 2026ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agentscited by 14
- 2026OmegaUse: Building a General-Purpose GUI Agent for Autonomous Task Executioncited by 13
- 2026MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Researchcited by 13
- 2026UI-Mem: Self-Evolving Experience Memory for Online Reinforcement Learning in Mobile GUI Agentscited by 12
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agentscited by 12
- 2026UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experiencecited by 11
- 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesiscited by 11
12 most cited of 64 All 64 (JSON)
- 2026GroundGUI: GUI Grounding by High-Quality Data and Distillation-to-Reinforcement Learning13 Oct 2026
- 2026OpenMobile-2: Building Versatile Mobile Agents with Scalable Environments and App-Native Tools9 Oct 2026
- 2026Can Agents Work for Everyone? Cross-User Reliability for Mobile GUI Agents in Personalized User Interfaces6 Oct 2026
- 2026ComputerSD: Online Self-Distillation from Real-Time Feedback for Computer-Use Agents30 Sep 2026
- 2026PastForward: Faster On-Device GUI Agents via Computational Experience Reuse26 Sep 2026
- 2026From Tapping to Hopping: Augmenting Mobile GUI Agents with App-Native Deeplinks25 Sep 2026
- 2026How Many Pixels Is a Digit Worth? Place-Aware Coordinate Entropy for GUI Agent Confidence Estimation21 Sep 2026
- 2026Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agents15 Sep 2026
- 2026BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents11 Sep 2026
- 2026LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents9 Sep 2026
- 2026UI-Venus-2 Technical Report27 Aug 2026
- 2026Are Android GUI Agents Robust Against Runtime Anomalies? AnTrap: Evaluating Agents in Dynamic Adversarial Environments25 Aug 2026
12 newest of 64 All 64 (JSON)
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decodingcited by 28
- 2026MolmoPoint: Better Pointing for VLMs with Grounding Tokenscited by 15
- 2026Video2GUI: Synthesizing Large-Scale Interaction Trajectories for Generalized GUI Agent Pretrainingcited by 7
- 2026AdaZoom-GUI: Adaptive Zoom-based GUI Grounding with Instruction Refinementcited by 6
- 2026Avenir-Web: Human-Experience-Imitating Multimodal Web Agents with Mixture of Grounding Expertscited by 4
- 2026AQuaUI: Visual Token Reduction for GUI Agents with Adaptive Quadtreescited by 1
- 2026OS-SPEAR: A Toolkit for the Safety, Performance,Efficiency, and Robustness Analysis of OS Agentscited by 0
- 2026MintAct: A Unified Visual Agent for Digital Environmentscited by 0
- 2026Learning Reliable GUI Agents under Imperfect Priorscited by 0
- 2026Learning Reliable GUI Agents under Imperfect Priors30 Sep 2026
- 2026MintAct: A Unified Visual Agent for Digital Environments18 Sep 2026
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding26 May 2026
- 2026AQuaUI: Visual Token Reduction for GUI Agents with Adaptive Quadtrees19 May 2026
- 2026Video2GUI: Synthesizing Large-Scale Interaction Trajectories for Generalized GUI Agent Pretraining14 May 2026
- 2026OS-SPEAR: A Toolkit for the Safety, Performance,Efficiency, and Robustness Analysis of OS Agents27 Apr 2026
- 2026MolmoPoint: Better Pointing for VLMs with Grounding Tokens30 Mar 2026
- 2026AdaZoom-GUI: Adaptive Zoom-based GUI Grounding with Instruction Refinement18 Mar 2026
- 2026Avenir-Web: Human-Experience-Imitating Multimodal Web Agents with Mixture of Grounding Experts2 Feb 2026
- 2026Task-Adaptive Rubrics for GUI Reward Modeling25 Aug 2026
- 2026VISTA: View-Consistent Self-Verified Training for GUI Grounding12 Jun 2026
- 2026Beyond Binary: Reframing GUI Critique as Continuous Semantic Alignment14 May 2026
- 2026ClawMobile: Rethinking Smartphone-Native Agentic Systems26 Feb 2026
- 2026What Happens Before Decoding? Prefill Determines GUI Grounding in VLMscited by 4
- 2026Agent Skills Should Go Beyond Text: The Case for Visual Skillscited by 2
- 2026One Forward Beats Two: InnerZoom for Accurate and Efficient GUI Groundingcited by 2
- 2026Coding with Eyes: Visual Feedback Unlocks Reliable GUI Code Generating and Debuggingcited by 1
- 2026Safe, or Simply Incapable? Rethinking Safety Evaluation for Phone-Use Agentscited by 1
- 2026PhoneWorld: From Real-App Trajectories to Dynamic and Verifiable Environments for Phone-Use Agentscited by 1
- 2026Through Their Eyes: Fixation-aligned Tuning for Personalized User Emulationcited by 0
- 2026GUI-Lens: Coarse-to-Fine Cropping for GUI Grounding with General-Purpose VLMscited by 0
- 2026Learning from Reliable Negatives: Confidence-Anchored Test-Time Adaptation for GUI Groundingcited by 0
- 2026iCoder-27B: Recursive AI-Led Development of Frontier Industrial Coding Modelcited by 0
- 2026Learning from Reliable Negatives: Confidence-Anchored Test-Time Adaptation for GUI Grounding14 Sep 2026
- 2026iCoder-27B: Recursive AI-Led Development of Frontier Industrial Coding Model28 Aug 2026
- 2026GUI-Lens: Coarse-to-Fine Cropping for GUI Grounding with General-Purpose VLMs4 Aug 2026
- 2026One Forward Beats Two: InnerZoom for Accurate and Efficient GUI Grounding29 Jun 2026
- 2026Agent Skills Should Go Beyond Text: The Case for Visual Skills31 May 2026
- 2026PhoneWorld: From Real-App Trajectories to Dynamic and Verifiable Environments for Phone-Use Agents28 May 2026
- 2026What Happens Before Decoding? Prefill Determines GUI Grounding in VLMs10 May 2026
- 2026Safe, or Simply Incapable? Rethinking Safety Evaluation for Phone-Use Agents8 May 2026
- 2026Through Their Eyes: Fixation-aligned Tuning for Personalized User Emulation10 Apr 2026
- 2026Coding with Eyes: Visual Feedback Unlocks Reliable GUI Code Generating and Debugging14 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2024TinyClick: Single-Turn Agent for Empowering GUI Automation
- 2025TransBench: Breaking Barriers for Transferable Graphical User Interface Agents in Dynamic Digital Environments
- 2024Falcon-UI: Understanding GUI Before Following User Instructions
- 2026SEE: Structure-aware Exploring & Exploiting for Long-horizon GUI Agent Trajectory Synthesis
- 2026JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Composition
- 2025UI-Vision: A Desktop-centric GUI Benchmark for Visual Perception and Interaction
- 2024GUI Agents: A Survey
- 2025GUIrilla: A Scalable Framework for Automated Desktop UI Exploration