GUI-ARP: Enhancing Grounding with Adaptive Region Perception for GUI Agents
Not on the map. Why?
Abstract (arXiv)
Existing GUI grounding methods often struggle with fine-grained localization in high-resolution screenshots. To address this, we propose GUI-ARP, a novel framework that enables adaptive multi-stage inference. Equipped with the proposed Adaptive Region Perception (ARP) and Adaptive Stage Controlling (ASC), GUI-ARP dynamically exploits visual attention for cropping task-relevant regions and adapts its inference strategy, performing a single-stage inference for simple cases and a multi-stage analysis for more complex scenarios. This is achieved through a two-phase training pipeline that integrates supervised fine-tuning with reinforcement fine-tuning based on Group Relative Policy Optimization (GRPO). Extensive experiments demonstrate that the proposed GUI-ARP achieves state-of-the-art performance on challenging GUI grounding benchmarks, with a 7B model reaching 60.8% accuracy on ScreenSpot-Pro and 30.9% on UI-Vision benchmark. Notably, GUI-ARP-7B demonstrates strong competitiveness against open-source 72B models (UI-TARS-72B at 38.1%) and proprietary models.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 28 of its 30 references that are in the map. First posted on arXiv 19 Sep 2025.
Builds on
28 of 30 references.
References · 28
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
- 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agentscited by 553
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 515
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 373
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agentscited by 370
- 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Usecited by 246
- 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agentscited by 240
- 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 226
16 more
- 2024On the Effects of Data Scale on UI Control Agentscited by 187
- 2024Agent S: An Open Agentic Framework that Uses Computers Like a Humancited by 182
- 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learningcited by 166
- 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesiscited by 132
- 2024GUICourse: From General Vision Language Models to Versatile GUI Agentscited by 112
- 2024AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agentscited by 110
- 2024ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Explorationcited by 99
- 2025UI-Venus Technical Report: Building High-performance UI Agents with RFTcited by 90
- 2025GUI-Actor: Coordinate-Free Visual Grounding for GUI Agentscited by 89
- 2024Agent-E: From Autonomous Web Navigation to Foundational Design Principles in Agentic Systemscited by 79
- 2025Enhancing Visual Grounding for GUI Agents via Self-Evolutionary Reinforcement Learningcited by 79
- 2025UI-Vision: A Desktop-centric GUI Benchmark for Visual Perception and Interactioncited by 68
- 2024Chain-of-Spot: Interactive Reasoning Improves Large Vision-Language Modelscited by 65
- 2025GUI-G2: Gaussian Reward Modeling for GUI Groundingcited by 60
- 2025InfiGUI-G1: Advancing GUI Grounding with Adaptive Exploration Policy Optimizationcited by 24
- 2025R-VLM: Region-Aware Vision Language Model for Precise GUI Groundingcited by 20
Built on by
Citing papers per year: 2025: 4; 2026: 6.
10 papers.
- 2025Learning GUI Grounding with Spatial Reasoning from Visual Feedbackcited by 12
- 2025MVP: Multiple View Prediction Improves GUI Groundingcited by 10
- 2025Zoom in, Click out: Unlocking and Evaluating the Potential of Zooming for GUI Groundingcited by 7
- 2026Continual GUI Agentscited by 7
- 2025GUI-AIMA: Aligning Intrinsic Multimodal Attention with a Context Anchor for GUI Groundingcited by 6
- 2026CUA-Suite: Massive Human-annotated Video Demonstrations for Computer-Use Agentscited by 3
- 2026From Failure to Feedback: Group Revision Unlocks Hard Cases in Object-Level Groundingcited by 2
- 2026AutoFocus: Uncertainty-Aware Active Visual Search for GUI Groundingcited by 1
- 2026GUI-AC: Enhancing Continual Learning in GUI Agentscited by 1
- 2026RankGround: Efficient High-Resolution GUI Grounding via Lightweight Reranker-Guided Crop Selectioncited by 0
- 2026RankGround: Efficient High-Resolution GUI Grounding via Lightweight Reranker-Guided Crop Selection16 Sep 2026
- 2026GUI-AC: Enhancing Continual Learning in GUI Agents9 Jun 2026
- 2026From Failure to Feedback: Group Revision Unlocks Hard Cases in Object-Level Grounding15 May 2026
- 2026AutoFocus: Uncertainty-Aware Active Visual Search for GUI Grounding4 May 2026
- 2026CUA-Suite: Massive Human-annotated Video Demonstrations for Computer-Use Agents25 Mar 2026
- 2026Continual GUI Agents28 Jan 2026
- 2025MVP: Multiple View Prediction Improves GUI Grounding9 Dec 2025
- 2025Zoom in, Click out: Unlocking and Evaluating the Potential of Zooming for GUI Grounding5 Dec 2025
- 2025GUI-AIMA: Aligning Intrinsic Multimodal Attention with a Context Anchor for GUI Grounding2 Nov 2025
- 2025Learning GUI Grounding with Spatial Reasoning from Visual Feedback25 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2026GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents
- 2026AdaZoom-GUI: Adaptive Zoom-based GUI Grounding with Instruction Refinement
- 2025textscGUI-Spotlight: Adaptive Iterative Focus Refinement for Enhanced GUI Visual Grounding
- 2025MEGA-GUI: Multi-stage Enhanced Grounding Agents for GUI Elements
- 2026DRS-GUI: Dynamic Region Search for Training-Free GUI Grounding
- 2026Measure Twice, Click Once: Co-evolving Proposer and Visual Critic via Reinforcement Learning for GUI Grounding
- 2025Visual Test-time Scaling for GUI Agent Grounding
- 2026V2P: Visual Attention Calibration for GUI Grounding via Background Suppression and Center Peaking