mlsanityData to 7 Oct 2026

GUI-ARP: Enhancing Grounding with Adaptive Region Perception for GUI Agents

arXiv 2509.15532 ↗First posted 19 Sep 2025cs.CV cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

Existing GUI grounding methods often struggle with fine-grained localization in high-resolution screenshots. To address this, we propose GUI-ARP, a novel framework that enables adaptive multi-stage inference. Equipped with the proposed Adaptive Region Perception (ARP) and Adaptive Stage Controlling (ASC), GUI-ARP dynamically exploits visual attention for cropping task-relevant regions and adapts its inference strategy, performing a single-stage inference for simple cases and a multi-stage analysis for more complex scenarios. This is achieved through a two-phase training pipeline that integrates supervised fine-tuning with reinforcement fine-tuning based on Group Relative Policy Optimization (GRPO). Extensive experiments demonstrate that the proposed GUI-ARP achieves state-of-the-art performance on challenging GUI grounding benchmarks, with a 7B model reaching 60.8% accuracy on ScreenSpot-Pro and 30.9% on UI-Vision benchmark. Notably, GUI-ARP-7B demonstrates strong competitiveness against open-source 72B models (UI-TARS-72B at 38.1%) and proprietary models.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 28 of its 30 references that are in the map. First posted on arXiv 19 Sep 2025.

Builds on

28 of 30 references.

References · 28

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2024GPT-4o System Cardcited by 4,467
  5. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
  6. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agentscited by 553
  7. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 515
  8. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 373
  9. 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agentscited by 370
  10. 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Usecited by 246
  11. 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agentscited by 240
  12. 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 226
16 more
  1. 2024On the Effects of Data Scale on UI Control Agentscited by 187
  2. 2024Agent S: An Open Agentic Framework that Uses Computers Like a Humancited by 182
  3. 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learningcited by 166
  4. 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesiscited by 132
  5. 2024GUICourse: From General Vision Language Models to Versatile GUI Agentscited by 112
  6. 2024AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agentscited by 110
  7. 2024ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Explorationcited by 99
  8. 2025UI-Venus Technical Report: Building High-performance UI Agents with RFTcited by 90
  9. 2025GUI-Actor: Coordinate-Free Visual Grounding for GUI Agentscited by 89
  10. 2024Agent-E: From Autonomous Web Navigation to Foundational Design Principles in Agentic Systemscited by 79
  11. 2025Enhancing Visual Grounding for GUI Agents via Self-Evolutionary Reinforcement Learningcited by 79
  12. 2025UI-Vision: A Desktop-centric GUI Benchmark for Visual Perception and Interactioncited by 68
  13. 2024Chain-of-Spot: Interactive Reasoning Improves Large Vision-Language Modelscited by 65
  14. 2025GUI-G2: Gaussian Reward Modeling for GUI Groundingcited by 60
  15. 2025InfiGUI-G1: Advancing GUI Grounding with Adaptive Exploration Policy Optimizationcited by 24
  16. 2025R-VLM: Region-Aware Vision Language Model for Precise GUI Groundingcited by 20

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 6.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents
  2. 2026AdaZoom-GUI: Adaptive Zoom-based GUI Grounding with Instruction Refinement
  3. 2025textscGUI-Spotlight: Adaptive Iterative Focus Refinement for Enhanced GUI Visual Grounding
  4. 2025MEGA-GUI: Multi-stage Enhanced Grounding Agents for GUI Elements
  5. 2026DRS-GUI: Dynamic Region Search for Training-Free GUI Grounding
  6. 2026Measure Twice, Click Once: Co-evolving Proposer and Visual Critic via Reinforcement Learning for GUI Grounding
  7. 2025Visual Test-time Scaling for GUI Agent Grounding
  8. 2026V2P: Visual Attention Calibration for GUI Grounding via Background Suppression and Center Peaking