mlsanityData to 14 Oct 2026

VenusBench-GD: A Comprehensive Multi-Platform GUI Benchmark for Diverse Grounding Tasks

arXiv 2512.16501 ↗First posted 18 Dec 2025cs.CVcited by 7

On the map: LLM agents and tool use → GUI and mobile agents

Abstract (arXiv)

GUI grounding is a critical component in building capable GUI agents. However, existing grounding benchmarks suffer from significant limitations: they either provide insufficient data volume and narrow domain coverage, or focus excessively on a single platform and require highly specialized domain knowledge. In this work, we present VenusBench-GD, a comprehensive, bilingual benchmark for GUI grounding that spans multiple platforms, enabling hierarchical evaluation for real-word applications. VenusBench-GD contributes as follows: (i) we introduce a large-scale, cross-platform benchmark with extensive coverage of applications, diverse UI elements, and rich annotated data, (ii) we establish a high-quality data construction pipeline for grounding tasks, achieving higher annotation accuracy than existing benchmarks, and (iii) we extend the scope of element grounding by proposing a hierarchical task taxonomy that divides grounding into basic and advanced categories, encompassing six distinct subtasks designed to evaluate models from complementary perspectives. Our experimental findings reveal critical insights: general-purpose multimodal models now match or even surpass specialized GUI models on basic grounding tasks. In contrast, advanced tasks, still favor GUI-specialized models, though they exhibit significant overfitting and poor robustness. These results underscore the necessity of comprehensive, multi-tiered evaluation frameworks.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 33 of its 39 references that are in the map. First posted on arXiv 18 Dec 2025.

Builds on

33 of 39 references.

Closest ancestors · 17

Same direction, newest first

  1. 2025UI-Ins: Enhancing GUI Grounding with Multi-Perspective Instruction-as-Reasoning23 Oct
  2. 2025UI-Venus Technical Report: Building High-performance UI Agents with RFT14 Aug
  3. 2025MMBench-GUI: Hierarchical Multi-Platform Evaluation Framework for GUI Agents25 Jul
  4. 2025GUI-Actor: Coordinate-Free Visual Grounding for GUI Agents3 Jun
  5. 2025AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning2 Jun
  6. 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis19 May
  7. 2025Enhancing Visual Grounding for GUI Agents via Self-Evolutionary Reinforcement Learning18 May
  8. 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use4 Apr
  9. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
  10. 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks20 Jan
  11. 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
  12. 2024Agent S: An Open Agentic Framework that Uses Computers Like a Human10 Oct
5 more
  1. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
  2. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
  3. 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception29 Jan
  4. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents17 Jan
  5. 2023CogAgent: A Visual Language Model for GUI Agents14 Dec

Other references · 16

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2024GPT-4o System Cardcited by 4,588
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  5. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  6. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 553
  7. 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 278
  8. 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 186
  9. 2024WebCanvas: Benchmarking Web Agents in Online Environmentscited by 121
  10. 2025GTA1: GUI Test-time Scaling Agentcited by 106
  11. 2025UI-Vision: A Desktop-centric GUI Benchmark for Visual Perception and Interactioncited by 77
  12. 2025GUI-G2: Gaussian Reward Modeling for GUI Groundingcited by 63
4 more
  1. 2024E-ANT: A Large-Scale Dataset for Efficient Automatic GUI NavigaTioncited by 11
  2. 2023Mobile User Interface Element Detection Via Adaptively Prompt Tuningcited by 8
  3. 2025V2P: Visual Attention Calibration for GUI Grounding via Background Suppression and Center Peakingcited by 6
  4. 2025Recon-Act: A Self-Evolving Multi-Agent Browser-Use System via Web Reconnaissance, Tool Generation, and Task Executioncited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026WinDeskGround: A Benchmark for Robust GUI Grounding in Complex Multi-Window Desktop Environments
  2. 2025Chain-of-Ground: Improving GUI Grounding via Iterative Reasoning and Reference Feedback
  3. 2025MEGA-GUI: Multi-stage Enhanced Grounding Agents for GUI Elements
  4. 2025Generalist Scanner Meets Specialist Locator: A Synergistic Coarse-to-Fine Framework for Robust GUI Grounding
  5. 2026AdaZoom-GUI: Adaptive Zoom-based GUI Grounding with Instruction Refinement
  6. 2024Aria-UI: Visual Grounding for GUI Instructions
  7. 2026MHVF: Training-Free GUI Grounding via Verification-Guided Multi-Hypothesis Search
  8. 2025DiMo-GUI: Advancing Test-time Scaling in GUI Grounding via Modality-Aware Visual Reasoning