Beyond Sequential Interaction: Benchmarking Parallel Execution and Coordination for GUI Agents
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
Graphical user interface (GUI) agents are systems powered by large multimodal models (LMMs). They perceive screen state and execute user instructions through GUI actions such as clicking, typing, and scrolling on desktops and mobile devices. However, current agents scale poorly to long-horizon tasks: actions incur costly LMM inferences, and performance degrades as context grows. Humans divide such workloads among collaborators who complete sub-tasks in parallel. Yet parallel coordination among GUI agents has received little attention. To close this gap, we introduce ParaGUIBench, to our knowledge, the first benchmark dedicated to parallel execution and coordination of multiple GUI agents on separate desktop instances. It consists of three components: a multi-device Docker infrastructure with a shared file system; a dataset of 233 tasks spanning six task categories; and an evaluation system with efficiency metrics, including step reduction ratio and token cost. We further introduce ParaGUI, a planner-worker agent that decomposes GUI tasks and dispatches sub-tasks to concurrent workers on separate desktop instances. On ParaGUIBench, ParaGUI reaches a 46.4% success rate, outperforming the strongest serial baseline (Claude Sonnet 4.6) by 12.9 points while using roughly half the steps and less than half the tokens. These results show that parallel execution can improve both success rate and efficiency on decomposable, long-horizon GUI tasks, pointing to a direction worth further study.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 28 of its 39 references that are in the map. First posted on arXiv 17 Jul 2026.
Builds on
28 of 39 references.
Closest ancestors · 3
Same direction, newest first
- 2025OSWorld-Human: Benchmarking the Efficiency of Computer-Use Agents19 Jun
- 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale12 Sep
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
Other references · 25
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2025OpenAI GPT-5 System Cardcited by 910
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
- 2023An LLM Compiler for Parallel Function Callingcited by 170
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agentscited by 169
- 2024Survey on Large Language Model-Enhanced Reinforcement Learning: Concept, Taxonomy, and Methodscited by 114
- 2025Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluationcited by 83
13 more
- 2024MegaAgent: A Large-Scale Autonomous LLM-based Multi-Agent System Without Predefined SOPscited by 45
- 2025Collab-Overcooked: Benchmarking and Evaluating Large Language Models as Collaborative Agentscited by 39
- 2024Graph-enhanced Large Language Models in Asynchronous Plan Reasoningcited by 37
- 2025Flow: Modularized Agentic Workflow Automationcited by 31
- 2025Robotouille: An Asynchronous Planning Benchmark for LLM Agentscited by 31
- 2025Flash-Searcher: Fast and Effective Web Agents via DAG-Based Parallel Executioncited by 27
- 2025Anthropic Economic Index report: Uneven geographic and enterprise AI adoptioncited by 23
- 2025DynTaskMAS: A Dynamic Task Graph-driven Framework for Asynchronous and Parallel LLM-based Multi-Agent Systemscited by 20
- 2025WebMall -- A Multi-Shop Benchmark for Evaluating Web Agentscited by 15
- 2025Plan-over-Graph: Towards Parallelable LLM Agent Schedulecited by 13
- 2025VeriWeb: Verifiable Long-Chain Web Benchmark for Agentic Information-Seekingcited by 10
- 2025UFO3: Weaving the Digital Agent Galaxycited by 6
- 2026AsyncTool: Evaluating the Asynchronous Function Calling Capability under Multi-Task Scenarioscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MMBench-GUI: Hierarchical Multi-Platform Evaluation Framework for GUI Agents
- 2025WorldGUI: An Interactive Benchmark for Desktop GUI Automation from Any Starting Point
- 2026JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Composition
- 2025ProBench: Benchmarking GUI Agents with Accurate Process Information
- 2026WindowsWorld: A Process-Centric Benchmark of Autonomous GUI Agents in Professional Cross-Application Environments
- 2026Efficient GUI Agents: A Systems Survey of Observation, Memory, Action, and Runtime Optimization
- 2026AutoGUI-v2: A Comprehensive Multi-Modal GUI Functionality Understanding Benchmark
- 2026GUI vs. CLI: Execution Bottlenecks in Screen-Only and Skill-Mediated Computer-Use Agents