GUI-GENESIS: Automated Synthesis of Efficient Environments with Verifiable Rewards for GUI Agent Post-Training
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
Post-training GUI agents in interactive environments is critical for developing generalization and long-horizon planning capabilities. However, training on real-world applications is hindered by high latency, poor reproducibility, and unverifiable rewards relying on noisy visual proxies. To address the limitations, we present GUI-GENESIS, the first framework to automatically synthesize efficient GUI training environments with verifiable rewards. GUI-GENESIS reconstructs real-world applications into lightweight web environments using multimodal code models and equips them with code-native rewards, executable assertions that provide deterministic reward signals and eliminate visual estimation noise. Extensive experiments show that GUI-GENESIS reduces environment latency by 10 times and costs by over 28,000 per epoch compared to training on real applications. Notably, agents trained with GUI-GENESIS outperform the base model by 14.54% and even real-world RL baselines by 3.27% on held-out real-world tasks. Finally, we observe that models can synthesize environments they cannot yet solve, highlighting a pathway for self-improving agents.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 39 of its 51 references that are in the map. First posted on arXiv 15 Feb 2026.
Builds on
39 of 51 references.
Closest ancestors · 12
Same direction, newest first
- 2025MobileRL: Online Agentic Reinforcement Learning for Mobile GUI Agents10 Sep
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning2 Sep
- 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation21 Aug
- 2025Mobile-R1: Towards Interactive Capability for VLM-Based Mobile Agent via Systematic Training25 Jun
- 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
- 2024GUICourse: From General Vision Language Models to Versatile GUI Agents17 Jun
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
- 2024Android in the Zoo: Chain-of-Action-Thought for GUI Agents5 Mar
- 2023CogAgent: A Visual Language Model for GUI Agents14 Dec
Other references · 27
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
- 2025Kimi K2: Open Agentic Intelligencecited by 523
- 2018Behavioral Cloning from Observationcited by 482
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
15 more
- 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 314
- 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 271
- 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 226
- 2024GUIOdyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devicescited by 190
- 2024Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMscited by 173
- 2024Aria-UI: Visual Grounding for GUI Instructionscited by 136
- 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 116
- 2024Meta-Prompting: Enhancing Language Models with Task-Agnostic Scaffoldingcited by 115
- 2025On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Modelscited by 64
- 2025Enigmata: Scaling Logical Reasoning in Large Language Models with Synthetic Verifiable Puzzlescited by 53
- 2025ViMo: A Generative Visual GUI World Model for App Agentscited by 33
- 2025ViCrit: A Verifiable Reinforcement Learning Proxy Task for Visual Perception in VLMscited by 25
- 2025Random Policy Valuation is Enough for LLM Reasoning with Verifiable Rewardscited by 10
- 2025FunReason-MT Technical Report: Advanced Data Synthesis Solution for Real-world Multi-Turn Tool-usecited by 9
- 2025AppForge: From Assistant to Independent Developer -- Are GPTs Ready for Software Development?cited by 4
Built on by
Citing papers per year: 2026: 16.
16 papers.
Sort:
By area:
- 2026Gym-Anything: Turn any Software into an Agent Environmentcited by 24
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
- 2026CUA-Gym: Scaling Verifiable Training Environments and Tasks for Computer-Use Agentscited by 21
- 2026OpenComputer: Verifiable Software Worlds for Computer-Use Agentscited by 9
- 2026MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Researchcited by 9
- 2026SCALECUA: Scaling Computer Use Agents with Verifiable Task Synthesis and Efficient Online RLcited by 7
- 2026Qwen-CUA: Native Computer Use for (almost) Everythingcited by 5
- 2026PhoneBuddy: Training Open Models for Agentic Phone Usecited by 4
- 2026AlphaEval: Evaluating Agents in Productioncited by 1
- 2026PhoneWorld: From Real-App Trajectories to Dynamic and Verifiable Environments for Phone-Use Agentscited by 1
- 2026Teach it to stop, not just to clickcited by 1
- 2026CUA-Universe: A Scalable and Dynamic Environment for Hybrid GUI+CLI Agentscited by 1
4 more
- 2026RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agentscited by 1
- 2026Learning to Detect UI Principle Violations via Reinforcement Learningcited by 0
- 2026A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applicationscited by 0
- 2026CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learningcited by 0
- 2026CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learning26 Sep 2026
- 2026RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agents18 Sep 2026
- 2026CUA-Universe: A Scalable and Dynamic Environment for Hybrid GUI+CLI Agents4 Sep 2026
- 2026Qwen-CUA: Native Computer Use for (almost) Everything3 Aug 2026
- 2026Learning to Detect UI Principle Violations via Reinforcement Learning22 Jul 2026
- 2026Teach it to stop, not just to click19 Jul 2026
- 2026SCALECUA: Scaling Computer Use Agents with Verifiable Task Synthesis and Efficient Online RL13 Jul 2026
- 2026A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applications28 Jun 2026
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
- 2026PhoneBuddy: Training Open Models for Agentic Phone Use22 Jun 2026
- 2026PhoneWorld: From Real-App Trajectories to Dynamic and Verifiable Environments for Phone-Use Agents28 May 2026
- 2026MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research25 May 2026
4 more
- 2026CUA-Gym: Scaling Verifiable Training Environments and Tasks for Computer-Use Agents25 May 2026
- 2026OpenComputer: Verifiable Software Worlds for Computer-Use Agents19 May 2026
- 2026AlphaEval: Evaluating Agents in Production14 Apr 2026
- 2026Gym-Anything: Turn any Software into an Agent Environment7 Apr 2026
- 2026Gym-Anything: Turn any Software into an Agent Environmentcited by 24
- 2026CUA-Gym: Scaling Verifiable Training Environments and Tasks for Computer-Use Agentscited by 21
- 2026OpenComputer: Verifiable Software Worlds for Computer-Use Agentscited by 9
- 2026MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Researchcited by 9
- 2026SCALECUA: Scaling Computer Use Agents with Verifiable Task Synthesis and Efficient Online RLcited by 7
- 2026PhoneBuddy: Training Open Models for Agentic Phone Usecited by 4
- 2026AlphaEval: Evaluating Agents in Productioncited by 1
- 2026Teach it to stop, not just to clickcited by 1
- 2026CUA-Universe: A Scalable and Dynamic Environment for Hybrid GUI+CLI Agentscited by 1
- 2026RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agentscited by 1
- 2026A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applicationscited by 0
- 2026CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learningcited by 0
- 2026CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learning26 Sep 2026
- 2026RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agents18 Sep 2026
- 2026CUA-Universe: A Scalable and Dynamic Environment for Hybrid GUI+CLI Agents4 Sep 2026
- 2026Teach it to stop, not just to click19 Jul 2026
- 2026SCALECUA: Scaling Computer Use Agents with Verifiable Task Synthesis and Efficient Online RL13 Jul 2026
- 2026A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applications28 Jun 2026
- 2026PhoneBuddy: Training Open Models for Agentic Phone Use22 Jun 2026
- 2026MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research25 May 2026
- 2026CUA-Gym: Scaling Verifiable Training Environments and Tasks for Computer-Use Agents25 May 2026
- 2026OpenComputer: Verifiable Software Worlds for Computer-Use Agents19 May 2026
- 2026AlphaEval: Evaluating Agents in Production14 Apr 2026
- 2026Gym-Anything: Turn any Software into an Agent Environment7 Apr 2026
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026ScaleWoB: Guiding GUI Agents with Coding Agents via Large-Scale Environmental Synthesis
- 2026InfiniteWeb: Scalable Web Environment Synthesis for GUI Agent Training
- 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis
- 2026ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agents
- 2026MagicGUI-RMS: A Multi-Agent Reward Model System for Self-Evolving GUI Agents via Automated Feedback Reflux
- 2025UI-AGILE: Advancing GUI Agents with Effective Reinforcement Learning and Precise Inference-Time Grounding
- 2026GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments
- 2025GUI-Bee: Align GUI Action Grounding to Novel Environments via Autonomous Exploration