mlsanityData to 7 Oct 2026

GUI-GENESIS: Automated Synthesis of Efficient Environments with Verifiable Rewards for GUI Agent Post-Training

arXiv 2602.14093 ↗First posted 15 Feb 2026cs.AI cs.LGcited by 16

On the map: LLM agents and tool use → GUI and mobile agents

Abstract (arXiv)

Post-training GUI agents in interactive environments is critical for developing generalization and long-horizon planning capabilities. However, training on real-world applications is hindered by high latency, poor reproducibility, and unverifiable rewards relying on noisy visual proxies. To address the limitations, we present GUI-GENESIS, the first framework to automatically synthesize efficient GUI training environments with verifiable rewards. GUI-GENESIS reconstructs real-world applications into lightweight web environments using multimodal code models and equips them with code-native rewards, executable assertions that provide deterministic reward signals and eliminate visual estimation noise. Extensive experiments show that GUI-GENESIS reduces environment latency by 10 times and costs by over 28,000 per epoch compared to training on real applications. Notably, agents trained with GUI-GENESIS outperform the base model by 14.54% and even real-world RL baselines by 3.27% on held-out real-world tasks. Finally, we observe that models can synthesize environments they cannot yet solve, highlighting a pathway for self-improving agents.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 39 of its 51 references that are in the map. First posted on arXiv 15 Feb 2026.

Builds on

39 of 51 references.

Closest ancestors · 12

Same direction, newest first

  1. 2025MobileRL: Online Agentic Reinforcement Learning for Mobile GUI Agents10 Sep
  2. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning2 Sep
  3. 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation21 Aug
  4. 2025Mobile-R1: Towards Interactive Capability for VLM-Based Mobile Agent via Systematic Training25 Jun
  5. 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
  6. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
  7. 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
  8. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
  9. 2024GUICourse: From General Vision Language Models to Versatile GUI Agents17 Jun
  10. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
  11. 2024Android in the Zoo: Chain-of-Action-Thought for GUI Agents5 Mar
  12. 2023CogAgent: A Visual Language Model for GUI Agents14 Dec

Other references · 27

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  6. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  7. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  8. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  9. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
  10. 2025Kimi K2: Open Agentic Intelligencecited by 523
  11. 2018Behavioral Cloning from Observationcited by 482
  12. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
15 more
  1. 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 314
  2. 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 271
  3. 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 226
  4. 2024GUIOdyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devicescited by 190
  5. 2024Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMscited by 173
  6. 2024Aria-UI: Visual Grounding for GUI Instructionscited by 136
  7. 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 116
  8. 2024Meta-Prompting: Enhancing Language Models with Task-Agnostic Scaffoldingcited by 115
  9. 2025On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Modelscited by 64
  10. 2025Enigmata: Scaling Logical Reasoning in Large Language Models with Synthetic Verifiable Puzzlescited by 53
  11. 2025ViMo: A Generative Visual GUI World Model for App Agentscited by 33
  12. 2025ViCrit: A Verifiable Reinforcement Learning Proxy Task for Visual Perception in VLMscited by 25
  13. 2025Random Policy Valuation is Enough for LLM Reasoning with Verifiable Rewardscited by 10
  14. 2025FunReason-MT Technical Report: Advanced Data Synthesis Solution for Real-world Multi-Turn Tool-usecited by 9
  15. 2025AppForge: From Assistant to Independent Developer -- Are GPTs Ready for Software Development?cited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 16.

16 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026ScaleWoB: Guiding GUI Agents with Coding Agents via Large-Scale Environmental Synthesis
  2. 2026InfiniteWeb: Scalable Web Environment Synthesis for GUI Agent Training
  3. 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis
  4. 2026ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agents
  5. 2026MagicGUI-RMS: A Multi-Agent Reward Model System for Self-Evolving GUI Agents via Automated Feedback Reflux
  6. 2025UI-AGILE: Advancing GUI Agents with Effective Reinforcement Learning and Precise Inference-Time Grounding
  7. 2026GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments
  8. 2025GUI-Bee: Align GUI Action Grounding to Novel Environments via Autonomous Exploration