Generative Visual Code Mobile World Models
On the map: World models → World model security and GUI agents
also in 1 more
Abstract (arXiv)
Mobile Graphical User Interface (GUI) World Models (WMs) offer a promising path for improving mobile GUI agent performance at train- and inference-time. However, current approaches face a critical trade-off: text-based WMs sacrifice visual fidelity, while the inability of visual WMs in precise text rendering led to their reliance on slow, complex pipelines dependent on numerous external models. We propose a novel paradigm: visual world modeling via renderable code generation, where a single Vision-Language Model (VLM) predicts the next GUI state as executable web code that renders to pixels, rather than generating pixels directly. This combines the strengths of both approaches: VLMs retain their linguistic priors for precise text rendering while their pre-training on structured web code enables high-fidelity visual generation. We introduce gWorld (8B, 32B), the first open-weight visual mobile GUI WMs built on this paradigm, along with a data generation framework (gWorld) that automatically synthesizes code-based training data. In extensive evaluation across 4 in- and 2 out-of-distribution benchmarks, gWorld sets a new pareto frontier in accuracy versus model size, outperforming 8 frontier open-weight models over 50.25x larger. Further analyses show that (1) scaling training data via gWorld yields meaningful gains, (2) each component of our pipeline improves data quality, and (3) stronger world modeling improves downstream mobile GUI policy performance.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in World model security and GUI agents, one of 11 directions in World models. Builds on 46 of its 57 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
46 of 57 references.
Closest ancestors · 3
Same direction, newest first
- 2026MobileDreamer: Generative Sketch World Model for GUI Agent7 Jan
- 2025MobileWorldBench: Towards Semantic World Modeling For Mobile Agents16 Dec
- 2025ViMo: A Generative Visual GUI World Model for App Agents15 Apr
Other references · 43
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Visual Instruction Tuningcited by 7,792
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025Qwen-Image Technical Reportcited by 973
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 740
- 2023CogAgent: A Visual Language Model for GUI Agentscited by 692
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
31 more
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 373
- 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
- 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 314
- 2024OmniParser for Pure Vision Based GUI Agentcited by 193
- 2024GUIOdyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devicescited by 190
- 2024Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaborationcited by 187
- 2024On the Effects of Data Scale on UI Control Agentscited by 187
- 2025Mobile-Agent-v3: Fundamental Agents for GUI Automationcited by 183
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 146
- 2024Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agentscited by 144
- 2025Preference Leakage: A Contamination Problem in LLM-as-a-judgecited by 119
- 2024Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigationcited by 116
- 2024AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agentscited by 110
- 2024GUI Agents: A Surveycited by 101
- 2025CWM: An Open-Weights LLM for Research on Code Generation with World Modelscited by 87
- 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 73
- 2023Visual Chain of Thought: Bridging Logical Gaps with Multimodal Infillingscited by 68
- 2025Artificial Intelligence Index Report 2025cited by 58
- 2025WebEvolver: Enhancing Web Agent Self-Improvement with Coevolving World Modelcited by 56
- 2023Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Modelscited by 45
- 2025AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuningcited by 44
- 2024Generating Code World Models with Large Language Models Guided by Monte Carlo Tree Searchcited by 38
- 2025LLM-Powered GUI Agents in Phone Automation: Surveying Progress and Prospectscited by 31
- 2025Code World Models for General Game Playingcited by 25
- 2025ScreenCoder: Advancing Visual-to-Code Generation for Front-End Automation via Modular Multimodal Agentscited by 23
- 2025WebSynthesis: World-Model-Guided MCTS for Efficient WebUI-Trajectory Synthesiscited by 18
- 2025LLMs as Scalable, General-Purpose Simulators For Evolving Digital Agent Trainingcited by 17
- 2025LaTCoder: Converting Webpage Design to Code with Layout-as-Thoughtcited by 9
- 2025UISim: An Interactive Image-Based UI Simulator for Dynamic Mobile Environmentscited by 5
- 2025ScreenExplorer: Training a Vision-Language Model for Diverse Exploration in Open GUI Worldcited by 1
Built on by
Citing papers per year: 2026: 13.
13 papers.
Sort:
By area:
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 10
- 2026How Mobile World Model Guides GUI Agents?cited by 8
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026CUA-Suite: Massive Human-annotated Video Demonstrations for Computer-Use Agentscited by 3
- 2026Scaling GUI Agents with Visual State Transitionscited by 3
- 2026mSFT: Addressing Dataset Mixtures Overfitting Heterogeneously in Multi-task SFTcited by 2
- 2026AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agentscited by 2
- 2026Are GUI Agents Focused Enough? Automated Distraction via Semantic-level UI Element Injectioncited by 1
- 2026GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environmentscited by 1
- 2026Quo Vadis, World Modeling?cited by 0
- 2026AutoGUIWorld: Image Generators as Visual World Models for GUI Agentcited by 0
1 more
- 2026Right Screen, Wrong Transition: World Models as Verifiers for GUI Agents8 Oct 2026
- 2026AutoGUIWorld: Image Generators as Visual World Models for GUI Agent1 Oct 2026
- 2026GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments30 Aug 2026
- 2026AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agents6 Aug 2026
- 2026Quo Vadis, World Modeling?3 Aug 2026
- 2026Scaling GUI Agents with Visual State Transitions27 Jul 2026
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026How Mobile World Model Guides GUI Agents?11 May 2026
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr 2026
- 2026Are GUI Agents Focused Enough? Automated Distraction via Semantic-level UI Element Injection9 Apr 2026
- 2026CUA-Suite: Massive Human-annotated Video Demonstrations for Computer-Use Agents25 Mar 2026
1 more
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 10
- 2026How Mobile World Model Guides GUI Agents?cited by 8
- 2026AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agentscited by 2
- 2026GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environmentscited by 1
- 2026Quo Vadis, World Modeling?cited by 0
- 2026AutoGUIWorld: Image Generators as Visual World Models for GUI Agentcited by 0
- 2026AutoGUIWorld: Image Generators as Visual World Models for GUI Agent1 Oct 2026
- 2026GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments30 Aug 2026
- 2026AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agents6 Aug 2026
- 2026Quo Vadis, World Modeling?3 Aug 2026
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
- 2026How Mobile World Model Guides GUI Agents?11 May 2026
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026CUA-Suite: Massive Human-annotated Video Demonstrations for Computer-Use Agentscited by 3
- 2026Scaling GUI Agents with Visual State Transitionscited by 3
- 2026Are GUI Agents Focused Enough? Automated Distraction via Semantic-level UI Element Injectioncited by 1
- 2026Scaling GUI Agents with Visual State Transitions27 Jul 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026Are GUI Agents Focused Enough? Automated Distraction via Semantic-level UI Element Injection9 Apr 2026
- 2026CUA-Suite: Massive Human-annotated Video Demonstrations for Computer-Use Agents25 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Code2World: A GUI World Model via Renderable Code Generation
- 2024MobileViews: A Million-scale and Diverse Mobile GUI Dataset
- 2024EDGE: Enhanced Grounded GUI Understanding with Enriched Multi-Granularity Synthetic Data
- 2026Imagine to Act: High-Fidelity Data Synthesis via Image Editing World Model for Scalable GUI Agent Training
- 2026GUITrans2Act: Understanding User Operational Behaviors from Mobile GUI Interactions with Vision-Language Models
- 2024GUICourse: From General Vision Language Models to Versatile GUI Agents
- 2023Mobile-Env: Building Qualified Evaluation Benchmarks for LLM-GUI Interaction
- 2026Coding the Visual World: From Image to Simulation Using Vision Language Models