mlsanityData to 7 Oct 2026

Generative Visual Code Mobile World Models

arXiv 2602.01576 ↗First posted 2 Feb 2026cs.LG cs.AI cs.CVcited by 13

On the map: World models → World model security and GUI agents

also in 1 more
Abstract (arXiv)

Mobile Graphical User Interface (GUI) World Models (WMs) offer a promising path for improving mobile GUI agent performance at train- and inference-time. However, current approaches face a critical trade-off: text-based WMs sacrifice visual fidelity, while the inability of visual WMs in precise text rendering led to their reliance on slow, complex pipelines dependent on numerous external models. We propose a novel paradigm: visual world modeling via renderable code generation, where a single Vision-Language Model (VLM) predicts the next GUI state as executable web code that renders to pixels, rather than generating pixels directly. This combines the strengths of both approaches: VLMs retain their linguistic priors for precise text rendering while their pre-training on structured web code enables high-fidelity visual generation. We introduce gWorld (8B, 32B), the first open-weight visual mobile GUI WMs built on this paradigm, along with a data generation framework (gWorld) that automatically synthesizes code-based training data. In extensive evaluation across 4 in- and 2 out-of-distribution benchmarks, gWorld sets a new pareto frontier in accuracy versus model size, outperforming 8 frontier open-weight models over 50.25x larger. Further analyses show that (1) scaling training data via gWorld yields meaningful gains, (2) each component of our pipeline improves data quality, and (3) stronger world modeling improves downstream mobile GUI policy performance.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in World model security and GUI agents, one of 11 directions in World models. Builds on 46 of its 57 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

46 of 57 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026MobileDreamer: Generative Sketch World Model for GUI Agent7 Jan
  2. 2025MobileWorldBench: Towards Semantic World Modeling For Mobile Agents16 Dec
  3. 2025ViMo: A Generative Visual GUI World Model for App Agents15 Apr

Other references · 43

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  4. 2020Scaling Laws for Neural Language Modelscited by 6,411
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  6. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  7. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  8. 2025Qwen3-VL Technical Reportcited by 2,534
  9. 2025Qwen-Image Technical Reportcited by 973
  10. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 740
  11. 2023CogAgent: A Visual Language Model for GUI Agentscited by 692
  12. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
31 more
  1. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
  2. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 373
  3. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
  4. 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 314
  5. 2024OmniParser for Pure Vision Based GUI Agentcited by 193
  6. 2024GUIOdyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devicescited by 190
  7. 2024Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaborationcited by 187
  8. 2024On the Effects of Data Scale on UI Control Agentscited by 187
  9. 2025Mobile-Agent-v3: Fundamental Agents for GUI Automationcited by 183
  10. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 146
  11. 2024Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agentscited by 144
  12. 2025Preference Leakage: A Contamination Problem in LLM-as-a-judgecited by 119
  13. 2024Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigationcited by 116
  14. 2024AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agentscited by 110
  15. 2024GUI Agents: A Surveycited by 101
  16. 2025CWM: An Open-Weights LLM for Research on Code Generation with World Modelscited by 87
  17. 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 73
  18. 2023Visual Chain of Thought: Bridging Logical Gaps with Multimodal Infillingscited by 68
  19. 2025Artificial Intelligence Index Report 2025cited by 58
  20. 2025WebEvolver: Enhancing Web Agent Self-Improvement with Coevolving World Modelcited by 56
  21. 2023Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Modelscited by 45
  22. 2025AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuningcited by 44
  23. 2024Generating Code World Models with Large Language Models Guided by Monte Carlo Tree Searchcited by 38
  24. 2025LLM-Powered GUI Agents in Phone Automation: Surveying Progress and Prospectscited by 31
  25. 2025Code World Models for General Game Playingcited by 25
  26. 2025ScreenCoder: Advancing Visual-to-Code Generation for Front-End Automation via Modular Multimodal Agentscited by 23
  27. 2025WebSynthesis: World-Model-Guided MCTS for Efficient WebUI-Trajectory Synthesiscited by 18
  28. 2025LLMs as Scalable, General-Purpose Simulators For Evolving Digital Agent Trainingcited by 17
  29. 2025LaTCoder: Converting Webpage Design to Code with Layout-as-Thoughtcited by 9
  30. 2025UISim: An Interactive Image-Based UI Simulator for Dynamic Mobile Environmentscited by 5
  31. 2025ScreenExplorer: Training a Vision-Language Model for Diverse Exploration in Open GUI Worldcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Code2World: A GUI World Model via Renderable Code Generation
  2. 2024MobileViews: A Million-scale and Diverse Mobile GUI Dataset
  3. 2024EDGE: Enhanced Grounded GUI Understanding with Enriched Multi-Granularity Synthetic Data
  4. 2026Imagine to Act: High-Fidelity Data Synthesis via Image Editing World Model for Scalable GUI Agent Training
  5. 2026GUITrans2Act: Understanding User Operational Behaviors from Mobile GUI Interactions with Vision-Language Models
  6. 2024GUICourse: From General Vision Language Models to Versatile GUI Agents
  7. 2023Mobile-Env: Building Qualified Evaluation Benchmarks for LLM-GUI Interaction
  8. 2026Coding the Visual World: From Image to Simulation Using Vision Language Models