mlsanityData to 14 Oct 2026

AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agents

arXiv 2608.05891 ↗First posted 6 Aug 2026cs.AI cs.CLcited by 2

On the map: World models → World model security and GUI agents

also in 1 more
Abstract (arXiv)

Mobile GUI agents can operate apps through pixel perception and touch actions, making them a promising interface for collecting and improving long-horizon mobile interaction policies. However, real trajectories are difficult to obtain for sensitive apps and privacy-critical operations. At the same time, existing simulated environments are costly to scale up, and GUI world models still suffer from unstable generation, limited modality coverage, and inconsistent action-transition logic. To address these limitations, we propose AppDeltaWorld, a transition-grounded delta code world model that predicts the next GUI as a reachable code update rather than as an unconstrained image or text description. AppDeltaWorld retrieves app-specific Level-1 HTML references under an action-transition constraint, generates Level-2 executable HTML conditioned on the current screen, action, predicted next-screen text, and retrieved structure, and inserts generated visual assets into image slots before browser rendering. As a world model, AppDeltaWorld achieves the highest fidelity on CMGUIBench-500 under Code2World evaluation, with clear gains in structural layout and UI element reconstruction over image-only and code-only baselines. As a training environment, AppDeltaWorld supports filtered closed-loop SFT data construction that, when combined with public supervision, enables AppDeltaAgent to achieve state-of-the-art performance on AndroidLens and consistent gains on MobileGym and MobileWorld. Moreover, world-model-based test-time reinforcement learning enables policy adaptation and shows further improvements without additional interaction with real apps.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in World model security and GUI agents, one of 11 directions in World models. Builds on 33 of its 47 references that are in the map. First posted on arXiv 6 Aug 2026.

Builds on

33 of 47 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026How Mobile World Model Guides GUI Agents?11 May
  2. 2026Code2World: A GUI World Model via Renderable Code Generation10 Feb
  3. 2026Generative Visual Code Mobile World Models2 Feb
  4. 2026MobileDreamer: Generative Sketch World Model for GUI Agent7 Jan
  5. 2025MobileWorldBench: Towards Semantic World Modeling For Mobile Agents16 Dec
  6. 2025ViMo: A Generative Visual GUI World Model for App Agents15 Apr

Other references · 27

  1. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
  2. 2025TTRL: Test-Time Reinforcement Learningcited by 275
  3. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 215
  4. 2024Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agentscited by 154
  5. 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Taskscited by 131
  6. 2024Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigationcited by 126
  7. 2025UI-Venus Technical Report: Building High-performance UI Agents with RFTcited by 93
  8. 2024AppAgent v2: Advanced Agent for Flexible Mobile Interactionscited by 68
  9. 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligencecited by 54
  10. 2025MobileGUI-RL: Advancing Mobile GUI Agent through Reinforcement Learning in Online Environmentcited by 52
  11. 2025From Word to World: Can Large Language Models be Implicit Text-based World Models?cited by 42
  12. 2026Qwen-AgentWorld: Language World Models for General Agentscited by 28
15 more
  1. 2026WebWorld: A Large-Scale World Model for Web Agent Trainingcited by 26
  2. 2024Falcon-UI: Understanding GUI Before Following User Instructionscited by 22
  3. 2025MagicGUI: A Foundational Mobile GUI Agent with Scalable Data Pipeline and Reinforcement Fine-tuningcited by 19
  4. 2025Mobile-Bench-v2: A More Realistic and Comprehensive Benchmark for VLM-based Mobile Agentscited by 16
  5. 2026Computer-Using World Modelcited by 16
  6. 2026GUI-Libra: Training Native GUI Agents to Reason and Act with Action-aware Supervision and Partially Verifiable RLcited by 16
  7. 2026OmegaUse: Building a General-Purpose GUI Agent for Autonomous Task Executioncited by 13
  8. 2026MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Researchcited by 13
  9. 2025STEP: Success-Rate-Aware Trajectory-Efficient Policy Optimizationcited by 12
  10. 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesiscited by 11
  11. 2025MobileIPL: Enhancing Mobile Agents Thinking Process via Iterative Preference Learningcited by 9
  12. 2026CoME: Empowering Channel-of-Mobile-Experts with Informative Hybrid-Capabilities Reasoningcited by 5
  13. 2026SecAgent: Efficient Mobile GUI Agent with Semantic Contextcited by 4
  14. 2026R^3: Replay, Reflection, and Ranking Rewards for LLM Reinforcement Learningcited by 2
  15. 2026PhoneWorld: From Real-App Trajectories to Dynamic and Verifiable Environments for Phone-Use Agentscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024MobileViews: A Million-scale and Diverse Mobile GUI Dataset
  2. 2026StepReflect: Structured UI Transition Reflection for Mobile GUI Agents
  3. 2026GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments
  4. 2026SEE: Structure-aware Exploring & Exploiting for Long-horizon GUI Agent Trajectory Synthesis
  5. 2025TransBench: Breaking Barriers for Transferable Graphical User Interface Agents in Dynamic Digital Environments
  6. 2026APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents
  7. 2026Imagine to Act: High-Fidelity Data Synthesis via Image Editing World Model for Scalable GUI Agent Training
  8. 2026AutoGUIWorld: Image Generators as Visual World Models for GUI Agent