mlsanityData to 14 Oct 2026

AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machines

arXiv 2602.14296 ↗First posted 15 Feb 2026cs.AI cs.SEcited by 21

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

The performance of autonomous Web GUI agents heavily relies on the quality and quantity of their training data. However, a fundamental bottleneck persists: collecting interaction trajectories from real-world websites is expensive and difficult to verify. The underlying state transitions are hidden, leading to reliance on inconsistent and costly external verifiers to evaluate step-level correctness. To address this, we propose AutoWebWorld, a novel framework for synthesizing controllable and verifiable web environments by modeling them as Finite State Machines (FSMs) and use coding agents to translate FSMs into interactive websites. Unlike real websites, where state transitions are implicit, AutoWebWorld explicitly defines all states, actions, and transition rules. This enables programmatic verification: action correctness is checked against predefined rules, and task success is confirmed by reaching a goal state in the FSM graph. AutoWebWorld enables a fully automated search-and-verify pipeline, generating over 11,663 verified trajectories from 29 diverse web environments at only 0.04 per trajectory. Training on this synthetic data significantly boosts real-world performance. Our 7B Web GUI agent outperforms all baselines within 15 steps on WebVoyager. Furthermore, we observe a clear scaling law: as the synthetic data volume increases, performance on WebVoyager and Online-Mind2Web consistently improves.

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 30 of its 37 references that are in the map. First posted on arXiv 15 Feb 2026.

Builds on

30 of 37 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026InfiniteWeb: Scalable Web Environment Synthesis for GUI Agent Training7 Jan
  2. 2025Fara-7B: An Efficient Agentic Model for Computer Use24 Nov
  3. 2025A Survey of Data Agents: Emerging Paradigm or Overstated Hype?27 Oct
  4. 2025AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories11 Apr
  5. 2025An Illusion of Progress? Assessing the Current State of Web Agents2 Apr
  6. 2025Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agents17 Feb
  7. 2025InSTA: Towards Internet-Scale Training For Agents10 Feb
  8. 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorials12 Dec
  9. 2024NNetNav: Unsupervised Learning of Browser Agents Through Environment Interaction in the Wild3 Oct
  10. 2024WebCanvas: Benchmarking Web Agents in Online Environments18 Jun
  11. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models25 Jan
  12. 2023WebArena: A Realistic Web Environment for Building Autonomous Agents25 Jul
2 more
  1. 2023Mind2Web: Towards a Generalist Agent for the Web9 Jun
  2. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents4 Jul

Other references · 16

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  3. 2024A Survey on LLM-as-a-Judgecited by 1,423
  4. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
  5. 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 465
  6. 2025Kimi-VL Technical Reportcited by 388
  7. 2018Reinforcement Learning on Web Interfaces Using Workflow-Guided Explorationcited by 284
  8. 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Usecited by 254
  9. 2024WebLINX: Real-World Website Navigation with Multi-Turn Dialoguecited by 180
  10. 2025OpenCUA: Open Foundations for Computer-Use Agentscited by 160
  11. 2024Autonomous Evaluation and Refinement of Digital Agentscited by 137
  12. 2025UI-Venus Technical Report: Building High-performance UI Agents with RFTcited by 93
4 more
  1. 2024ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answeringcited by 50
  2. 2025VideoAgentTrek: Computer Use Pretraining from Unlabeled Videoscited by 22
  3. 2025Efficient Agent Training for Computer Usecited by 18
  4. 2025LEAD: Iterative Data Selection for Efficient LLM Instruction Tuningcited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 21.

21 papers.

Sort:

By area:

  1. 2026Qwen-AgentWorld: Language World Models for General Agentscited by 28
  2. 2026CUA-Gym: Scaling Verifiable Training Environments and Tasks for Computer-Use Agentscited by 23
  3. 2026MolmoWeb: Open Visual Web Agent and Open Data for the Open Webcited by 19
  4. 2026Recursive Synthesis for Long-Horizon Terminal Taskscited by 19
  5. 2026InfoPO: Information-Driven Policy Optimization for User-Centric Agentscited by 12
  6. 2026Harnessing Agentic Evolutioncited by 11
  7. 2026Learning to Build the Environment: Self-Evolving Reasoning RL via Verifiable Environment Synthesiscited by 8
  8. 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
  9. 2026Qwen-CUA: Native Computer Use for (almost) Everythingcited by 8
  10. 2026PatchWorld: Gradient-Free Optimization of Executable World Models for Agent Environmentscited by 7
  11. 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agentscited by 5
  12. 2026PhoneBuddy: Training Open Models for Agentic Phone Usecited by 4
9 more
  1. 2026Beyond Simply Environment Scaling: Designing Effective Environment Distributions for Multimodal Agent Learningcited by 3
  2. 2026Scalable Environments Drive Generalizable Agentscited by 2
  3. 2026PhoneWorld: From Real-App Trajectories to Dynamic and Verifiable Environments for Phone-Use Agentscited by 1
  4. 2026RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agentscited by 1
  5. 2026DataMagic: Authoring Data Videos through Declarative Multi-Agent Orchestrationcited by 1
  6. 2026UI2App: Benchmarking Visual Interaction Inference in Executable Web Application Generationcited by 0
  7. 2026From Trajectories to Grounded Preferences: Process Preference Synthesis via Interaction Element Graphs for Web PRMscited by 0
  8. 2026AutoGUIWorld: Image Generators as Visual World Models for GUI Agentcited by 0
  9. 2026Davinci-Tool: Scaling Agentic Tool-Use Supervision with Verifiable Executable Environmentscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Training Needs Trustworthy Worlds: Verified Synthetic Web Environments for Agent Learning
  2. 2025WebSynthesis: World-Model-Guided MCTS for Efficient WebUI-Trajectory Synthesis
  3. 2026GUI-GENESIS: Automated Synthesis of Efficient Environments with Verifiable Rewards for GUI Agent Post-Training
  4. 2025REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websites
  5. 2026SynWeaver: Website-Prior Task and Trajectory Co-Synthesis for Web Agents
  6. 2026WebWorld: A Large-Scale World Model for Web Agent Training
  7. 2026ScaleWoB: Guiding GUI Agents with Coding Agents via Large-Scale Environmental Synthesis
  8. 2026Before Acting, Change the State: Prospective State Intervention for Web Agents under Deceptive Interfaces