mlsanityData to 7 Oct 2026

Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agents

arXiv 2502.11357 ↗First posted 17 Feb 2025cs.AI cs.HCcited by 68

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Recent success in large multimodal models (LMMs) has sparked promising applications of agents capable of autonomously completing complex web tasks. While open-source LMM agents have made significant advances in offline evaluation benchmarks, their performance still falls substantially short of human-level capabilities in more realistic online settings. A key bottleneck is the lack of diverse and large-scale trajectory-level datasets across various domains, which are expensive to collect. In this paper, we address this challenge by developing a scalable recipe to synthesize the largest and most diverse trajectory-level dataset to date, containing over 94K successful multimodal web trajectories, spanning 49K unique URLs, 720K screenshots, and 33M web elements. In particular, we leverage extensive web exploration and refinement to obtain diverse task intents. The average cost is 28 cents per successful trajectory, making it affordable to a wide range of users in the community. Leveraging this dataset, we train Explorer, a multimodal web agent, and demonstrate strong performance on both offline and online web agent benchmarks such as Mind2Web-Live, Multimodal-Mind2Web, and MiniWob++. Additionally, our experiments highlight data scaling as a key driver for improving web agent capabilities. We hope this study makes state-of-the-art LMM-based agent research at a larger scale more accessible.

Key facts. Cited by 68 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 40 of its 54 references that are in the map. First posted on arXiv 17 Feb 2025.

Builds on

40 of 54 references.

Closest ancestors · 11

Same direction, newest first

  1. 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorials12 Dec
  2. 2024ScribeAgent: Towards Specialized Web Agents Using Production-Scale Workflow Data22 Nov
  3. 2024OpenWebVoyager: Building Multimodal Web Agents via Iterative Real-World Exploration, Feedback and Optimization25 Oct
  4. 2024AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?22 Jul
  5. 2024WebCanvas: Benchmarking Web Agents in Online Environments18 Jun
  6. 2024AutoWebGLM: A Large Language Model-based Web Navigating Agent4 Apr
  7. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models25 Jan
  8. 2024GPT-4V(ision) is a Generalist Web Agent, if Grounded3 Jan
  9. 2023WebArena: A Realistic Web Environment for Building Autonomous Agents25 Jul
  10. 2023Mind2Web: Towards a Generalist Agent for the Web9 Jun
  11. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents4 Jul

Other references · 29

  1. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  2. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  3. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
  4. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  5. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  6. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agentscited by 553
  7. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 373
  8. 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
  9. 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
  10. 2018Reinforcement Learning on Web Interfaces Using Workflow-Guided Explorationcited by 282
  11. 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 271
  12. 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scalecited by 212
17 more
  1. 2022ZeroGen: Efficient Zero-shot Learning via Dataset Generationcited by 209
  2. 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 203
  3. 2024On the Effects of Data Scale on UI Control Agentscited by 187
  4. 2024WebLINX: Real-World Website Navigation with Multi-Turn Dialoguecited by 177
  5. 2024OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Webcited by 156
  6. 2024Android in the Zoo: Chain-of-Action-Thought for GUI Agentscited by 156
  7. 2023Does Synthetic Data Generation of LLMs Help Clinical Text Mining?cited by 151
  8. 2024Tree Search for Language Model Agentscited by 148
  9. 2023GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI Navigationcited by 137
  10. 2024Autonomous Evaluation and Refinement of Digital Agentscited by 136
  11. 2024GUICourse: From General Vision Language Models to Versatile GUI Agentscited by 112
  12. 2024AgentInstruct: Toward Generative Teaching with Agentic Flowscited by 88
  13. 2023Lemur: Harmonizing Natural Language and Code for Language Agentscited by 71
  14. 2018Tranco: A Research-Oriented Top Sites Ranking Hardened Against Manipulationcited by 61
  15. 2021Grounding Open-Domain Instructions to Automate Web Support Taskscited by 43
  16. 2024Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scalecited by 43
  17. 2024EDGE: Enhanced Grounded GUI Understanding with Enriched Multi-Granularity Synthetic Datacited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 25; 2026: 43.

68 papers.

Sort:

By area:

  1. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
  2. 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 174
  3. 2025WebExplorer: Explore and Evolve for Training Long-Horizon Web Agentscited by 86
  4. 2025Agent Learning via Early Experiencecited by 79
  5. 2025WebEvolver: Enhancing Web Agent Self-Improvement with Coevolving World Modelcited by 56
  6. 2025OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflowscited by 54
  7. 2025AgentSynth: Scalable Task Generation for Generalist Computer-Use Agentscited by 41
  8. 2025Scaling Agent Learning via Experience Synthesiscited by 40
  9. 2025Fara-7B: An Efficient Agentic Model for Computer Usecited by 34
  10. 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulatorscited by 34
  11. 2025Go-Browse: Training Web Agents with Structured Explorationcited by 32
  12. 2025MedBrowseComp: Benchmarking Medical Deep Research and Computer Usecited by 28
38 more
  1. 2026Gym-Anything: Turn any Software into an Agent Environmentcited by 24
  2. 2026WebXSkill: Skill Learning for Autonomous Web Agentscited by 24
  3. 2025ProgRM: Build Better GUI Agents with Progress Rewardscited by 21
  4. 2025WebGuard: Building a Generalizable Guardrail for Web Agentscited by 20
  5. 2026AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machinescited by 20
  6. 2025LLMs as Scalable, General-Purpose Simulators For Evolving Digital Agent Trainingcited by 17
  7. 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applicationscited by 17
  8. 2025WALT: Web Agents that Learn Toolscited by 15
  9. 2025WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollbackcited by 14
  10. 2026CoEvolve: Training LLM Agents via Agent-Data Mutual Evolutioncited by 14
  11. 2026DynaWeb: Model-Based Reinforcement Learning of Web Agentscited by 12
  12. 2025Automated Skill Discovery for Language Agents through Exploration and Iterative Feedbackcited by 11
  13. 2026DocDancer: Towards Agentic Document-Grounded Information Seekingcited by 11
  14. 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesiscited by 10
  15. 2025Watch and Learn: Learning to Use Computers from Online Videoscited by 9
  16. 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agentscited by 9
  17. 2026TRACE: Trajectory-Aware Comprehensive Evaluation for Deep Research Agentscited by 8
  18. 2026Scaling Web Agent Training through Automatic Data Generation and Fine-grained Evaluationcited by 6
  19. 2026TimeWarp: Evaluating Web Agents by Revisiting the Pastcited by 6
  20. 2026WebFactory: Automated Compression of Foundational Language Intelligence into Grounded Web Agentscited by 6
  21. 2025Towards Self-Evolving Benchmarks: Synthesizing Agent Trajectories via Test-Time Exploration under Validate-by-Reproduce Paradigmcited by 5
  22. 2025Using GUI Agent for Electronic Design Automationcited by 5
  23. 2026Look Before You Leap: Autonomous Exploration for LLM Agentscited by 5
  24. 2026Fara-1.5: Scalable Learning Environments for Computer Use Agentscited by 5
  25. 2026TreeCUA: Efficiently Scaling GUI Automation with Tree-Structured Verifiable Evolutioncited by 4
  26. 2026WebChain: A Large-Scale Human-Annotated Dataset of Real-World Web Interaction Tracescited by 4
  27. 2026Ego2Web: A Web Agent Benchmark Grounded in Egocentric Videoscited by 4
  28. 2026UI-Oceanus: Scaling GUI Agents with Synthetic Environmental Dynamicscited by 4
  29. 2025Co-EPG: A Framework for Co-Evolution of Planning and Grounding in Autonomous GUI Agentscited by 3
  30. 2026ANCHOR: Branch-Point Data Generation for GUI Agentscited by 3
  31. 2026Video-Based Reward Modeling for Computer-Use Agentscited by 3
  32. 2026The Tool Illusion: Rethinking Tool Use in Web Agentscited by 3
  33. 2026Structured Distillation of Web Agent Capabilities Enables Generalizationcited by 3
  34. 2026GUI Agents with Reinforcement Learning: Toward Digital Inhabitantscited by 3
  35. 2026Planner Matters! An Efficient and Unbalanced Multi-agent Collaboration Framework for Long-horizon Planningcited by 3
  36. 2025InfraMind: A Novel Exploration-based GUI Agentic Framework for Mission-critical Industrial Managementcited by 2
  37. 2026HTMLCure: Turning Browser Experience into State Guided Repair for Interactive HTMLcited by 2
  38. 2026ProCUA-SFT Technical Reportcited by 2

50 most cited of 68 All 68 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026UNIBROWSE: A Data-to-Agent Framework for Multimodal BrowseComp
  2. 2026Odysseys: Benchmarking Web Agents on Realistic Long Horizon Tasks
  3. 2023Multimodal Web Navigation with Instruction-Finetuned Foundation Models
  4. 2026WebRetriever: A Large-Scale Comprehensive Benchmark for Efficient Web Agent Evaluation
  5. 2024MMInA: Benchmarking Multihop Multimodal Internet Agents
  6. 2026Weblica: Scalable and Reproducible Training Environments for Visual Web Agents
  7. 2025WebSynthesis: World-Model-Guided MCTS for Efficient WebUI-Trajectory Synthesis
  8. 2026MolmoWeb: Open Visual Web Agent and Open Data for the Open Web