Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agents
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Recent success in large multimodal models (LMMs) has sparked promising applications of agents capable of autonomously completing complex web tasks. While open-source LMM agents have made significant advances in offline evaluation benchmarks, their performance still falls substantially short of human-level capabilities in more realistic online settings. A key bottleneck is the lack of diverse and large-scale trajectory-level datasets across various domains, which are expensive to collect. In this paper, we address this challenge by developing a scalable recipe to synthesize the largest and most diverse trajectory-level dataset to date, containing over 94K successful multimodal web trajectories, spanning 49K unique URLs, 720K screenshots, and 33M web elements. In particular, we leverage extensive web exploration and refinement to obtain diverse task intents. The average cost is 28 cents per successful trajectory, making it affordable to a wide range of users in the community. Leveraging this dataset, we train Explorer, a multimodal web agent, and demonstrate strong performance on both offline and online web agent benchmarks such as Mind2Web-Live, Multimodal-Mind2Web, and MiniWob++. Additionally, our experiments highlight data scaling as a key driver for improving web agent capabilities. We hope this study makes state-of-the-art LMM-based agent research at a larger scale more accessible.
Key facts. Cited by 68 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 40 of its 54 references that are in the map. First posted on arXiv 17 Feb 2025.
Builds on
40 of 54 references.
Closest ancestors · 11
Same direction, newest first
- 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorials12 Dec
- 2024ScribeAgent: Towards Specialized Web Agents Using Production-Scale Workflow Data22 Nov
- 2024OpenWebVoyager: Building Multimodal Web Agents via Iterative Real-World Exploration, Feedback and Optimization25 Oct
- 2024AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?22 Jul
- 2024WebCanvas: Benchmarking Web Agents in Online Environments18 Jun
- 2024AutoWebGLM: A Large Language Model-based Web Navigating Agent4 Apr
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models25 Jan
- 2024GPT-4V(ision) is a Generalist Web Agent, if Grounded3 Jan
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agents25 Jul
- 2023Mind2Web: Towards a Generalist Agent for the Web9 Jun
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents4 Jul
Other references · 29
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agentscited by 553
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 373
- 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
- 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
- 2018Reinforcement Learning on Web Interfaces Using Workflow-Guided Explorationcited by 282
- 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 271
- 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scalecited by 212
17 more
- 2022ZeroGen: Efficient Zero-shot Learning via Dataset Generationcited by 209
- 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 203
- 2024On the Effects of Data Scale on UI Control Agentscited by 187
- 2024WebLINX: Real-World Website Navigation with Multi-Turn Dialoguecited by 177
- 2024OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Webcited by 156
- 2024Android in the Zoo: Chain-of-Action-Thought for GUI Agentscited by 156
- 2023Does Synthetic Data Generation of LLMs Help Clinical Text Mining?cited by 151
- 2024Tree Search for Language Model Agentscited by 148
- 2023GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI Navigationcited by 137
- 2024Autonomous Evaluation and Refinement of Digital Agentscited by 136
- 2024GUICourse: From General Vision Language Models to Versatile GUI Agentscited by 112
- 2024AgentInstruct: Toward Generative Teaching with Agentic Flowscited by 88
- 2023Lemur: Harmonizing Natural Language and Code for Language Agentscited by 71
- 2018Tranco: A Research-Oriented Top Sites Ranking Hardened Against Manipulationcited by 61
- 2021Grounding Open-Domain Instructions to Automate Web Support Taskscited by 43
- 2024Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scalecited by 43
- 2024EDGE: Enhanced Grounded GUI Understanding with Enriched Multi-Granularity Synthetic Datacited by 10
Built on by
Citing papers per year: 2025: 25; 2026: 43.
68 papers.
Sort:
By area:
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
- 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 174
- 2025WebExplorer: Explore and Evolve for Training Long-Horizon Web Agentscited by 86
- 2025Agent Learning via Early Experiencecited by 79
- 2025WebEvolver: Enhancing Web Agent Self-Improvement with Coevolving World Modelcited by 56
- 2025OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflowscited by 54
- 2025AgentSynth: Scalable Task Generation for Generalist Computer-Use Agentscited by 41
- 2025Scaling Agent Learning via Experience Synthesiscited by 40
- 2025Fara-7B: An Efficient Agentic Model for Computer Usecited by 34
- 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulatorscited by 34
- 2025Go-Browse: Training Web Agents with Structured Explorationcited by 32
- 2025MedBrowseComp: Benchmarking Medical Deep Research and Computer Usecited by 28
38 more
- 2026Gym-Anything: Turn any Software into an Agent Environmentcited by 24
- 2026WebXSkill: Skill Learning for Autonomous Web Agentscited by 24
- 2025ProgRM: Build Better GUI Agents with Progress Rewardscited by 21
- 2025WebGuard: Building a Generalizable Guardrail for Web Agentscited by 20
- 2026AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machinescited by 20
- 2025LLMs as Scalable, General-Purpose Simulators For Evolving Digital Agent Trainingcited by 17
- 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applicationscited by 17
- 2025WALT: Web Agents that Learn Toolscited by 15
- 2025WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollbackcited by 14
- 2026CoEvolve: Training LLM Agents via Agent-Data Mutual Evolutioncited by 14
- 2026DynaWeb: Model-Based Reinforcement Learning of Web Agentscited by 12
- 2025Automated Skill Discovery for Language Agents through Exploration and Iterative Feedbackcited by 11
- 2026DocDancer: Towards Agentic Document-Grounded Information Seekingcited by 11
- 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesiscited by 10
- 2025Watch and Learn: Learning to Use Computers from Online Videoscited by 9
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agentscited by 9
- 2026TRACE: Trajectory-Aware Comprehensive Evaluation for Deep Research Agentscited by 8
- 2026Scaling Web Agent Training through Automatic Data Generation and Fine-grained Evaluationcited by 6
- 2026TimeWarp: Evaluating Web Agents by Revisiting the Pastcited by 6
- 2026WebFactory: Automated Compression of Foundational Language Intelligence into Grounded Web Agentscited by 6
- 2025Towards Self-Evolving Benchmarks: Synthesizing Agent Trajectories via Test-Time Exploration under Validate-by-Reproduce Paradigmcited by 5
- 2025Using GUI Agent for Electronic Design Automationcited by 5
- 2026Look Before You Leap: Autonomous Exploration for LLM Agentscited by 5
- 2026Fara-1.5: Scalable Learning Environments for Computer Use Agentscited by 5
- 2026TreeCUA: Efficiently Scaling GUI Automation with Tree-Structured Verifiable Evolutioncited by 4
- 2026WebChain: A Large-Scale Human-Annotated Dataset of Real-World Web Interaction Tracescited by 4
- 2026Ego2Web: A Web Agent Benchmark Grounded in Egocentric Videoscited by 4
- 2026UI-Oceanus: Scaling GUI Agents with Synthetic Environmental Dynamicscited by 4
- 2025Co-EPG: A Framework for Co-Evolution of Planning and Grounding in Autonomous GUI Agentscited by 3
- 2026ANCHOR: Branch-Point Data Generation for GUI Agentscited by 3
- 2026Video-Based Reward Modeling for Computer-Use Agentscited by 3
- 2026The Tool Illusion: Rethinking Tool Use in Web Agentscited by 3
- 2026Structured Distillation of Web Agent Capabilities Enables Generalizationcited by 3
- 2026GUI Agents with Reinforcement Learning: Toward Digital Inhabitantscited by 3
- 2026Planner Matters! An Efficient and Unbalanced Multi-agent Collaboration Framework for Long-horizon Planningcited by 3
- 2025InfraMind: A Novel Exploration-based GUI Agentic Framework for Mission-critical Industrial Managementcited by 2
- 2026HTMLCure: Turning Browser Experience into State Guided Repair for Interactive HTMLcited by 2
- 2026ProCUA-SFT Technical Reportcited by 2
50 most cited of 68 All 68 (JSON)
- 2026Probe to Act: Elevating Browser-Use Agent via Active Visual Probing27 Sep 2026
- 2026From Trajectories to Grounded Preferences: Process Preference Synthesis via Interaction Element Graphs for Web PRMs26 Sep 2026
- 2026AutoTailor: Automatic, User-Aligned Capability Selection and Adaptation for Web Agents11 Sep 2026
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents27 Aug 2026
- 2026BrowserForge: Scaling Web Episode via Parallel Browser Sandboxes25 Aug 2026
- 2026SynWeaver: Website-Prior Task and Trajectory Co-Synthesis for Web Agents12 Aug 2026
- 2026Activity Frames: Deterministic Screen-Activity Compilation for Agent Memory and Replay6 Aug 2026
- 2026RMSWeb: Reflection, Failure-Mode Mining, and Salvage-DS for Web Agent Reinforcement Learning31 Jul 2026
- 2026Internalizing the Future: A Unified Agentic Training Paradigm for World Model Planning25 Jun 2026
- 2026ChainWorld: Composing Long-Horizon Desktop Workloads from Atomic OSWorld Tasks19 Jun 2026
- 2026Fara-1.5: Scalable Learning Environments for Computer Use Agents18 Jun 2026
- 2026ProCUA-SFT Technical Report15 Jun 2026
38 more
- 2026WebChallenger: A Reliable and Efficient Generalist Web Agent9 Jun 2026
- 2026HTMLCure: Turning Browser Experience into State Guided Repair for Interactive HTML26 May 2026
- 2026ScaleWoB: Guiding GUI Agents with Coding Agents via Large-Scale Environmental Synthesis24 May 2026
- 2026Look Before You Leap: Autonomous Exploration for LLM Agents15 May 2026
- 2026Skill-CMIB: Multimodal Agent Skill for Consistent Action via Conditional Multimodal Information Bottleneck8 May 2026
- 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applications8 May 2026
- 2026AutoFocus: Uncertainty-Aware Active Visual Search for GUI Grounding4 May 2026
- 2026Planner Matters! An Efficient and Unbalanced Multi-agent Collaboration Framework for Long-horizon Planning4 May 2026
- 2026GUI Agents with Reinforcement Learning: Toward Digital Inhabitants30 Apr 2026
- 2026AutoSurfer -- Teaching Web Agents through Comprehensive Surfing, Learning, and Modeling29 Apr 2026
- 2026CoEvolve: Training LLM Agents via Agent-Data Mutual Evolution17 Apr 2026
- 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesis16 Apr 2026
- 2026WebXSkill: Skill Learning for Autonomous Web Agents14 Apr 2026
- 2026Structured Distillation of Web Agent Capabilities Enables Generalization9 Apr 2026
- 2026Gym-Anything: Turn any Software into an Agent Environment7 Apr 2026
- 2026The Tool Illusion: Rethinking Tool Use in Web Agents3 Apr 2026
- 2026Ego2Web: A Web Agent Benchmark Grounded in Egocentric Videos23 Mar 2026
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agents12 Mar 2026
- 2026Video-Based Reward Modeling for Computer-Use Agents10 Mar 2026
- 2026WebChain: A Large-Scale Human-Annotated Dataset of Real-World Web Interaction Traces5 Mar 2026
- 2026WebFactory: Automated Compression of Foundational Language Intelligence into Grounded Web Agents5 Mar 2026
- 2026TimeWarp: Evaluating Web Agents by Revisiting the Past5 Mar 2026
- 2026AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machines15 Feb 2026
- 2026Building Autonomous GUI Navigation via Agentic-Q Estimation and Step-Wise Policy Optimization14 Feb 2026
- 2026Scaling Web Agent Training through Automatic Data Generation and Fine-grained Evaluation13 Feb 2026
- 2026UI-Oceanus: Scaling GUI Agents with Synthetic Environmental Dynamics11 Feb 2026
- 2026TreeCUA: Efficiently Scaling GUI Automation with Tree-Structured Verifiable Evolution10 Feb 2026
- 2026ANCHOR: Branch-Point Data Generation for GUI Agents6 Feb 2026
- 2026TRACE: Trajectory-Aware Comprehensive Evaluation for Deep Research Agents5 Feb 2026
- 2026DynaWeb: Model-Based Reinforcement Learning of Web Agents29 Jan 2026
- 2026DocDancer: Towards Agentic Document-Grounded Information Seeking8 Jan 2026
- 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulators22 Dec 2025
- 2025Using GUI Agent for Electronic Design Automation12 Dec 2025
- 2025LegalWebAgent: Empowering Access to Justice via LLM-Based Web Agents28 Nov 2025
- 2025Fara-7B: An Efficient Agentic Model for Computer Use24 Nov 2025
- 2025Co-EPG: A Framework for Co-Evolution of Planning and Grounding in Autonomous GUI Agents13 Nov 2025
- 2025Scaling Agent Learning via Experience Synthesis5 Nov 2025
- 2025LLMs as Scalable, General-Purpose Simulators For Evolving Digital Agent Training16 Oct 2025
50 newest of 68 All 68 (JSON)
- 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 174
- 2025WebExplorer: Explore and Evolve for Training Long-Horizon Web Agentscited by 86
- 2025OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflowscited by 54
- 2025AgentSynth: Scalable Task Generation for Generalist Computer-Use Agentscited by 41
- 2025Fara-7B: An Efficient Agentic Model for Computer Usecited by 34
- 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulatorscited by 34
- 2025Go-Browse: Training Web Agents with Structured Explorationcited by 32
- 2026Gym-Anything: Turn any Software into an Agent Environmentcited by 24
- 2026WebXSkill: Skill Learning for Autonomous Web Agentscited by 24
- 2025ProgRM: Build Better GUI Agents with Progress Rewardscited by 21
- 2025WebGuard: Building a Generalizable Guardrail for Web Agentscited by 20
- 2026AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machinescited by 20
12 most cited of 50 All 50 (JSON)
- 2026AutoTailor: Automatic, User-Aligned Capability Selection and Adaptation for Web Agents11 Sep 2026
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents27 Aug 2026
- 2026BrowserForge: Scaling Web Episode via Parallel Browser Sandboxes25 Aug 2026
- 2026SynWeaver: Website-Prior Task and Trajectory Co-Synthesis for Web Agents12 Aug 2026
- 2026Activity Frames: Deterministic Screen-Activity Compilation for Agent Memory and Replay6 Aug 2026
- 2026RMSWeb: Reflection, Failure-Mode Mining, and Salvage-DS for Web Agent Reinforcement Learning31 Jul 2026
- 2026ChainWorld: Composing Long-Horizon Desktop Workloads from Atomic OSWorld Tasks19 Jun 2026
- 2026Fara-1.5: Scalable Learning Environments for Computer Use Agents18 Jun 2026
- 2026ProCUA-SFT Technical Report15 Jun 2026
- 2026ScaleWoB: Guiding GUI Agents with Coding Agents via Large-Scale Environmental Synthesis24 May 2026
- 2026Look Before You Leap: Autonomous Exploration for LLM Agents15 May 2026
- 2026Skill-CMIB: Multimodal Agent Skill for Consistent Action via Conditional Multimodal Information Bottleneck8 May 2026
12 newest of 50 All 50 (JSON)
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
- 2025WALT: Web Agents that Learn Toolscited by 15
- 2025WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollbackcited by 14
- 2026WebChallenger: A Reliable and Efficient Generalist Web Agentcited by 0
- 2026From Trajectories to Grounded Preferences: Process Preference Synthesis via Interaction Element Graphs for Web PRMscited by 0
- 2026From Trajectories to Grounded Preferences: Process Preference Synthesis via Interaction Element Graphs for Web PRMs26 Sep 2026
- 2026WebChallenger: A Reliable and Efficient Generalist Web Agent9 Jun 2026
- 2025WALT: Web Agents that Learn Tools1 Oct 2025
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun 2025
- 2025WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollback26 May 2025
- 2025Agent Learning via Early Experiencecited by 79
- 2025Scaling Agent Learning via Experience Synthesiscited by 40
- 2025MedBrowseComp: Benchmarking Medical Deep Research and Computer Usecited by 28
- 2025LLMs as Scalable, General-Purpose Simulators For Evolving Digital Agent Trainingcited by 17
- 2025Watch and Learn: Learning to Use Computers from Online Videoscited by 9
- 2026HTMLCure: Turning Browser Experience into State Guided Repair for Interactive HTMLcited by 2
- 2025Toward Autonomous UI Exploration: The UIExplorer Benchmarkcited by 0
- 2026Probe to Act: Elevating Browser-Use Agent via Active Visual Probingcited by 0
- 2026Probe to Act: Elevating Browser-Use Agent via Active Visual Probing27 Sep 2026
- 2026HTMLCure: Turning Browser Experience into State Guided Repair for Interactive HTML26 May 2026
- 2025Scaling Agent Learning via Experience Synthesis5 Nov 2025
- 2025LLMs as Scalable, General-Purpose Simulators For Evolving Digital Agent Training16 Oct 2025
- 2025Agent Learning via Early Experience9 Oct 2025
- 2025Watch and Learn: Learning to Use Computers from Online Videos6 Oct 2025
- 2025Toward Autonomous UI Exploration: The UIExplorer Benchmark21 Jun 2025
- 2025MedBrowseComp: Benchmarking Medical Deep Research and Computer Use20 May 2025
Similar, not cited
Close in wording, no citation either way
- 2026UNIBROWSE: A Data-to-Agent Framework for Multimodal BrowseComp
- 2026Odysseys: Benchmarking Web Agents on Realistic Long Horizon Tasks
- 2023Multimodal Web Navigation with Instruction-Finetuned Foundation Models
- 2026WebRetriever: A Large-Scale Comprehensive Benchmark for Efficient Web Agent Evaluation
- 2024MMInA: Benchmarking Multihop Multimodal Internet Agents
- 2026Weblica: Scalable and Reproducible Training Environments for Visual Web Agents
- 2025WebSynthesis: World-Model-Guided MCTS for Efficient WebUI-Trajectory Synthesis
- 2026MolmoWeb: Open Visual Web Agent and Open Data for the Open Web