mlsanityData to 14 Oct 2026

A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Models

arXiv 2503.23350 ↗First posted 30 Mar 2025cs.AIcited by 87

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

With the advancement of web techniques, they have significantly revolutionized various aspects of people's lives. Despite the importance of the web, many tasks performed on it are repetitive and time-consuming, negatively impacting overall quality of life. To efficiently handle these tedious daily tasks, one of the most promising approaches is to advance autonomous agents based on Artificial Intelligence (AI) techniques, referred to as AI Agents, as they can operate continuously without fatigue or performance degradation. In the context of the web, leveraging AI Agents -- termed WebAgents -- to automatically assist people in handling tedious daily tasks can dramatically enhance productivity and efficiency. Recently, Large Foundation Models (LFMs) containing billions of parameters have exhibited human-like language understanding and reasoning capabilities, showing proficiency in performing various complex tasks. This naturally raises the question: `Can LFMs be utilized to develop powerful AI Agents that automatically handle web tasks, providing significant convenience to users?' To fully explore the potential of LFMs, extensive research has emerged on WebAgents designed to complete daily web tasks according to user instructions, significantly enhancing the convenience of daily human life. In this survey, we comprehensively review existing research studies on WebAgents across three key aspects: architectures, training, and trustworthiness. Additionally, several promising directions for future research are explored to provide deeper insights.

Key facts. Cited by 87 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 105 of its 185 references that are in the map. First posted on arXiv 30 Mar 2025.

Builds on

105 of 185 references.

Closest ancestors · 23

Same direction, newest first

  1. 2025Learning to Contextualize Web Pages for Enhanced Decision Making by LLM Agents12 Mar
  2. 2025CowPilot: A Framework for Autonomous and Human-Agent Collaborative Web Navigation28 Jan
  3. 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorials12 Dec
  4. 2024The BrowserGym Ecosystem for Web Agent Research6 Dec
  5. 2024ScribeAgent: Towards Specialized Web Agents Using Production-Scale Workflow Data22 Nov
  6. 2024Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents10 Nov
  7. 2024Auto-Intent: Automated Intent Discovery and Self-Exploration for Large Language Model Web Agents29 Oct
  8. 2024Infogent: An Agent-Based Framework for Web Information Aggregation24 Oct
  9. 2024Beyond Browsing: API-Based Web Agents21 Oct
  10. 2024AgentOccam: A Simple Yet Strong Baseline for LLM-Based Web Agents17 Oct
  11. 2024Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigation17 Oct
  12. 2024From Grounding to Planning: Benchmarking Bottlenecks in Web Agents3 Sep
11 more
  1. 2024Agent-E: From Autonomous Web Navigation to Foundational Design Principles in Agentic Systems17 Jul
  2. 2024Large Language Models Can Self-Improve At Web Agent Tasks30 May
  3. 2024Navigating WebAI: Training Agents to Complete Web Tasks with Large Language Models and Reinforcement Learning1 May
  4. 2024Grounded Language Agent for Product Search via Intelligent Web Interactions16 Apr
  5. 2024AutoWebGLM: A Large Language Model-based Web Navigating Agent4 Apr
  6. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models25 Jan
  7. 2024GPT-4V(ision) is a Generalist Web Agent, if Grounded3 Jan
  8. 2023Exposing Limitations of Language Model Agents in Sequential-Task Compositions on the Web30 Nov
  9. 2023LASER: LLM Agent with State-Space Exploration for Web Navigation15 Sep
  10. 2023WebArena: A Realistic Web Environment for Building Autonomous Agents25 Jul
  11. 2023Mind2Web: Towards a Generalist Agent for the Web9 Jun

Other references · 82

  1. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  2. 2020Deep Reinforcement Learning for Autonomous Driving: A Surveycited by 721
  3. 2019Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithmscited by 567
  4. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agentscited by 567
  5. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
  6. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
  7. 2024Understanding the planning of LLM agents: A surveycited by 421
  8. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 382
  9. 2023A Survey on Large Language Models for Recommendationcited by 379
  10. 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agentscited by 378
  11. 2023Language Models can Solve Computer Taskscited by 372
  12. 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 366
38 more
  1. 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 353
  2. 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 319
  3. 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 299
  4. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agentscited by 288
  5. 2024Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Securitycited by 260
  6. 2024DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learningcited by 214
  7. 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 205
  8. 2024OmniParser for Pure Vision Based GUI Agentcited by 198
  9. 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Taskscited by 195
  10. 2024On the Effects of Data Scale on UI Control Agentscited by 194
  11. 2023Synapse: Trajectory-as-Exemplar Prompting with Memory for Computer Controlcited by 187
  12. 2023Multimodal Web Navigation with Instruction-Finetuned Foundation Modelscited by 160
  13. 2024Android in the Zoo: Chain-of-Action-Thought for GUI Agentscited by 159
  14. 2024Tree Search for Language Model Agentscited by 151
  15. 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakagecited by 150
  16. 2024UFO: A UI-Focused Agent for Windows OS Interactioncited by 148
  17. 2024Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agentscited by 137
  18. 2024ST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agentscited by 133
  19. 2024Dissecting Adversarial Robustness of Multimodal LM Agentscited by 120
  20. 2024WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environmentcited by 107
  21. 2019On the Use of ArXiv as a Datasetcited by 103
  22. 2024ScreenAgent: A Vision Language Model-driven Computer Control Agentcited by 102
  23. 2024WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Explorationcited by 101
  24. 2025Unveiling Privacy Risks in LLM Agent Memorycited by 101
  25. 2024Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility Generationcited by 100
  26. 2024ScreenAI: A Vision-Language Model for UI and Infographics Understandingcited by 98
  27. 2023Cooperation, Competition, and Maliciousness: LLM-Stakeholders Interactive Negotiationcited by 96
  28. 2021Trustworthy AI: A Computational Perspectivecited by 93
  29. 2024WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Taskscited by 90
  30. 2024RedCode: Risky Code Execution and Generation Benchmark for Code Agentscited by 90
  31. 2022A data-driven approach for learning to control computerscited by 88
  32. 2024MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuningcited by 76
  33. 2025RTBAS: Defending LLM Agents Against Prompt Injection and Privacy Leakagecited by 69
  34. 2023SteP: Stacked LLM Policies for Web Actionscited by 66
  35. 2024Large Language Models Empowered Personalized Web Agentscited by 66
  36. 2024Refusal-Trained LLMs Are Easily Jailbroken As Browser Agentscited by 65
  37. 2022Spotlight: Mobile UI Understanding using Vision-Language Models with a Focuscited by 62
  38. 2025Knowledge Graph Retrieval-Augmented Generation for LLM-based Recommendationcited by 57

50 most cited of 82 All 82 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 36; 2026: 51.

87 papers.

Sort:

By area:

  1. 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challengescited by 169
  2. 2025Information Gain-based Policy Optimization: A Simple and Effective Approach for Multi-Turn Search Agentscited by 48
  3. 2025DeepShop: A Benchmark for Deep Research Shopping Agentscited by 46
  4. 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulatorscited by 42
  5. 2026The 2025 AI Agent Index: Documenting Technical and Safety Features of Deployed Agentic AI Systemscited by 30
  6. 2025Why Do LLM Agents Fail in Exploring New Environments? A World-Modeling Perspectivecited by 28
  7. 2026WebXSkill: Skill Learning for Autonomous Web Agentscited by 24
  8. 2026ExpSeek: Self-Triggered Experience Seeking for Web Agentscited by 23
  9. 2025SecureWebArena: A Holistic Security Evaluation Benchmark for LVLM-based Web Agentscited by 19
  10. 2025WebMall -- A Multi-Shop Benchmark for Evaluating Web Agentscited by 17
  11. 2025Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agentscited by 17
  12. 2025InfoFlow: Reinforcing Search Agent Via Reward Density Optimizationcited by 11
38 more
  1. 2026The Why Behind the Action: Unveiling Internal Drivers via Agentic Attributioncited by 11
  2. 2025WebOperator: Action-Aware Tree Search for Autonomous Agents in Web Environmentcited by 10
  3. 2025SynWorld: Virtual Scenario Synthesis for Agentic Action Knowledge Refinementcited by 9
  4. 2025Diffusion Generative Recommendation with Continuous Tokenscited by 9
  5. 2025Agentic Knowledgeable Self-awarenesscited by 8
  6. 2026MiniAppBench: Evaluating the Shift from Text to Interactive HTML Responses in LLM-Powered Assistantscited by 8
  7. 2025Retrieval-Augmented Purifier for Robust LLM-Empowered Recommendationcited by 7
  8. 2025InfantAgent-Next: A Multimodal Generalist Agent for Automated Computer Interactioncited by 7
  9. 2025A Functionality-Grounded Benchmark for Evaluating Web Agents in E-commerce Domainscited by 7
  10. 2025Exploring Backdoor Attack and Defense for LLM-empowered Recommendationscited by 6
  11. 2025LaMDAgent: An Autonomous Framework for Post-Training Pipeline Optimization via LLM Agentscited by 6
  12. 2025Autonomous Data Agents: A New Opportunity for Smart Datacited by 6
  13. 2026ColorBrowserAgent: Complex Long-Horizon Browser Agent with Adaptive Knowledge Evolutioncited by 6
  14. 2026Atomicity for Agents: Exposing, Exploiting, and Mitigating TOCTOU Vulnerabilities in Browser-Use Agentscited by 6
  15. 2025Mind the Web: The Security of Web Use Agentscited by 5
  16. 2026Optimizing Agentic Workflows using Meta-toolscited by 5
  17. 2026Empowering GUI Agents via Autonomous Experience Exploration and Hindsight Experience Utilization for Task Planningcited by 5
  18. 2026How do Visual Attributes Influence Web Agents? A Comprehensive Evaluation of User Interface Design Factorscited by 4
  19. 2026SnapGuard: Lightweight Prompt Injection Detection for Screenshot-Based Web Agentscited by 4
  20. 2026WARD: Adversarially Robust Defense of Web Agents Against Prompt Injectionscited by 4
  21. 2025Machine-Readable Ads: Accessibility and Trust Patterns for AI Web Agents interacting with Online Advertisementscited by 3
  22. 2025Interaction-Driven Browsing: A Human-in-the-Loop Conceptual Framework Informed by Human Web Browsing for Browser-Using Agentscited by 3
  23. 2025ALLOY: Generating Reusable Agent Workflows from User Demonstrationcited by 3
  24. 2026Enhancing Molecular Property Predictions by Learning from Bond Modelling and Interactionscited by 3
  25. 2026WebAgentGuard: A Reasoning-Driven Guard Model for Detecting Prompt Injection Attacks in Web Agentscited by 3
  26. 2026GUI Agents with Reinforcement Learning: Toward Digital Inhabitantscited by 3
  27. 2026CP-Agent: A Calibrated Risk-Controlled Agent for Feedback-Driven Competitive Programmingcited by 3
  28. 2026Online Skill Learning for Web Agents via State-Grounded Dynamic Retrievalcited by 3
  29. 2026HarnessBridge: Learnable Bidirectional Controller for LLM Agent Harnesscited by 3
  30. 2026Benchmarking Web Agent Safety under E-commerce Deceptive Interfacescited by 3
  31. 2025iTFKAN: Interpretable Time Series Forecasting with Kolmogorov-Arnold Networkcited by 2
  32. 2025Web-CogReasoner: Towards Multimodal Knowledge-Induced Cognitive Reasoning for Web Agentscited by 2
  33. 2025TGPO: Tree-Guided Preference Optimization for Robust Web Agent Reinforcement Learningcited by 2
  34. 2025RISK: A Framework for GUI Agents in E-commerce Risk Managementcited by 2
  35. 2025Affordance Representation and Recognition for Autonomous Agentscited by 2
  36. 2025An Index-based Approach for Efficient and Effective Web Content Extractioncited by 2
  37. 2026GuideWeb: A Benchmark for Automatic In-App Guide Generation on Real-World Web UIscited by 2
  38. 2026Plan-MCTS: Plan Exploration for Action Exploitation in Web Navigationcited by 2

50 most cited of 87 All 87 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023AutoAgents: A Framework for Automatic Agent Generation
  2. 2025An Illusion of Progress? Assessing the Current State of Web Agents
  3. 2025Build the web for agents, not agents for the web
  4. 2025Agentic Web: Weaving the Next Web with AI Agents
  5. 2025BrowserAgent: Building Web Agents with Human-Inspired Web Browsing Actions
  6. 2025Semantic Web and Software Agents -- A Forgotten Wave of Artificial Intelligence?
  7. 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?
  8. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks