Embodied Web Agents: Bridging Physical-Digital Realms for Integrated Agent Intelligence
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
AI agents today are mostly siloed - they either retrieve and reason over vast amount of digital information and knowledge obtained online; or interact with the physical world through embodied perception, planning and action - but rarely both. This separation limits their ability to solve tasks that require integrated physical and digital intelligence, such as cooking from online recipes, navigating with dynamic map data, or interpreting real-world landmarks using web knowledge. We introduce Embodied Web Agents, a novel paradigm for AI agents that fluidly bridge embodiment and web-scale reasoning. To operationalize this concept, we first develop the Embodied Web Agents task environments, a unified simulation platform that tightly integrates realistic 3D indoor and outdoor environments with functional web interfaces. Building upon this platform, we construct and release the Embodied Web Agents Benchmark, which encompasses a diverse suite of tasks including cooking, navigation, shopping, tourism, and geolocation - all requiring coordinated reasoning across physical and digital realms for systematic assessment of cross-domain intelligence. Experimental results reveal significant performance gaps between state-of-the-art AI systems and human capabilities, establishing both challenges and opportunities at the intersection of embodied cognition and web-scale knowledge access. All datasets, codes and websites are publicly available at our project page https://embodied-web-agent.github.io/.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 21 of its 31 references that are in the map. First posted on arXiv 18 Jun 2025.
Builds on
21 of 31 references.
Closest ancestors · 1
Same direction, newest first
Other references · 20
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
- 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 363
- 2018Reinforcement Learning on Web Interfaces Using Workflow-Guided Explorationcited by 284
- 2018Touchdown: Natural Language Navigation and Spatial Reasoning in Visual Street Environmentscited by 239
- 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 232
- 2021iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Taskscited by 194
8 more
- 2024WebLINX: Real-World Website Navigation with Multi-Turn Dialoguecited by 180
- 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 165
- 2020iGibson 1.0: a Simulation Environment for Interactive Tasks in Large Realistic Scenescited by 155
- 2023Open-domain Visual Entity Recognition: Towards Recognizing Millions of Wikipedia Entitiescited by 113
- 2018Learning to Navigate in Cities Without a Mapcited by 104
- 2025Can Large Vision Language Models Read Maps Like a Human?cited by 30
- 2025AI Sees Your Location, But With A Bias Toward The Wealthy Worldcited by 14
- 2019RUN through the Streets: A New Dataset and Baseline Models for Realistic Urban Navigationcited by 11
Built on by
Citing papers per year: 2025: 5; 2026: 10.
15 papers.
Sort:
By area:
- 2025Where LLM Agents Fail and How They can Learn From Failurescited by 133
- 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agentscited by 44
- 2025GeoVista: Web-Augmented Agentic Visual Reasoning for Geolocalizationcited by 11
- 2025NaviMaster: Learning a Unified Policy for GUI and Embodied Navigation Taskscited by 10
- 2026RoboAgent: Chaining Basic Capabilities for Embodied Task Planningcited by 7
- 2025DeliveryBench: Can Agents Earn Profit in Real World?cited by 6
- 2026OpenWebRL: Demystifying Online Multi-turn Reinforcement Learning for Visual Web Agentscited by 6
- 2026Aligning Agentic World Models via Knowledgeable Experience Learningcited by 5
- 2026MapTab: A Diagnostic Benchmark for Long-Horizon Multi-Criteria Multimodal Reasoning on Heterogeneous Topological Graphscited by 3
- 2026Synergy: A Next-Generation General-Purpose Agent for Open Agentic Webcited by 2
- 2025OceanGym: A Benchmark Environment for Underwater Embodied Agentscited by 1
- 2026Long-Horizon Embodied Decision-Making via Multimodal Memory Compressioncited by 1
- 2026360CityArena: A Realistic Virtual Urban Navigation Benchmark for Embodied Agents9 Aug 2026
- 2026EvoHarness-RL: Learning Self-Evolving Runtime Harness for Long-Horizon LLM Agents5 Aug 2026
- 2026Long-Horizon Embodied Decision-Making via Multimodal Memory Compression2 Aug 2026
- 2026ABot-AgentOS: A General Robotic Agent OS with Lifelong Multi-modal Memory11 Jul 2026
- 2026OpenWebRL: Demystifying Online Multi-turn Reinforcement Learning for Visual Web Agents1 Jun 2026
- 2026RoboAgent: Chaining Basic Capabilities for Embodied Task Planning9 Apr 2026
- 2026Synergy: A Next-Generation General-Purpose Agent for Open Agentic Web30 Mar 2026
- 2026MapTab: A Diagnostic Benchmark for Long-Horizon Multi-Criteria Multimodal Reasoning on Heterogeneous Topological Graphs20 Feb 2026
- 2026Aligning Agentic World Models via Knowledgeable Experience Learning19 Jan 2026
- 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents14 Jan 2026
- 2025DeliveryBench: Can Agents Earn Profit in Real World?22 Dec 2025
- 2025GeoVista: Web-Augmented Agentic Visual Reasoning for Geolocalization19 Nov 2025
3 more
- 2025Where LLM Agents Fail and How They can Learn From Failurescited by 133
- 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agentscited by 44
- 2025DeliveryBench: Can Agents Earn Profit in Real World?cited by 6
- 2026OpenWebRL: Demystifying Online Multi-turn Reinforcement Learning for Visual Web Agentscited by 6
- 2026Synergy: A Next-Generation General-Purpose Agent for Open Agentic Webcited by 2
- 2025OceanGym: A Benchmark Environment for Underwater Embodied Agentscited by 1
- 2026EvoHarness-RL: Learning Self-Evolving Runtime Harness for Long-Horizon LLM Agentscited by 1
- 2026ABot-AgentOS: A General Robotic Agent OS with Lifelong Multi-modal Memorycited by 0
- 2026EvoHarness-RL: Learning Self-Evolving Runtime Harness for Long-Horizon LLM Agents5 Aug 2026
- 2026ABot-AgentOS: A General Robotic Agent OS with Lifelong Multi-modal Memory11 Jul 2026
- 2026OpenWebRL: Demystifying Online Multi-turn Reinforcement Learning for Visual Web Agents1 Jun 2026
- 2026Synergy: A Next-Generation General-Purpose Agent for Open Agentic Web30 Mar 2026
- 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents14 Jan 2026
- 2025DeliveryBench: Can Agents Earn Profit in Real World?22 Dec 2025
- 2025OceanGym: A Benchmark Environment for Underwater Embodied Agents30 Sep 2025
- 2025Where LLM Agents Fail and How They can Learn From Failures29 Sep 2025
- 2025NaviMaster: Learning a Unified Policy for GUI and Embodied Navigation Taskscited by 10
- 2026RoboAgent: Chaining Basic Capabilities for Embodied Task Planningcited by 7
- 2026Long-Horizon Embodied Decision-Making via Multimodal Memory Compressioncited by 1
- 2026360CityArena: A Realistic Virtual Urban Navigation Benchmark for Embodied Agentscited by 1
- 2026360CityArena: A Realistic Virtual Urban Navigation Benchmark for Embodied Agents9 Aug 2026
- 2026Long-Horizon Embodied Decision-Making via Multimodal Memory Compression2 Aug 2026
- 2026RoboAgent: Chaining Basic Capabilities for Embodied Task Planning9 Apr 2026
- 2025NaviMaster: Learning a Unified Policy for GUI and Embodied Navigation Tasks4 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025Embodied AI Agents: Modeling the World
- 2024MMInA: Benchmarking Multihop Multimodal Internet Agents
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI
- 2026Embodied-BenchClaw: An Autonomous Multi-Agent System for Embodied Spatial Intelligence Benchmark Construction
- 2024EmbodiedCity: A Benchmark Platform for Embodied Agent in Real-world City Environment
- 2026ParallelWorld: Test-Time Scaling for Embodied Reasoning
- 2026Towards general embodied intelligence: integrating large language models, knowledge bases, and reasoning capabilities to build the next generation of AI agents
- 2026ETA: A New Agentic Paradigm for Embodied Tasks