mlsanityData to 14 Oct 2026

Embodied Web Agents: Bridging Physical-Digital Realms for Integrated Agent Intelligence

arXiv 2506.15677 ↗First posted 18 Jun 2025cs.AI cs.CL cs.CVcited by 15

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

AI agents today are mostly siloed - they either retrieve and reason over vast amount of digital information and knowledge obtained online; or interact with the physical world through embodied perception, planning and action - but rarely both. This separation limits their ability to solve tasks that require integrated physical and digital intelligence, such as cooking from online recipes, navigating with dynamic map data, or interpreting real-world landmarks using web knowledge. We introduce Embodied Web Agents, a novel paradigm for AI agents that fluidly bridge embodiment and web-scale reasoning. To operationalize this concept, we first develop the Embodied Web Agents task environments, a unified simulation platform that tightly integrates realistic 3D indoor and outdoor environments with functional web interfaces. Building upon this platform, we construct and release the Embodied Web Agents Benchmark, which encompasses a diverse suite of tasks including cooking, navigation, shopping, tourism, and geolocation - all requiring coordinated reasoning across physical and digital realms for systematic assessment of cross-domain intelligence. Experimental results reveal significant performance gaps between state-of-the-art AI systems and human capabilities, establishing both challenges and opportunities at the intersection of embodied cognition and web-scale knowledge access. All datasets, codes and websites are publicly available at our project page https://embodied-web-agent.github.io/.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 21 of its 31 references that are in the map. First posted on arXiv 18 Jun 2025.

Builds on

21 of 31 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Making9 Oct

Other references · 20

  1. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  2. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  3. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
  4. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  5. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
  6. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
  7. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
  8. 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 363
  9. 2018Reinforcement Learning on Web Interfaces Using Workflow-Guided Explorationcited by 284
  10. 2018Touchdown: Natural Language Navigation and Spatial Reasoning in Visual Street Environmentscited by 239
  11. 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 232
  12. 2021iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Taskscited by 194
8 more
  1. 2024WebLINX: Real-World Website Navigation with Multi-Turn Dialoguecited by 180
  2. 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 165
  3. 2020iGibson 1.0: a Simulation Environment for Interactive Tasks in Large Realistic Scenescited by 155
  4. 2023Open-domain Visual Entity Recognition: Towards Recognizing Millions of Wikipedia Entitiescited by 113
  5. 2018Learning to Navigate in Cities Without a Mapcited by 104
  6. 2025Can Large Vision Language Models Read Maps Like a Human?cited by 30
  7. 2025AI Sees Your Location, But With A Bias Toward The Wealthy Worldcited by 14
  8. 2019RUN through the Streets: A New Dataset and Baseline Models for Realistic Urban Navigationcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 10.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025Embodied AI Agents: Modeling the World
  2. 2024MMInA: Benchmarking Multihop Multimodal Internet Agents
  3. 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI
  4. 2026Embodied-BenchClaw: An Autonomous Multi-Agent System for Embodied Spatial Intelligence Benchmark Construction
  5. 2024EmbodiedCity: A Benchmark Platform for Embodied Agent in Real-world City Environment
  6. 2026ParallelWorld: Test-Time Scaling for Embodied Reasoning
  7. 2026Towards general embodied intelligence: integrating large language models, knowledge bases, and reasoning capabilities to build the next generation of AI agents
  8. 2026ETA: A New Agentic Paradigm for Embodied Tasks