mlsanityData to 7 Oct 2026

EmbeWebAgent: Embedding Web Agents into Any Customized UI

arXiv 2602.14865 ↗First posted 16 Feb 2026cs.AI cs.SEcited by 0

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Most web agents operate at the human interface level, observing screenshots or raw DOM trees without application-level access, which limits robustness and action expressiveness. In enterprise settings, however, explicit control of both the frontend and backend is available. We present EmbeWebAgent, a framework for embedding agents directly into existing UIs using lightweight frontend hooks (curated ARIA and URL-based observations, and a per-page function registry exposed via a WebSocket) and a reusable backend workflow that performs reasoning and takes actions. EmbeWebAgent is stack-agnostic (e.g., React or Angular), supports mixed-granularity actions ranging from GUI primitives to higher-level composites, and orchestrates navigation, manipulation, and domain-specific analytics via MCP tools. Our demo shows minimal retrofitting effort and robust multi-step behaviors grounded in a live UI setting. Live Demo: https://youtu.be/Cy06Ljee1JQ

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 16 of its 24 references that are in the map. First posted on arXiv 16 Feb 2026.

Builds on

16 of 24 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Models30 Mar
  2. 2024Beyond Browsing: API-Based Web Agents21 Oct
  3. 2024Agent-E: From Autonomous Web Navigation to Foundational Design Principles in Agentic Systems17 Jul
  4. 2024WILBUR: Adaptive In-Context Learning for Robust and Accurate Web Agents8 Apr
  5. 2024GPT-4V(ision) is a Generalist Web Agent, if Grounded3 Jan
  6. 2023Mind2Web: Towards a Generalist Agent for the Web9 Jun

Other references · 10

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  5. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  6. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 373
  7. 2024SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priorscited by 53
  8. 2025API Agents vs. GUI Agents: Divergence and Convergencecited by 28
  9. 2025COOPERA: Continual Open-Ended Human-Robot Assistancecited by 7
  10. 2024The infrastructure powering IBM's Gen AI model developmentcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026WebPageBench: Event-Level Verification and Controlled UI-Variant Generation for Web Agents
  2. 2026MolmoWeb: Open Visual Web Agent and Open Data for the Open Web
  3. 2026CAP: A Scalable Benchmark for Evaluating Cross-Site Browser Agents with Complex Actions and Perception
  4. 2026Internal APIs Are All You Need: Shadow APIs, Shared Discovery, and the Case Against Browser-First Agent Architectures
  5. 2025WebVIA: A Web-based Vision-Language Agentic Framework for Interactive and Verifiable UI-to-Code Generation
  6. 2026BrowserForge: Scaling Web Episode via Parallel Browser Sandboxes
  7. 2025WALT: Web Agents that Learn Tools
  8. 2026Beyond Chat and Clicks: GUI Agents for In-Situ Assistance via Live Interface Transformation