MM-WebAgent: A Hierarchical Multimodal Web Agent for Webpage Generation
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
The rapid progress of Artificial Intelligence Generated Content (AIGC) tools enables images, videos, and visualizations to be created on demand for webpage design, offering a flexible and increasingly adopted paradigm for modern UI/UX. However, directly integrating such tools into automated webpage generation often leads to style inconsistency and poor global coherence, as elements are generated in isolation. We propose MM-WebAgent, a hierarchical agentic framework for multimodal webpage generation that coordinates AIGC-based element generation through hierarchical planning and iterative self-reflection. MM-WebAgent jointly optimizes global layout, local multimodal content, and their integration, producing coherent and visually consistent webpages. We further introduce a benchmark for multimodal webpage generation and a multi-level evaluation protocol for systematic assessment. Experiments demonstrate that MM-WebAgent outperforms code-generation and agent-based baselines, especially on multimodal element generation and integration. Code & Data: https://aka.ms/mm-webagent.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 15 of its 32 references that are in the map. First posted on arXiv 16 Apr 2026.
Builds on
15 of 32 references.
Closest ancestors · 1
Same direction, newest first
Other references · 14
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
- 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 282
- 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 129
- 2025WebGen-Bench: Evaluating LLMs on Generating Interactive and Functional Websites from Scratchcited by 72
- 2024Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototypingcited by 51
- 2025FullFront: Benchmarking MLLMs Across the Full Front-End Engineering Workflowcited by 28
- 2025ScreenCoder: Advancing Visual-to-Code Generation for Front-End Automation via Modular Multimodal Agentscited by 26
- 2025ReCode: Unify Plan and Action for Universal Granularity Controlcited by 15
- 2025Seeing is Fixing: Cross-Modal Reasoning with Multimodal LLMs for Visual Software Issue Fixingcited by 12
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026VideoVIBE: A Video-Grounded Diagnostic Benchmark for One-Shot Interactive Website Generationcited by 1
- 2026LandingAgent: A Reference-Annotated Dataset and Agentic Generation Framework for Landing Pagescited by 0
- 2026V-ICAL Bench: Evaluating Video In-Context Learning for Multimodal Agents in Interactive Environmentscited by 0
- 2026TeleGen: Improving LLM-Based Web Application Generation via Runtime Telemetrycited by 0
- 2026GAMEGO: Training Game-Dev Agents with Synthetic Trajectories Anchored in Real-World Assetscited by 0
- 2026TeleGen: Improving LLM-Based Web Application Generation via Runtime Telemetry4 Oct 2026
- 2026GAMEGO: Training Game-Dev Agents with Synthetic Trajectories Anchored in Real-World Assets2 Oct 2026
- 2026V-ICAL Bench: Evaluating Video In-Context Learning for Multimodal Agents in Interactive Environments14 Sep 2026
- 2026LandingAgent: A Reference-Annotated Dataset and Agentic Generation Framework for Landing Pages28 Aug 2026
- 2026VideoVIBE: A Video-Grounded Diagnostic Benchmark for One-Shot Interactive Website Generation10 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2024MMInA: Benchmarking Multihop Multimodal Internet Agents
- 2025Build the web for agents, not agents for the web
- 2025APD-Agents: A Large Language Model-Driven Multi-Agents Collaborative Framework for Automated Page Design
- 2024VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks
- 2024AdaptAgent: Adapting Multimodal Web Agents with Few-Shot Learning from Human Demonstrations
- 2026MAG: A Web-Agent Benchmark and Harness for Multimodal Action and Guide Generation
- 2026InteractWeb-Bench: Can Multimodal Agent Escape Blind Execution in Interactive Website Generation?
- 2026Vision2Web: A Hierarchical Benchmark for Visual Website Development with Agent Verification