mlsanityData to 14 Oct 2026

MM-WebAgent: A Hierarchical Multimodal Web Agent for Webpage Generation

arXiv 2604.15309 ↗First posted 16 Apr 2026cs.CV cs.AI cs.CLcited by 5

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

The rapid progress of Artificial Intelligence Generated Content (AIGC) tools enables images, videos, and visualizations to be created on demand for webpage design, offering a flexible and increasingly adopted paradigm for modern UI/UX. However, directly integrating such tools into automated webpage generation often leads to style inconsistency and poor global coherence, as elements are generated in isolation. We propose MM-WebAgent, a hierarchical agentic framework for multimodal webpage generation that coordinates AIGC-based element generation through hierarchical planning and iterative self-reflection. MM-WebAgent jointly optimizes global layout, local multimodal content, and their integration, producing coherent and visually consistent webpages. We further introduce a benchmark for multimodal webpage generation and a multi-level evaluation protocol for systematic assessment. Experiments demonstrate that MM-WebAgent outperforms code-generation and agent-based baselines, especially on multimodal element generation and integration. Code & Data: https://aka.ms/mm-webagent.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 15 of its 32 references that are in the map. First posted on arXiv 16 Apr 2026.

Builds on

15 of 32 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025WebGen-Agent: Enhancing Interactive Website Generation with Multi-Level Feedback and Step-Level Reinforcement Learning26 Sep

Other references · 14

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  3. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  4. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
  5. 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 282
  6. 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 129
  7. 2025WebGen-Bench: Evaluating LLMs on Generating Interactive and Functional Websites from Scratchcited by 72
  8. 2024Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototypingcited by 51
  9. 2025FullFront: Benchmarking MLLMs Across the Full Front-End Engineering Workflowcited by 28
  10. 2025ScreenCoder: Advancing Visual-to-Code Generation for Front-End Automation via Modular Multimodal Agentscited by 26
  11. 2025ReCode: Unify Plan and Action for Universal Granularity Controlcited by 15
  12. 2025Seeing is Fixing: Cross-Modal Reasoning with Multimodal LLMs for Visual Software Issue Fixingcited by 12
2 more
  1. 2025DesignCoder: Hierarchy-Aware and Self-Correcting UI Code Generation with Large Language Modelscited by 11
  2. 2025WebGen-V Bench: Structured Representation for Enhancing Visual Design in LLM-based Web Generation and Evaluationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024MMInA: Benchmarking Multihop Multimodal Internet Agents
  2. 2025Build the web for agents, not agents for the web
  3. 2025APD-Agents: A Large Language Model-Driven Multi-Agents Collaborative Framework for Automated Page Design
  4. 2024VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks
  5. 2024AdaptAgent: Adapting Multimodal Web Agents with Few-Shot Learning from Human Demonstrations
  6. 2026MAG: A Web-Agent Benchmark and Harness for Multimodal Action and Guide Generation
  7. 2026InteractWeb-Bench: Can Multimodal Agent Escape Blind Execution in Interactive Website Generation?
  8. 2026Vision2Web: A Hierarchical Benchmark for Visual Website Development with Agent Verification