mlsanityData to 14 Oct 2026

FullFront: Benchmarking MLLMs Across the Full Front-End Engineering Workflow

arXiv 2505.17399 ↗First posted 23 May 2025cs.CLcited by 28

Not on the map. Why?

Abstract (arXiv)

Front-end engineering involves a complex workflow where engineers conceptualize designs, translate them into code, and iteratively refine the implementation. While recent benchmarks primarily focus on converting visual designs to code, we present FullFront, a benchmark designed to evaluate Multimodal Large Language Models (MLLMs) across the full front-end development pipeline. FullFront assesses three fundamental tasks that map directly to the front-end engineering pipeline: Webpage Design (conceptualization phase), Webpage Perception QA (comprehension of visual organization and elements), and Webpage Code Generation (implementation phase). Unlike existing benchmarks that use either scraped websites with bloated code or oversimplified LLM-generated HTML, FullFront employs a novel, two-stage process to transform real-world webpages into clean, standardized HTML while maintaining diverse visual designs and avoiding copyright issues. Extensive testing of state-of-the-art MLLMs reveals significant limitations in page perception, code generation (particularly for image handling and layout), and interaction implementation. Our results quantitatively demonstrate performance disparities across models and tasks, and highlight a substantial gap between current MLLM capabilities and human expert performance in front-end engineering. The FullFront benchmark and code are available in https://github.com/Mikivishy/FullFront.

Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 30 of its 53 references that are in the map. First posted on arXiv 23 May 2025.

Builds on

30 of 53 references.

References · 30

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  4. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  5. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  6. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
  7. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agentscited by 567
  8. 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 563
  9. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 382
  10. 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 205
  11. 2024OmniParser for Pure Vision Based GUI Agentcited by 198
  12. 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
18 more
  1. 2024AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?cited by 158
  2. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
  3. 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmarkcited by 134
  4. 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Taskscited by 131
  5. 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 129
  6. 2021Screen2Words: Automatic Mobile UI Summarization with Multimodal Learningcited by 120
  7. 2024Cradle: Empowering Foundation Agents Towards General Computer Controlcited by 117
  8. 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 114
  9. 2024GUICourse: From General Vision Language Models to Versatile GUI Agentscited by 114
  10. 2021WebQA: Multihop and Multimodal QAcited by 109
  11. 2021WebSRC: A Dataset for Web-Based Structural Reading Comprehensioncited by 100
  12. 2024VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?cited by 100
  13. 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 74
  14. 2024WebCode2M: A Real-World Dataset for Code Generation from Webpage Designscited by 44
  15. 2024MRWeb: An Exploration of Generating Multi-Page Resource-Aware Web Code from UI Designscited by 24
  16. 2024IW-Bench: Evaluating Large Multimodal Models for Converting Image-to-Webcited by 16
  17. 2024WebQuest: A Benchmark for Multimodal QA on Web Page Sequencescited by 12
  18. 2025WinClick: GUI Grounding with Multimodal Large Language Modelscited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 22.

28 papers.

Sort:

By area:

  1. 2025ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluationcited by 42
  2. 2026WebCoderBench: Benchmarking Web Application Generation with Comprehensive and Interpretable Evaluation Metricscited by 18
  3. 2025WebGen-Agent: Enhancing Interactive Website Generation with Multi-Level Feedback and Step-Level Reinforcement Learningcited by 15
  4. 2025FronTalk: Benchmarking Front-End Development as Conversational Code Generation with Multi-Modal Feedbackcited by 14
  5. 2025WebVIA: A Web-based Vision-Language Agentic Framework for Interactive and Verifiable UI-to-Code Generationcited by 10
  6. 2026MiniAppBench: Evaluating the Shift from Text to Interactive HTML Responses in LLM-Powered Assistantscited by 8
  7. 2026WebVR: Benchmarking Multimodal LLMs for WebPage Recreation from Videos via Human-Aligned Visual Rubricscited by 8
  8. 2026WebCompass: Towards Multimodal Web Coding Evaluation for Code Language Modelscited by 6
  9. 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligencecited by 6
  10. 2026MM-WebAgent: A Hierarchical Multimodal Web Agent for Webpage Generationcited by 5
  11. 2025InteractScience: Programmatic and Visually-Grounded Evaluation of Interactive Scientific Demonstration Code Generationcited by 4
  12. 2025WebGen-V Bench: Structured Representation for Enhancing Visual Design in LLM-based Web Generation and Evaluationcited by 3
16 more
  1. 2026LH-Bench: Skill-Grounded Evaluation of Long-Horizon Agents on Subjective Enterprise Taskscited by 3
  2. 2026Cookie-Bench: Continuous On-screen Key Interaction Evaluation for Web Generationcited by 3
  3. 2026FullStack-Agent: Enhancing Agentic Full-Stack Web Coding via Development-Oriented Testing and Repository Back-Translationcited by 2
  4. 2026MM-OptBench: A Solver-Grounded Benchmark for Multimodal Optimization Modelingcited by 2
  5. 2026HTMLCure: Turning Browser Experience into State Guided Repair for Interactive HTMLcited by 2
  6. 20261D-Bench: A Benchmark for Iterative UI Code Generation with Visual Feedback in Real-Worldcited by 1
  7. 2026Benchmarking Multimodal LLMs on Code Generation for Complex Interactive Webpagescited by 1
  8. 2026LongWebBench: Evaluating Structural and Functional Webpage Generation in Long-Horizon Settingscited by 0
  9. 2026Pattern over Pixels: Measuring Pattern Completion Bias in Multimodal Code Generationcited by 0
  10. 2026WebWorld: The Browser as a World Model for Self-Improving Web Codecited by 0
  11. 2026Framework and Benchmark for Code-Driven Agentic Testing in Web Developmentcited by 0
  12. 2026Enabling Creative Exploration for Vibe Design Agentscited by 0
  13. 2026WebCraftBench: Evaluating Web Application Generation from a Software Testing Perspectivecited by 0
  14. 2026AUV-Bench: Aesthetic Understanding and Generation Evaluation for User Interfacescited by 0
  15. 2026TaoD2C-Bench: Benchmarking MLLMs for Industrial UI Code Generation Beyond Visual Fidelitycited by 0
  16. 2026PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesiscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generation
  2. 2024Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototyping
  3. 2025Advancing vision-language models in front-end development via data synthesis
  4. 2025LaTCoder: Converting Webpage Design to Code with Layout-as-Thought
  5. 2025WebUIBench: A Comprehensive Benchmark for Evaluating Multimodal Large Language Models in WebUI-to-Code
  6. 2026Rendering-in-the-Loop: An Execution-Driven Agent for Interactive Web Development
  7. 2025IWR-Bench: Can LVLMs reconstruct interactive webpage from a user interaction video?
  8. 2026MV-Bench: Benchmarking Multimodal Large Language Models for Coordinated Multi-View Interface Construction