FullFront: Benchmarking MLLMs Across the Full Front-End Engineering Workflow
Not on the map. Why?
Abstract (arXiv)
Front-end engineering involves a complex workflow where engineers conceptualize designs, translate them into code, and iteratively refine the implementation. While recent benchmarks primarily focus on converting visual designs to code, we present FullFront, a benchmark designed to evaluate Multimodal Large Language Models (MLLMs) across the full front-end development pipeline. FullFront assesses three fundamental tasks that map directly to the front-end engineering pipeline: Webpage Design (conceptualization phase), Webpage Perception QA (comprehension of visual organization and elements), and Webpage Code Generation (implementation phase). Unlike existing benchmarks that use either scraped websites with bloated code or oversimplified LLM-generated HTML, FullFront employs a novel, two-stage process to transform real-world webpages into clean, standardized HTML while maintaining diverse visual designs and avoiding copyright issues. Extensive testing of state-of-the-art MLLMs reveals significant limitations in page perception, code generation (particularly for image handling and layout), and interaction implementation. Our results quantitatively demonstrate performance disparities across models and tasks, and highlight a substantial gap between current MLLM capabilities and human expert performance in front-end engineering. The FullFront benchmark and code are available in https://github.com/Mikivishy/FullFront.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 30 of its 53 references that are in the map. First posted on arXiv 23 May 2025.
Builds on
30 of 53 references.
References · 30
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agentscited by 567
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 563
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 382
- 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 205
- 2024OmniParser for Pure Vision Based GUI Agentcited by 198
- 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
18 more
- 2024AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?cited by 158
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
- 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmarkcited by 134
- 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Taskscited by 131
- 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 129
- 2021Screen2Words: Automatic Mobile UI Summarization with Multimodal Learningcited by 120
- 2024Cradle: Empowering Foundation Agents Towards General Computer Controlcited by 117
- 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 114
- 2024GUICourse: From General Vision Language Models to Versatile GUI Agentscited by 114
- 2021WebQA: Multihop and Multimodal QAcited by 109
- 2021WebSRC: A Dataset for Web-Based Structural Reading Comprehensioncited by 100
- 2024VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?cited by 100
- 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 74
- 2024WebCode2M: A Real-World Dataset for Code Generation from Webpage Designscited by 44
- 2024MRWeb: An Exploration of Generating Multi-Page Resource-Aware Web Code from UI Designscited by 24
- 2024IW-Bench: Evaluating Large Multimodal Models for Converting Image-to-Webcited by 16
- 2024WebQuest: A Benchmark for Multimodal QA on Web Page Sequencescited by 12
- 2025WinClick: GUI Grounding with Multimodal Large Language Modelscited by 11
Built on by
Citing papers per year: 2025: 6; 2026: 22.
28 papers.
Sort:
By area:
- 2025ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluationcited by 42
- 2026WebCoderBench: Benchmarking Web Application Generation with Comprehensive and Interpretable Evaluation Metricscited by 18
- 2025WebGen-Agent: Enhancing Interactive Website Generation with Multi-Level Feedback and Step-Level Reinforcement Learningcited by 15
- 2025FronTalk: Benchmarking Front-End Development as Conversational Code Generation with Multi-Modal Feedbackcited by 14
- 2025WebVIA: A Web-based Vision-Language Agentic Framework for Interactive and Verifiable UI-to-Code Generationcited by 10
- 2026MiniAppBench: Evaluating the Shift from Text to Interactive HTML Responses in LLM-Powered Assistantscited by 8
- 2026WebVR: Benchmarking Multimodal LLMs for WebPage Recreation from Videos via Human-Aligned Visual Rubricscited by 8
- 2026WebCompass: Towards Multimodal Web Coding Evaluation for Code Language Modelscited by 6
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligencecited by 6
- 2026MM-WebAgent: A Hierarchical Multimodal Web Agent for Webpage Generationcited by 5
- 2025InteractScience: Programmatic and Visually-Grounded Evaluation of Interactive Scientific Demonstration Code Generationcited by 4
- 2025WebGen-V Bench: Structured Representation for Enhancing Visual Design in LLM-based Web Generation and Evaluationcited by 3
16 more
- 2026LH-Bench: Skill-Grounded Evaluation of Long-Horizon Agents on Subjective Enterprise Taskscited by 3
- 2026Cookie-Bench: Continuous On-screen Key Interaction Evaluation for Web Generationcited by 3
- 2026FullStack-Agent: Enhancing Agentic Full-Stack Web Coding via Development-Oriented Testing and Repository Back-Translationcited by 2
- 2026MM-OptBench: A Solver-Grounded Benchmark for Multimodal Optimization Modelingcited by 2
- 2026HTMLCure: Turning Browser Experience into State Guided Repair for Interactive HTMLcited by 2
- 20261D-Bench: A Benchmark for Iterative UI Code Generation with Visual Feedback in Real-Worldcited by 1
- 2026Benchmarking Multimodal LLMs on Code Generation for Complex Interactive Webpagescited by 1
- 2026LongWebBench: Evaluating Structural and Functional Webpage Generation in Long-Horizon Settingscited by 0
- 2026Pattern over Pixels: Measuring Pattern Completion Bias in Multimodal Code Generationcited by 0
- 2026WebWorld: The Browser as a World Model for Self-Improving Web Codecited by 0
- 2026Framework and Benchmark for Code-Driven Agentic Testing in Web Developmentcited by 0
- 2026Enabling Creative Exploration for Vibe Design Agentscited by 0
- 2026WebCraftBench: Evaluating Web Application Generation from a Software Testing Perspectivecited by 0
- 2026AUV-Bench: Aesthetic Understanding and Generation Evaluation for User Interfacescited by 0
- 2026TaoD2C-Bench: Benchmarking MLLMs for Industrial UI Code Generation Beyond Visual Fidelitycited by 0
- 2026PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesiscited by 0
- 2026PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesis14 Oct 2026
- 2026TaoD2C-Bench: Benchmarking MLLMs for Industrial UI Code Generation Beyond Visual Fidelity7 Oct 2026
- 2026AUV-Bench: Aesthetic Understanding and Generation Evaluation for User Interfaces28 Sep 2026
- 2026WebCraftBench: Evaluating Web Application Generation from a Software Testing Perspective14 Sep 2026
- 2026Enabling Creative Exploration for Vibe Design Agents14 Sep 2026
- 2026Framework and Benchmark for Code-Driven Agentic Testing in Web Development31 Aug 2026
- 2026WebWorld: The Browser as a World Model for Self-Improving Web Code31 Aug 2026
- 2026Pattern over Pixels: Measuring Pattern Completion Bias in Multimodal Code Generation4 Aug 2026
- 2026LongWebBench: Evaluating Structural and Functional Webpage Generation in Long-Horizon Settings16 Jun 2026
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligence14 Jun 2026
- 2026Benchmarking Multimodal LLMs on Code Generation for Complex Interactive Webpages29 May 2026
- 2026Cookie-Bench: Continuous On-screen Key Interaction Evaluation for Web Generation28 May 2026
16 more
- 2026HTMLCure: Turning Browser Experience into State Guided Repair for Interactive HTML26 May 2026
- 2026MM-OptBench: A Solver-Grounded Benchmark for Multimodal Optimization Modeling12 May 2026
- 2026WebCompass: Towards Multimodal Web Coding Evaluation for Code Language Models20 Apr 2026
- 2026MM-WebAgent: A Hierarchical Multimodal Web Agent for Webpage Generation16 Apr 2026
- 2026LH-Bench: Skill-Grounded Evaluation of Long-Horizon Agents on Subjective Enterprise Tasks24 Mar 2026
- 2026WebVR: Benchmarking Multimodal LLMs for WebPage Recreation from Videos via Human-Aligned Visual Rubrics11 Mar 2026
- 2026MiniAppBench: Evaluating the Shift from Text to Interactive HTML Responses in LLM-Powered Assistants10 Mar 2026
- 20261D-Bench: A Benchmark for Iterative UI Code Generation with Visual Feedback in Real-World20 Feb 2026
- 2026FullStack-Agent: Enhancing Agentic Full-Stack Web Coding via Development-Oriented Testing and Repository Back-Translation3 Feb 2026
- 2026WebCoderBench: Benchmarking Web Application Generation with Comprehensive and Interpretable Evaluation Metrics5 Jan 2026
- 2025FronTalk: Benchmarking Front-End Development as Conversational Code Generation with Multi-Modal Feedback5 Dec 2025
- 2025WebVIA: A Web-based Vision-Language Agentic Framework for Interactive and Verifiable UI-to-Code Generation9 Nov 2025
- 2025WebGen-V Bench: Structured Representation for Enhancing Visual Design in LLM-based Web Generation and Evaluation17 Oct 2025
- 2025InteractScience: Programmatic and Visually-Grounded Evaluation of Interactive Scientific Demonstration Code Generation10 Oct 2025
- 2025WebGen-Agent: Enhancing Interactive Website Generation with Multi-Level Feedback and Step-Level Reinforcement Learning26 Sep 2025
- 2025ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluation7 Jul 2025
- 2025WebVIA: A Web-based Vision-Language Agentic Framework for Interactive and Verifiable UI-to-Code Generationcited by 10
- 2026WebCompass: Towards Multimodal Web Coding Evaluation for Code Language Modelscited by 6
- 2026MM-WebAgent: A Hierarchical Multimodal Web Agent for Webpage Generationcited by 5
- 2026LH-Bench: Skill-Grounded Evaluation of Long-Horizon Agents on Subjective Enterprise Taskscited by 3
- 2026FullStack-Agent: Enhancing Agentic Full-Stack Web Coding via Development-Oriented Testing and Repository Back-Translationcited by 2
- 2026Framework and Benchmark for Code-Driven Agentic Testing in Web Developmentcited by 0
- 2026Enabling Creative Exploration for Vibe Design Agentscited by 0
- 2026Enabling Creative Exploration for Vibe Design Agents14 Sep 2026
- 2026Framework and Benchmark for Code-Driven Agentic Testing in Web Development31 Aug 2026
- 2026WebCompass: Towards Multimodal Web Coding Evaluation for Code Language Models20 Apr 2026
- 2026MM-WebAgent: A Hierarchical Multimodal Web Agent for Webpage Generation16 Apr 2026
- 2026LH-Bench: Skill-Grounded Evaluation of Long-Horizon Agents on Subjective Enterprise Tasks24 Mar 2026
- 2026FullStack-Agent: Enhancing Agentic Full-Stack Web Coding via Development-Oriented Testing and Repository Back-Translation3 Feb 2026
- 2025WebVIA: A Web-based Vision-Language Agentic Framework for Interactive and Verifiable UI-to-Code Generation9 Nov 2025
- 2026WebVR: Benchmarking Multimodal LLMs for WebPage Recreation from Videos via Human-Aligned Visual Rubricscited by 8
- 2026LongWebBench: Evaluating Structural and Functional Webpage Generation in Long-Horizon Settingscited by 0
- 2026Pattern over Pixels: Measuring Pattern Completion Bias in Multimodal Code Generationcited by 0
- 2026TaoD2C-Bench: Benchmarking MLLMs for Industrial UI Code Generation Beyond Visual Fidelitycited by 0
- 2026TaoD2C-Bench: Benchmarking MLLMs for Industrial UI Code Generation Beyond Visual Fidelity7 Oct 2026
- 2026Pattern over Pixels: Measuring Pattern Completion Bias in Multimodal Code Generation4 Aug 2026
- 2026LongWebBench: Evaluating Structural and Functional Webpage Generation in Long-Horizon Settings16 Jun 2026
- 2026WebVR: Benchmarking Multimodal LLMs for WebPage Recreation from Videos via Human-Aligned Visual Rubrics11 Mar 2026
- 2025ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluationcited by 42
- 2026WebCoderBench: Benchmarking Web Application Generation with Comprehensive and Interpretable Evaluation Metricscited by 18
- 2025FronTalk: Benchmarking Front-End Development as Conversational Code Generation with Multi-Modal Feedbackcited by 14
- 2026MiniAppBench: Evaluating the Shift from Text to Interactive HTML Responses in LLM-Powered Assistantscited by 8
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligencecited by 6
- 2025InteractScience: Programmatic and Visually-Grounded Evaluation of Interactive Scientific Demonstration Code Generationcited by 4
- 2025WebGen-V Bench: Structured Representation for Enhancing Visual Design in LLM-based Web Generation and Evaluationcited by 3
- 2026Cookie-Bench: Continuous On-screen Key Interaction Evaluation for Web Generationcited by 3
- 2026MM-OptBench: A Solver-Grounded Benchmark for Multimodal Optimization Modelingcited by 2
- 2026HTMLCure: Turning Browser Experience into State Guided Repair for Interactive HTMLcited by 2
- 20261D-Bench: A Benchmark for Iterative UI Code Generation with Visual Feedback in Real-Worldcited by 1
- 2026WebCraftBench: Evaluating Web Application Generation from a Software Testing Perspectivecited by 0
12 most cited of 14 All 14 (JSON)
- 2026PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesis14 Oct 2026
- 2026AUV-Bench: Aesthetic Understanding and Generation Evaluation for User Interfaces28 Sep 2026
- 2026WebCraftBench: Evaluating Web Application Generation from a Software Testing Perspective14 Sep 2026
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligence14 Jun 2026
- 2026Cookie-Bench: Continuous On-screen Key Interaction Evaluation for Web Generation28 May 2026
- 2026HTMLCure: Turning Browser Experience into State Guided Repair for Interactive HTML26 May 2026
- 2026MM-OptBench: A Solver-Grounded Benchmark for Multimodal Optimization Modeling12 May 2026
- 2026MiniAppBench: Evaluating the Shift from Text to Interactive HTML Responses in LLM-Powered Assistants10 Mar 2026
- 20261D-Bench: A Benchmark for Iterative UI Code Generation with Visual Feedback in Real-World20 Feb 2026
- 2026WebCoderBench: Benchmarking Web Application Generation with Comprehensive and Interpretable Evaluation Metrics5 Jan 2026
- 2025FronTalk: Benchmarking Front-End Development as Conversational Code Generation with Multi-Modal Feedback5 Dec 2025
- 2025WebGen-V Bench: Structured Representation for Enhancing Visual Design in LLM-based Web Generation and Evaluation17 Oct 2025
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generation
- 2024Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototyping
- 2025Advancing vision-language models in front-end development via data synthesis
- 2025LaTCoder: Converting Webpage Design to Code with Layout-as-Thought
- 2025WebUIBench: A Comprehensive Benchmark for Evaluating Multimodal Large Language Models in WebUI-to-Code
- 2026Rendering-in-the-Loop: An Execution-Driven Agent for Interactive Web Development
- 2025IWR-Bench: Can LVLMs reconstruct interactive webpage from a user interaction video?
- 2026MV-Bench: Benchmarking Multimodal Large Language Models for Coordinated Multi-View Interface Construction