WebRenderBench: Enhancing Web Interface Generation through Layout-Style Consistency and Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Automating the conversion of UI images into web code is a critical task for front-end development and rapid prototyping. Advances in multimodal large language models (MLLMs) have made WebUI-to-Code increasingly feasible, yet existing benchmarks remain limited in data diversity and evaluation reliability. To address these issues, we present WebRenderBench, a large-scale benchmark of 45.1k webpages collected from real-world portal sites, offering greater diversity, complexity, and realism than prior benchmarks. We further propose a novel evaluation metric that measures layout and style consistency from the final rendered pages. Unlike vision-based methods that rely on costly LLM reasoning or structure-based comparisons vulnerable to noise and asymmetry, our approach enables more efficient, objective, and reliable UI quality assessment. Finally, we introduce the Automated Layout and Style Inspection Agent (ALISA), which integrates this metric into reinforcement learning as a reward signal to enhance training on crawled asymmetric webpages. Experiments show that ALISA significantly boosts generation performance, achieving state-of-the-art results across multiple metrics.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 19 of its 38 references that are in the map. First posted on arXiv 5 Oct 2025.
Builds on
19 of 38 references.
References · 19
- 2023GPT-4 Technical Reportcited by 18,132
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 468
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 439
- 2025Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domainscited by 150
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 146
- 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 126
- 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 113
7 more
- 2023RLTF: Reinforcement Learning from Unit Test Feedbackcited by 110
- 2024Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototypingcited by 50
- 2018Machine Learning-Based Prototyping of Graphical User Interfaces for Mobile Appscited by 36
- 2024Sketch2Code: Evaluating Vision-Language Models for Interactive Web Design Prototypingcited by 29
- 2025Process-Supervised Reinforcement Learning for Code Generationcited by 21
- 2023Can Pre-Trained Text-to-Image Models Generate Visual Goals for Reinforcement Learning?cited by 20
- 2025WebUIBench: A Comprehensive Benchmark for Evaluating Multimodal Large Language Models in WebUI-to-Codecited by 14
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025WebVIA: A Web-based Vision-Language Agentic Framework for Interactive and Verifiable UI-to-Code Generation
- 2026WebGen-R1: Incentivizing Large Language Models to Generate Functional and Aesthetic Websites with Reinforcement Learning
- 2025WebGen-V Bench: Structured Representation for Enhancing Visual Design in LLM-based Web Generation and Evaluation
- 2024Automatically Generating UI Code from Screenshot: A Divide-and-Conquer-Based Approach
- 2026WebUIProof: Benchmarking WebUI Code Generators with UI-Agent Execution Harness
- 2026Benchmarking Multimodal LLMs on Code Generation for Complex Interactive Webpages
- 2026Rendering-in-the-Loop: An Execution-Driven Agent for Interactive Web Development
- 2024WebCode2M: A Real-World Dataset for Code Generation from Webpage Designs