1D-Bench: A Benchmark for Iterative UI Code Generation with Visual Feedback in Real-World
Not on the map. Why?
Abstract (arXiv)
Design-to-code translates high-fidelity UI designs into executable front-end implementations, but progress remains hard to compare due to inconsistent datasets, toolchains, and evaluation protocols. We introduce 1D-Bench, a benchmark grounded in real e-commerce workflows, where each instance provides a reference rendering and an exported intermediate representation that may contain extraction errors. 1D is short for one day, representing the efficient completion of design-to-code tasks in less than one day. Models take both as input, using the intermediate representation as structural cues while being evaluated against the reference rendering, which tests robustness to intermediate representation defects rather than literal adherence. 1D-Bench requires generating an executable React codebase under a fixed toolchain with an explicit component hierarchy, and defines a multi-round setting in which models iteratively apply component-level edits using execution feedback. Experiments on commercial and open-weight multimodal models show that iterative editing generally improves final performance by increasing rendering success and often improving visual similarity. We further conduct a pilot study on post-training with synthetic repair trajectories and reinforcement learning based editing, and observe limited and unstable gains that may stem from sparse terminal rewards and high-variance file-level updates. The data and scripts used in this study are available in an anonymized repository at https://anonymous.4open.science/r/d2c-benchmark-A9C4/.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 31 of its 45 references that are in the map. First posted on arXiv 20 Feb 2026.
Builds on
31 of 45 references.
References · 31
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,091
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 450
- 2024ToolACE: Winning the Points of LLM Function Callingcited by 208
- 2024OmniParser for Pure Vision Based GUI Agentcited by 194
- 2024Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMscited by 173
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 147
- 2025ReSum: Unlocking Long-Horizon Search Intelligence via Context Summarizationcited by 137
- 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 113
- 2025Reinforcement Learning Optimization for Large-Scale Learning: An Efficient and User-Friendly Scaling Librarycited by 97
- 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 73
- 2022Spotlight: Mobile UI Understanding using Vision-Language Models with a Focuscited by 62
- 2024WebCode2M: A Real-World Dataset for Code Generation from Webpage Designscited by 43
19 more
- 2025Understanding Code Agent Behaviour: An Empirical Study of Success and Failure Trajectoriescited by 32
- 2024AutoDroid-V2: Boosting SLM-based GUI Agents via Code Generationcited by 31
- 2024Sketch2Code: Evaluating Vision-Language Models for Interactive Web Design Prototypingcited by 29
- 2024UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedbackcited by 26
- 2025FullFront: Benchmarking MLLMs Across the Full Front-End Engineering Workflowcited by 26
- 2025LLM-based Agentic Reasoning Frameworks: A Survey from Methods to Scenarioscited by 26
- 2024MRWeb: An Exploration of Generating Multi-Page Resource-Aware Web Code from UI Designscited by 24
- 2025UICopilot: Automating UI Synthesis via Hierarchical Code Generation from Webpage Designscited by 22
- 2025MLLM-Based UI2Code Automation Guided by UI Layout Informationcited by 17
- 2024IW-Bench: Evaluating Large Multimodal Models for Converting Image-to-Webcited by 16
- 2025Advancing vision-language models in front-end development via data synthesiscited by 16
- 2025DesignCoder: Hierarchy-Aware and Self-Correcting UI Code Generation with Large Language Modelscited by 11
- 2025WebVIA: A Web-based Vision-Language Agentic Framework for Interactive and Verifiable UI-to-Code Generationcited by 10
- 2025LaTCoder: Converting Webpage Design to Code with Layout-as-Thoughtcited by 9
- 2025Beyond Automation: How UI/UX Designers Perceive AI as a Creative Partner in the Divergent Thinking Stagescited by 6
- 2025Code Aesthetics with Agentic Reward Feedbackcited by 6
- 2024WAFFLE: Finetuning Multi-Modal Models for Automated Front-End Developmentcited by 5
- 2023Designing with Language: Wireframing UI Design Intent with Generative Large Language Modelscited by 4
- 2025Empowering RepoQA-Agent based on Reinforcement Learning Driven by Monte-carlo Tree Searchcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.