Vision-Guided Iterative Refinement for Frontend Code Generation
Not on the map. Why?
Abstract (arXiv)
Code generation with large language models often relies on multi-stage human-in-the-loop refinement, which is effective but very costly - particularly in domains such as frontend web development where the solution quality depends on rendered visual output. We present a fully automated critic-in-the-loop framework in which a vision-language model serves as a visual critic that provides structured feedback on rendered webpages to guide iterative refinement of generated code. Across real-world user requests from the WebDev Arena dataset, this approach yields consistent improvements in solution quality, achieving up to 17.8% increase in performance over three refinement cycles. Next, we investigate parameter-efficient fine-tuning using LoRA to understand whether the improvements provided by the critic can be internalized by the code-generating LLM. Fine-tuning achieves 25% of the gains from the best critic-in-the-loop solution without a significant increase in token counts. Our findings indicate that automated, VLM-based critique of frontend code generation leads to significantly higher quality solutions than can be achieved through a single LLM inference pass, and highlight the importance of iterative refinement for the complex visual outputs associated with web development.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 16 of its 38 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
16 of 38 references.
References · 16
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,151
- 2016Sequence-Level Knowledge Distillationcited by 761
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 516
- 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 146
- 2025METAL: A Multi-Agent Framework for Chart Generation with Test-Time Scalingcited by 33
- 2024Sketch2Code: Evaluating Vision-Language Models for Interactive Web Design Prototypingcited by 29
4 more
- 2026Grading Scale Impact on LLM-as-a-Judge: Human-LLM Alignment Is Highest on 0-5 Grading Scalecited by 17
- 2025ReLook: Vision-Grounded RL with a Multimodal LLM Critic for Agentic Web Codingcited by 12
- 2025WebDevJudge: Evaluating (M)LLMs as Critiques for Web Development Qualitycited by 10
- 2025Code Aesthetics with Agentic Reward Feedbackcited by 6
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026The reach of a verification tool decides its value: A controlled study of verification surface, artifact quality, and cost in AI coding agentscited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
- 2026TaoD2C-Bench: Benchmarking MLLMs for Industrial UI Code Generation Beyond Visual Fidelitycited by 0
- 2026TaoD2C-Bench: Benchmarking MLLMs for Industrial UI Code Generation Beyond Visual Fidelity7 Oct 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026The reach of a verification tool decides its value: A controlled study of verification surface, artifact quality, and cost in AI coding agents28 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2025ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluation
- 2025RefineCoder: Iterative Improving of Large Language Models via Adaptive Critique Refinement for Code Generation
- 2026Asuka-Bench: Benchmarking Code Agents on Underspecified User Intent and Multi-Round Refinement
- 2025FronTalk: Benchmarking Front-End Development as Conversational Code Generation with Multi-Modal Feedback
- 2026Self-Distillation Policy Optimization via Visual Feedback: Bridging Code and Visual Artifacts
- 2024An Empirical Study on the Code Refactoring Capability of Large Language Models
- 2025Advancing vision-language models in front-end development via data synthesis
- 2026Rendering-in-the-Loop: An Execution-Driven Agent for Interactive Web Development