mlsanityData to 7 Oct 2026

Vision-Guided Iterative Refinement for Frontend Code Generation

arXiv 2604.05839 ↗First posted 7 Apr 2026cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Code generation with large language models often relies on multi-stage human-in-the-loop refinement, which is effective but very costly - particularly in domains such as frontend web development where the solution quality depends on rendered visual output. We present a fully automated critic-in-the-loop framework in which a vision-language model serves as a visual critic that provides structured feedback on rendered webpages to guide iterative refinement of generated code. Across real-world user requests from the WebDev Arena dataset, this approach yields consistent improvements in solution quality, achieving up to 17.8% increase in performance over three refinement cycles. Next, we investigate parameter-efficient fine-tuning using LoRA to understand whether the improvements provided by the critic can be internalized by the code-generating LLM. Fine-tuning achieves 25% of the gains from the best critic-in-the-loop solution without a significant increase in token counts. Our findings indicate that automated, VLM-based critique of frontend code generation leads to significantly higher quality solutions than can be achieved through a single LLM inference pass, and highlight the importance of iterative refinement for the complex visual outputs associated with web development.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 16 of its 38 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

16 of 38 references.

References · 16

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  5. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,151
  6. 2016Sequence-Level Knowledge Distillationcited by 761
  7. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
  8. 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 516
  9. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
  10. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 146
  11. 2025METAL: A Multi-Agent Framework for Chart Generation with Test-Time Scalingcited by 33
  12. 2024Sketch2Code: Evaluating Vision-Language Models for Interactive Web Design Prototypingcited by 29
4 more
  1. 2026Grading Scale Impact on LLM-as-a-Judge: Human-LLM Alignment Is Highest on 0-5 Grading Scalecited by 17
  2. 2025ReLook: Vision-Grounded RL with a Multimodal LLM Critic for Agentic Web Codingcited by 12
  3. 2025WebDevJudge: Evaluating (M)LLMs as Critiques for Web Development Qualitycited by 10
  4. 2025Code Aesthetics with Agentic Reward Feedbackcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluation
  2. 2025RefineCoder: Iterative Improving of Large Language Models via Adaptive Critique Refinement for Code Generation
  3. 2026Asuka-Bench: Benchmarking Code Agents on Underspecified User Intent and Multi-Round Refinement
  4. 2025FronTalk: Benchmarking Front-End Development as Conversational Code Generation with Multi-Modal Feedback
  5. 2026Self-Distillation Policy Optimization via Visual Feedback: Bridging Code and Visual Artifacts
  6. 2024An Empirical Study on the Code Refactoring Capability of Large Language Models
  7. 2025Advancing vision-language models in front-end development via data synthesis
  8. 2026Rendering-in-the-Loop: An Execution-Driven Agent for Interactive Web Development