mlsanityData to 7 Oct 2026

WebVR: Benchmarking Multimodal LLMs for WebPage Recreation from Videos via Human-Aligned Visual Rubrics

arXiv 2603.13391 ↗First posted 11 Mar 2026cs.CVcited by 8

On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection

Abstract (arXiv)

Existing web-generation benchmarks rely on text prompts or static screenshots as input. However, videos naturally convey richer signals such as interaction flow, transition timing, and motion continuity, which are essential for faithful webpage recreation. Despite this potential, video-conditioned webpage generation remains largely unexplored, with no dedicated benchmark for this task. To fill this gap, we introduce WebVR, a benchmark that evaluates whether MLLMs can faithfully recreate webpages from demonstration videos. WebVR contains 175 webpages across diverse categories, all constructed through a controlled synthesis pipeline rather than web crawling, ensuring varied and realistic demonstrations without overlap with existing online pages. We also design a fine-grained, human-aligned visual rubric that evaluates the generated webpages across multiple dimensions. Experiments on 19 models reveal substantial gaps in recreating fine-grained style and motion quality, while the rubric-based automatic evaluation achieves 96% agreement with human preferences. We release the dataset, evaluation toolkit, and baseline results to support future research on video-to-webpage generation.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 23 of its 26 references that are in the map. First posted on arXiv 11 Mar 2026.

Builds on

23 of 26 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Benchmarking MLLM-based Web Understanding: Reasoning, Robustness and Safety26 Sep
  2. 2025WebUIBench: A Comprehensive Benchmark for Evaluating Multimodal Large Language Models in WebUI-to-Code9 Jun
  3. 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs28 Jun
  4. 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset14 Mar

Other references · 19

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
  5. 2023Large Language Models are not Fair Evaluatorscited by 1,050
  6. 2023A Comprehensive Overview of Large Language Modelscited by 639
  7. 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
  8. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
  9. 2025WebGen-Bench: Evaluating LLMs on Generating Interactive and Functional Websites from Scratchcited by 66
  10. 2024Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototypingcited by 50
  11. 2025DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generationcited by 41
  12. 2025Web-Bench: A LLM Code Benchmark Based on Web Standards and Frameworkscited by 36
7 more
  1. 2025ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluationcited by 35
  2. 2026STEP3-VL-10B Technical Reportcited by 28
  3. 2025FullFront: Benchmarking MLLMs Across the Full Front-End Engineering Workflowcited by 25
  4. 2026WebCoderBench: Benchmarking Web Application Generation with Comprehensive and Interpretable Evaluation Metricscited by 15
  5. 2025MLLM as a UI Judge: Benchmarking Multimodal LLMs for Predicting Human Perception of User Interfacescited by 11
  6. 2025WebDevJudge: Evaluating (M)LLMs as Critiques for Web Development Qualitycited by 10
  7. 2026GUI-GenBench: Evaluating Image Generation Models as Interactive GUI Environmentscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Video2Code: Generating Interactive Webpages from UI Videos via Action-Aware Revisit
  2. 2025WebGen-V Bench: Structured Representation for Enhancing Visual Design in LLM-based Web Generation and Evaluation
  3. 2026VideoArgus: Agentic Rubric-Grounded Unified Evaluation for Video Generation and Editing
  4. 2026LongWebBench: Evaluating Structural and Functional Webpage Generation in Long-Horizon Settings
  5. 2025IWR-Bench: Can LVLMs reconstruct interactive webpage from a user interaction video?
  6. 2025Video-Bench: Human-Aligned Video Generation Benchmark
  7. 2026Weblica: Scalable and Reproducible Training Environments for Visual Web Agents
  8. 2024VideoWebArena: Evaluating Long Context Multimodal Agents with Video Understanding Web Tasks