WebVR: Benchmarking Multimodal LLMs for WebPage Recreation from Videos via Human-Aligned Visual Rubrics
On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection
Abstract (arXiv)
Existing web-generation benchmarks rely on text prompts or static screenshots as input. However, videos naturally convey richer signals such as interaction flow, transition timing, and motion continuity, which are essential for faithful webpage recreation. Despite this potential, video-conditioned webpage generation remains largely unexplored, with no dedicated benchmark for this task. To fill this gap, we introduce WebVR, a benchmark that evaluates whether MLLMs can faithfully recreate webpages from demonstration videos. WebVR contains 175 webpages across diverse categories, all constructed through a controlled synthesis pipeline rather than web crawling, ensuring varied and realistic demonstrations without overlap with existing online pages. We also design a fine-grained, human-aligned visual rubric that evaluates the generated webpages across multiple dimensions. Experiments on 19 models reveal substantial gaps in recreating fine-grained style and motion quality, while the rubric-based automatic evaluation achieves 96% agreement with human preferences. We release the dataset, evaluation toolkit, and baseline results to support future research on video-to-webpage generation.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 23 of its 26 references that are in the map. First posted on arXiv 11 Mar 2026.
Builds on
23 of 26 references.
Closest ancestors · 4
Same direction, newest first
- 2025Benchmarking MLLM-based Web Understanding: Reasoning, Robustness and Safety26 Sep
- 2025WebUIBench: A Comprehensive Benchmark for Evaluating Multimodal Large Language Models in WebUI-to-Code9 Jun
- 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs28 Jun
- 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset14 Mar
Other references · 19
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2023Large Language Models are not Fair Evaluatorscited by 1,050
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
- 2025WebGen-Bench: Evaluating LLMs on Generating Interactive and Functional Websites from Scratchcited by 66
- 2024Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototypingcited by 50
- 2025DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generationcited by 41
- 2025Web-Bench: A LLM Code Benchmark Based on Web Standards and Frameworkscited by 36
7 more
- 2025ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluationcited by 35
- 2026STEP3-VL-10B Technical Reportcited by 28
- 2025FullFront: Benchmarking MLLMs Across the Full Front-End Engineering Workflowcited by 25
- 2026WebCoderBench: Benchmarking Web Application Generation with Comprehensive and Interpretable Evaluation Metricscited by 15
- 2025MLLM as a UI Judge: Benchmarking Multimodal LLMs for Predicting Human Perception of User Interfacescited by 11
- 2025WebDevJudge: Evaluating (M)LLMs as Critiques for Web Development Qualitycited by 10
- 2026GUI-GenBench: Evaluating Image Generation Models as Interactive GUI Environmentscited by 5
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Vision2Web: A Hierarchical Benchmark for Visual Website Development with Agent Verificationcited by 16
- 2026VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine Systemcited by 7
- 2026EvoStreaming: Your Offline Video Model Is a Natively Streaming Assistantcited by 5
- 2026VideoVIBE: A Video-Grounded Diagnostic Benchmark for One-Shot Interactive Website Generationcited by 1
- 2026Omni2Web: Benchmarking Audiovisual Website Developmentcited by 1
- 2026Animation2Code: Evaluating Temporal Visual Reasoning in Video-to-Code Generationcited by 0
- 2026UI2App: Benchmarking Visual Interaction Inference in Executable Web Application Generationcited by 0
- 2026A2Z GameSpec-Bench: How Faithfully Can Coding Agents Generate Games from Game Design Specifications?cited by 0
- 2026A2Z GameSpec-Bench: How Faithfully Can Coding Agents Generate Games from Game Design Specifications?30 Sep 2026
- 2026Omni2Web: Benchmarking Audiovisual Website Development20 Sep 2026
- 2026VideoVIBE: A Video-Grounded Diagnostic Benchmark for One-Shot Interactive Website Generation10 Aug 2026
- 2026VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine System29 Jul 2026
- 2026UI2App: Benchmarking Visual Interaction Inference in Executable Web Application Generation7 Jul 2026
- 2026Animation2Code: Evaluating Temporal Visual Reasoning in Video-to-Code Generation26 Jun 2026
- 2026EvoStreaming: Your Offline Video Model Is a Natively Streaming Assistant11 May 2026
- 2026Vision2Web: A Hierarchical Benchmark for Visual Website Development with Agent Verification27 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Video2Code: Generating Interactive Webpages from UI Videos via Action-Aware Revisit
- 2025WebGen-V Bench: Structured Representation for Enhancing Visual Design in LLM-based Web Generation and Evaluation
- 2026VideoArgus: Agentic Rubric-Grounded Unified Evaluation for Video Generation and Editing
- 2026LongWebBench: Evaluating Structural and Functional Webpage Generation in Long-Horizon Settings
- 2025IWR-Bench: Can LVLMs reconstruct interactive webpage from a user interaction video?
- 2025Video-Bench: Human-Aligned Video Generation Benchmark
- 2026Weblica: Scalable and Reproducible Training Environments for Visual Web Agents
- 2024VideoWebArena: Evaluating Long Context Multimodal Agents with Video Understanding Web Tasks