mlsanityData to 7 Oct 2026

WebRISE: Requirement-Induced State Evaluation for MLLM-Generated Web Artifacts

arXiv 2606.03220 ↗First posted 2 Jun 2026cs.CL cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Existing benchmarks for MLLM-generated web artifacts assess interaction through local evidence and miss the requirement-induced states and transitions that determine whether a page works. We introduce WebRISE, which compiles task requirements into Interaction Contract Graphs (ICGs) of observable states, user-intent transitions, and DOM/visual assertions for implementation-agnostic browser execution. WebRISE spans 442 tasks across five input modalities (Text, Markdown, Sketch, Image, Video), with 5,495 transitions and 5,271 requirement checks that separate user-stated functions from implicit product-level constraints. Across 14 MLLMs, even the strongest model reaches only 65.6% transition validity and 66.3% requirement coverage, and visual quality is no proxy for behavior (Qwen3.6-35B-A3B on Markdown: V=80.8 yet T=15.5). Video gives the strongest interaction signal (+10.6 pp implicit coverage over Text), while implicit constraints persist; defect injection shows ICG-based scoring detects state errors at 2-16x the rate of checkpoint-style evaluation.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Jun 2026.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026WebWorld: The Browser as a World Model for Self-Improving Web Code
  2. 2026UI2App: Benchmarking Visual Interaction Inference in Executable Web Application Generation
  3. 2026LongWebBench: Evaluating Structural and Functional Webpage Generation in Long-Horizon Settings
  4. 2024Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototyping
  5. 2026ComponentBench: Diagnosing Component-Level Failures in Computer-Use Agents
  6. 2025ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluation
  7. 2026Rendering-in-the-Loop: An Execution-Driven Agent for Interactive Web Development
  8. 2026WebTestBench: Evaluating Computer-Use Agents towards End-to-End Automated Web Testing