I-WebGenBench : Evaluating Interactivity in LLM-Generated Scientific Web Applications
Not on the map. Why?
Abstract (arXiv)
Recent advances in visual language models have enabled autonomous agents for complex reasoning, tool use, and document understanding. However, existing document agents mainly transform papers into static artifacts such as summaries, webpages, or slides, which are insufficient for technical papers involving dynamic mechanisms and state transitions. In this work, we propose a Paper-to-Interactive-System Agent that converts research papers into executable interactive web systems. Given a PDF paper, the agent performs end-to-end processing without human intervention, including paper understanding, system modeling, and interactive webpage synthesis, enabling users to manipulate inputs and observe dynamic behaviors. To evaluate this task, we introduce a benchmark of 19 research papers paired with expert-built interactive systems as ground truth. We further propose PaperVoyager, a structured generation framework that explicitly models mechanisms and interaction logic during synthesis. Experiments show that PaperVoyager significantly improves the quality of generated interactive systems, offering a new paradigm for interactive scientific paper understanding.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 38 of its 47 references that are in the map. First posted on arXiv 30 May 2026.
Builds on
38 of 47 references.
References · 38
- 2025Qwen3 Technical Reportcited by 8,820
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
- 2025OpenAI GPT-5 System Cardcited by 989
- 2021Measuring Coding Challenge Competence With APPScited by 902
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
- 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 421
26 more
- 2025Kimi-VL Technical Reportcited by 388
- 2023RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generationcited by 367
- 2023RepoBench: Benchmarking Repository-Level Code Auto-Completion Systemscited by 353
- 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 203
- 2023OctoPack: Instruction Tuning Code Large Language Modelscited by 189
- 2025MiniMax-01: Scaling Foundation Models with Lightning Attentioncited by 166
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
- 2025MiMo: Unlocking the Reasoning Potential of Language Model -- From Pretraining to Posttrainingcited by 121
- 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 114
- 2025SWE-Lancer: Can Frontier LLMs Earn 1 Million from Real-World Freelance Software Engineering?cited by 105
- 2024SWE-Bench+: Enhanced Coding Benchmark for LLMscited by 99
- 2025SWE-Fixer: Training Open-Source LLMs for Effective and Efficient GitHub Issue Resolutioncited by 90
- 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 74
- 2025WebGen-Bench: Evaluating LLMs on Generating Interactive and Functional Websites from Scratchcited by 72
- 2024Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototypingcited by 51
- 2025DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generationcited by 45
- 2025UXAgent: An LLM Agent-Based Usability Testing Framework for Web Designcited by 40
- 2025Web-Bench: A LLM Code Benchmark Based on Web Standards and Frameworkscited by 40
- 2025PresentAgent: Multimodal Agent for Presentation Video Generationcited by 21
- 2024NaturalCodeBench: Examining Coding Performance Mismatch on HumanEval and Natural User Promptscited by 19
- 2026WebCoderBench: Benchmarking Web Application Generation with Comprehensive and Interpretable Evaluation Metricscited by 18
- 2024IW-Bench: Evaluating Large Multimodal Models for Converting Image-to-Webcited by 16
- 2025IWR-Bench: Can LVLMs reconstruct interactive webpage from a user interaction video?cited by 12
- 2026WebCompass: Towards Multimodal Web Coding Evaluation for Code Language Modelscited by 6
- 2025WebGen-V Bench: Structured Representation for Enhancing Visual Design in LLM-based Web Generation and Evaluationcited by 3
- 2026PaperVoyager : Building Interactive Web with Visual Language Modelscited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Paper2Web: Let's Make Your Paper Alive!
- 2025Paper2Agent: Reimagining Research Papers As Interactive and Reliable AI Agents
- 2026ViviDoc: Generating Interactive Documents through Human-Agent Collaboration
- 2025PaperDebugger: A Plugin-Based Multi-Agent System for In-Editor Academic Writing, Review, and Editing
- 2026PaperClaw: Harnessing Agents for Autonomous Research and Human-in-the-Loop Refinement
- 2025PaperArena: An Evaluation Benchmark for Tool-Augmented Agentic Reasoning on Scientific Literature
- 2025Agentic publications: redesigning scientific publishing in the age of thinking large language models
- 2026PARNESS: A Paper Harness for End-to-End Automated Scientific Research with Dynamic Workflows, Full-Text Indexing, and Cross-Run Knowledge Accumulation