InteractScience: Programmatic and Visually-Grounded Evaluation of Interactive Scientific Demonstration Code Generation
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) are increasingly capable of generating complete applications from natural language instructions, creating new opportunities in science and education. In these domains, interactive scientific demonstrations are particularly valuable for explaining concepts, supporting new teaching methods, and presenting research findings. Generating such demonstrations requires models to combine accurate scientific knowledge with the ability to implement interactive front-end code that behaves correctly and responds to user actions. This capability goes beyond the scope of existing benchmarks, which typically evaluate either knowledge question answering without grounding in code or static web code generation without scientific interactivity. To evaluate this integrated ability, we design a hybrid framework that combines programmatic functional testing to rigorously verify interaction logic with visually-grounded qualitative testing to assess rendered outputs against reference snapshots. Building on this framework, we present InteractScience, a benchmark consisting of a substantial set of carefully designed questions across five scientific domains, each paired with unit tests, reference snapshots, and checklists. We evaluate 30 leading open- and closed-source LLMs and report results that highlight ongoing weaknesses in integrating domain knowledge with interactive front-end coding. Our work positions InteractScience as the first benchmark to automatically measure this combined capability with realistic interactive operations, providing a foundation for advancing reliable and educationally useful scientific demonstration code generation. All code and data are publicly available at https://github.com/open-compass/InteractScience.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 47 of its 61 references that are in the map. First posted on arXiv 10 Oct 2025.
Builds on
47 of 61 references.
References · 47
- 2023GPT-4 Technical Reportcited by 18,396
- 2025Qwen3 Technical Reportcited by 8,820
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
35 more
- 2024A Survey on Large Language Models for Code Generationcited by 658
- 2025Kimi K2: Open Agentic Intelligencecited by 567
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 467
- 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 465
- 2025Accelerating scientific discovery with Co-Scientistcited by 401
- 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 203
- 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesiscited by 163
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
- 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 129
- 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generationcited by 129
- 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualizationcited by 102
- 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 92
- 2023Deep Model Fusion: A Surveycited by 91
- 2024A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendationscited by 85
- 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 74
- 2025WebGen-Bench: Evaluating LLMs on Generating Interactive and Functional Websites from Scratchcited by 72
- 2025ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Datacited by 60
- 2025LLM Agents for Education: Advances and Applicationscited by 59
- 2025Scaling Text-Rich Image Understanding via Code-Guided Synthetic Multimodal Data Generationcited by 58
- 2025ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific Workflowscited by 52
- 2024Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototypingcited by 51
- 2025DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generationcited by 45
- 2024WebCode2M: A Real-World Dataset for Code Generation from Webpage Designscited by 44
- 2024A Survey on Evaluating Large Language Models in Code Generation Taskscited by 44
- 2025ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluationcited by 42
- 2025FullFront: Benchmarking MLLMs Across the Full Front-End Engineering Workflowcited by 28
- 2025TheoremExplainAgent: Towards Video-based Multimodal Explanations for LLM Theorem Understandingcited by 24
- 2024Drawing Pandas: A Benchmark for LLMs in Generating Plotting Codecited by 23
- 2025SridBench: Benchmark of Scientific Research Illustration Drawing of Image Generation Modelcited by 19
- 2025VisCoder: Fine-Tuning LLMs for Executable Python Visualization Code Generationcited by 17
- 2025WebMMU: A Benchmark for Multimodal Multilingual Website Understanding and Code Generationcited by 16
- 2025FusionFactory: Fusing LLM Capabilities with Multi-LLM Log Datacited by 10
- 2025Generative Interfaces for Language Modelscited by 6
- 2025From EduVisBench to EduVisAgent: A Benchmark and Multi-Agent Framework for Reasoning-Driven Pedagogical Visualizationcited by 5
- 2024TestAgent: Automatic Benchmarking and Exploratory Interaction for Evaluating LLMs in Vertical Domainscited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligencecited by 6
- 2026RealChart2Code: Advancing Chart-to-Code Generation with Real Data and Multi-Task Evaluationcited by 4
- 2025TechImage-Bench: Rubric-Based Evaluation for Technical Image Generationcited by 2
- 2026PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesiscited by 0
- 2026PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesis14 Oct 2026
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligence14 Jun 2026
- 2026RealChart2Code: Advancing Chart-to-Code Generation with Real Data and Multi-Task Evaluation26 Mar 2026
- 2025TechImage-Bench: Rubric-Based Evaluation for Technical Image Generation13 Dec 2025