mlsanityData to 14 Oct 2026

InteractScience: Programmatic and Visually-Grounded Evaluation of Interactive Scientific Demonstration Code Generation

arXiv 2510.09724 ↗First posted 10 Oct 2025cs.SE cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are increasingly capable of generating complete applications from natural language instructions, creating new opportunities in science and education. In these domains, interactive scientific demonstrations are particularly valuable for explaining concepts, supporting new teaching methods, and presenting research findings. Generating such demonstrations requires models to combine accurate scientific knowledge with the ability to implement interactive front-end code that behaves correctly and responds to user actions. This capability goes beyond the scope of existing benchmarks, which typically evaluate either knowledge question answering without grounding in code or static web code generation without scientific interactivity. To evaluate this integrated ability, we design a hybrid framework that combines programmatic functional testing to rigorously verify interaction logic with visually-grounded qualitative testing to assess rendered outputs against reference snapshots. Building on this framework, we present InteractScience, a benchmark consisting of a substantial set of carefully designed questions across five scientific domains, each paired with unit tests, reference snapshots, and checklists. We evaluate 30 leading open- and closed-source LLMs and report results that highlight ongoing weaknesses in integrating domain knowledge with interactive front-end coding. Our work positions InteractScience as the first benchmark to automatically measure this combined capability with realistic interactive operations, providing a foundation for advancing reliable and educationally useful scientific demonstration code generation. All code and data are publicly available at https://github.com/open-compass/InteractScience.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 47 of its 61 references that are in the map. First posted on arXiv 10 Oct 2025.

Builds on

47 of 61 references.

References · 47

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2024GPT-4o System Cardcited by 4,588
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  7. 2021Program Synthesis with Large Language Modelscited by 3,637
  8. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  9. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  10. 2024A Survey on LLM-as-a-Judgecited by 1,423
  11. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  12. 2024Qwen2.5-Coder Technical Reportcited by 1,203
35 more
  1. 2024A Survey on Large Language Models for Code Generationcited by 658
  2. 2025Kimi K2: Open Agentic Intelligencecited by 567
  3. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 467
  4. 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 465
  5. 2025Accelerating scientific discovery with Co-Scientistcited by 401
  6. 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 203
  7. 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesiscited by 163
  8. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
  9. 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 129
  10. 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generationcited by 129
  11. 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualizationcited by 102
  12. 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 92
  13. 2023Deep Model Fusion: A Surveycited by 91
  14. 2024A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendationscited by 85
  15. 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 74
  16. 2025WebGen-Bench: Evaluating LLMs on Generating Interactive and Functional Websites from Scratchcited by 72
  17. 2025ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Datacited by 60
  18. 2025LLM Agents for Education: Advances and Applicationscited by 59
  19. 2025Scaling Text-Rich Image Understanding via Code-Guided Synthetic Multimodal Data Generationcited by 58
  20. 2025ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific Workflowscited by 52
  21. 2024Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototypingcited by 51
  22. 2025DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generationcited by 45
  23. 2024WebCode2M: A Real-World Dataset for Code Generation from Webpage Designscited by 44
  24. 2024A Survey on Evaluating Large Language Models in Code Generation Taskscited by 44
  25. 2025ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluationcited by 42
  26. 2025FullFront: Benchmarking MLLMs Across the Full Front-End Engineering Workflowcited by 28
  27. 2025TheoremExplainAgent: Towards Video-based Multimodal Explanations for LLM Theorem Understandingcited by 24
  28. 2024Drawing Pandas: A Benchmark for LLMs in Generating Plotting Codecited by 23
  29. 2025SridBench: Benchmark of Scientific Research Illustration Drawing of Image Generation Modelcited by 19
  30. 2025VisCoder: Fine-Tuning LLMs for Executable Python Visualization Code Generationcited by 17
  31. 2025WebMMU: A Benchmark for Multimodal Multilingual Website Understanding and Code Generationcited by 16
  32. 2025FusionFactory: Fusing LLM Capabilities with Multi-LLM Log Datacited by 10
  33. 2025Generative Interfaces for Language Modelscited by 6
  34. 2025From EduVisBench to EduVisAgent: A Benchmark and Multi-Agent Framework for Reasoning-Driven Pedagogical Visualizationcited by 5
  35. 2024TestAgent: Automatic Benchmarking and Exploratory Interaction for Evaluating LLMs in Vertical Domainscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.