SciFigure2Code: An AI-Reconstructed Benchmark for Scientific Figure-to-Code
Not on the map. Why?
Abstract (arXiv)
Scientific figures are the interface through which research claims are inspected and reused, but final published panels rarely expose the data or plotting code that produced them. Recovering this hidden provenance from pixels is therefore underdetermined. We introduce SciFigure2Code, an AI-reconstructed benchmark that instead evaluates presentation recovery: generating editable Python programs that preserve how a scientific panel is arranged and read. Role-specialized Codex agents generate, execute, visually refine, and audit silver-standard presentation programs that capture geometry, visual hierarchy, encodings, annotations, and typography without claiming to recover original measurements or author source code. This reconstruction-and-audit protocol turns final published panels into auditable reference packages; the resulting resource contains 6,740 reviewed panels and SciFigureBench, a balanced 337-panel test set across 31 chart subtypes, five domains, and three complexity levels. Across 14 zero-shot models in image-only and caption-assisted settings, execution, multi-component layouts, axes, legends, and scientific labels remain weak. Claude Opus 4.7 achieves the highest image-only Overall score, Claude Opus 4.6 leads caption-assisted reconstruction, and two-stage plan-then-code prompting improves Overall for all four tested models. SciFigure2Code provides an auditable testbed for agents that construct editable, visually faithful scientific figure presentations.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 27 references that are in the map. First posted on arXiv 8 Sep 2026.
Builds on
17 of 27 references.
References · 17
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
- 2021Measuring Coding Challenge Competence With APPScited by 879
- 2022DS-1000: A Natural and Reliable Benchmark for Data Science Code Generationcited by 442
- 2019PlotQA: Reasoning over Scientific Plotscited by 317
- 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 166
- 2023ChartLlama: A Multimodal LLM for Chart Understanding and Generationcited by 158
5 more
- 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generationcited by 118
- 2023ChartBench: A Benchmark for Complex Visual Reasoning in Chartscited by 116
- 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualizationcited by 98
- 2023ChartSumm: A Comprehensive Benchmark for Automatic Chart Summarization of Long and Short Summariescited by 30
- 2021Understanding Data Visualization Design Practicecited by 5
Built on by
Not cited yet.