PlotPick: AI-powered batch extraction of numerical data from scientific figures
Not on the map. Why?
Abstract (arXiv)
Systematic reviews and meta-analyses often need numerical data reported only in figures, and extracting them with interactive digitisers usually requires a person to select and calibrate each figure. We present PlotPick, an open-source tool that uses vision-language models (VLMs) to extract tabular data from batches of scientific figures, and we benchmark the kind of model it calls: nine VLMs from four providers on ChartX and six of them on PlotQA, against DePlot, a dedicated chart-to-table model, with every system scored on the same items by numeric F1 (F1 over unlabelled numbers at 5% relative tolerance). On six ChartX chart types (n=300) all nine VLMs outperform DePlot in aggregate, at 79.1-96.0% against 74.3%. The lead comes mainly from box plots, where DePlot scores 24.8% against 64.2-97.3%; pooled over the other five types, seven VLMs keep a lead of 4.7 to 11.6 points and the two weakest do not. On a subset of the PlotQA test split (n=529; 427 horizontal bar charts), scored by a lenient best-series variant of the metric, DePlot reaches 87.0%; the two strongest VLMs are level with it or slightly above it, and four fall 3.8 to 30.3 points below. DePlot was trained on PlotQA's training split. Both benchmarks use synthetic charts, and the metric ignores which series a value belongs to. The application itself was not evaluated: its figure detection, structured output, prompt and default model were not tested, and the one benchmarked model it offers, Claude Haiku 4.5, is one of the four below DePlot on PlotQA. Accuracy on biomedical figures has not been established, and every extracted value must be checked against its source figure. This version corrects version 1, which scored most PlotQA replies against category labels instead of plotted values; its claim that every VLM outperformed DePlot on both benchmarks is withdrawn. PlotPick is available at https://plotpick.streamlit.app/.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 14 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
7 of 14 references.
References · 7
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
- 2019PlotQA: Reasoning over Scientific Plotscited by 317
- 2022DePlot: One-shot visual language reasoning by plot-to-table translationcited by 157
- 2022MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derenderingcited by 132
- 2024ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoningcited by 127
- 2024TinyChart: Efficient Chart Understanding with Visual Token Merging and Program-of-Thoughts Learningcited by 51
- 2025Leveraging Vision Capabilities of Multimodal LLMs for Automated Data Extraction from Plotscited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026PlotGround: Grounding Plot Digitization in Real Scientific Figures and Their Source Data
- 2026Self-Ensembling Vision-Language Models for Chart Data Extraction
- 2026ChartDensity-Bench: Benchmarking MLLMs for Numerical Data Reconstruction under Visual Density
- 2026ChartZero: Synthetic Priors Enable Zero Shot Chart Data Extraction
- 2024Plot2Code: A Comprehensive Benchmark for Evaluating Multi-modal Large Language Models in Code Generation from Scientific Plots
- 2025ChartGen: Scaling Chart Understanding Via Code-Guided Synthetic Chart Generation
- 2026Beyond Text and Tables: Vision-Language Model Integration in ComProScanner for Extracting Materials Data from Scientific Figures with High Accuracy
- 2024DeTikZify: Synthesizing Graphics Programs for Scientific Figures and Sketches with TikZ