Spatial Priming Outperforms Semantic Prompting: A Grid-Based Approach to Improving LLM Accuracy on Chart Data Extraction
Not on the map. Why?
Abstract (arXiv)
The automated extraction of data from scientific charts is a critical task for large-scale literature analysis. While multimodal Large Language Models (LLMs) show promise, their accuracy on non-standardized charts remains a challenge. This raises a key research question: what is the most effective strategy to improve model performance (high-level semantic priming) or low-level spatial priming? This paper presents a comparative investigation into these two distinct strategies. We describe our exploratory experiments with semantic methods, such as a two-stage metadata-first framework and Chain-of-Thought, which failed to produce a statistically significant improvement. In contrast, we present a simple but highly effective spatial priming method: overlaying a coordinate grid onto the chart image before analysis. Our quantitative experiment on a synthetic dataset demonstrates that this grid-based approach provides a statistically significant reduction in data extraction error (SMAPE reduced from 25.5% to 19.5%, p < 0.05) compared to a baseline. We conclude that for the current generation of multimodal models, providing explicit spatial context is a more effective and reliable strategy than high-level semantic guidance for this class of tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 4 of its 9 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
4 of 9 references.
References · 4
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2022DePlot: One-shot visual language reasoning by plot-to-table translationcited by 160
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025START: Spatial and Textual Learning for Chart Understanding
- 2026ChartFI: Benchmarking Faithfulness and Insightfulness of Chart Descriptions from Multimodal Large Language Models
- 2026Making Multimodal LLMs Reliable Chart Data Extractors: A Benchmark and Training Framework
- 2026ChartAnno: Benchmarking Multimodal Large Language Models for Chart Annotation Generation
- 2026ChartNet: A Million-Scale, High-Quality Multimodal Dataset for Robust Chart Understanding
- 2025ChartAnchor: Chart Grounding with Structural-Semantic Fidelity
- 2023ChartLlama: A Multimodal LLM for Chart Understanding and Generation
- 2024On Pre-training of Multimodal Language Models Customized for Chart Understanding