GPT-5 Model Corrected GPT-4V's Chart Reading Errors, Not Prompting
Not on the map. Why?
Abstract (arXiv)
We present a quantitative evaluation to understand the effect of zero-shot large-language model (LLMs) and prompting uses on chart reading tasks. We asked LLMs to answer 107 visualization questions to compare inference accuracies between the agentic GPT-5 and multimodal GPT-4V, for difficult image instances, where GPT-4V failed to produce correct answers. Our results show that model architecture dominates the inference accuracy: GPT5 largely improved accuracy, while prompt variants yielded only small effects. Pre-registration of this work is available here: https://osf.io/u78td/?view_only=6b075584311f48e991c39335c840ded3; the Google Drive materials are here:https://drive.google.com/file/d/1ll8WWZDf7cCNcfNWrLViWt8GwDNSvVrp/view.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 8 of its 21 references that are in the map. First posted on arXiv 8 Oct 2025.
Builds on
8 of 21 references.
References · 8
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,657
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,348
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
- 2023A Survey on Evaluation of Large Language Modelscited by 1,236
- 2025Reliable and Efficient Amortized Model-based Evaluationcited by 29
- 2024How Aligned are Human Chart Takeaways and LLM Predictions? A Case Study on Bar Charts with Varying Layoutscited by 10
- 2025CHART-6: Human-Centered Evaluation of Data Visualization Understanding in Vision-Language Modelscited by 5
- 2025A Rigorous Behavior Assessment of CNNs Using a Data-Domain Sampling Regimecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023GPT-3.5, GPT-4, or BARD? Evaluating LLMs Reasoning Ability in Zero-Shot Setting and Performance Boosting Through Prompts
- 2022Prompting GPT-3 To Be Reliable
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)
- 2023Gemini vs GPT-4V: A Preliminary Comparison and Combination of Vision-Language Models Through Qualitative Cases
- 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Tasks
- 2023Lost in Translation: When GPT-4V(ision) Can't See Eye to Eye with Text. A Vision-Language-Consistency Analysis of VLLMs and Beyond
- 2024Putting GPT-4o to the Sword: A Comprehensive Evaluation of Language, Vision, Speech, and Multimodal Proficiency
- 2024GPT-4V Cannot Generate Radiology Reports Yet