mlsanityData to 13 Oct 2026

GPT-5 Model Corrected GPT-4V's Chart Reading Errors, Not Prompting

arXiv 2510.06782 ↗First posted 8 Oct 2025cs.HC cs.CL cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a quantitative evaluation to understand the effect of zero-shot large-language model (LLMs) and prompting uses on chart reading tasks. We asked LLMs to answer 107 visualization questions to compare inference accuracies between the agentic GPT-5 and multimodal GPT-4V, for difficult image instances, where GPT-4V failed to produce correct answers. Our results show that model architecture dominates the inference accuracy: GPT5 largely improved accuracy, while prompt variants yielded only small effects. Pre-registration of this work is available here: https://osf.io/u78td/?view_only=6b075584311f48e991c39335c840ded3; the Google Drive materials are here:https://drive.google.com/file/d/1ll8WWZDf7cCNcfNWrLViWt8GwDNSvVrp/view.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 8 of its 21 references that are in the map. First posted on arXiv 8 Oct 2025.

Builds on

8 of 21 references.

References · 8

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,657
  2. 2022Large Language Models are Zero-Shot Reasonerscited by 4,348
  3. 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
  4. 2023A Survey on Evaluation of Large Language Modelscited by 1,236
  5. 2025Reliable and Efficient Amortized Model-based Evaluationcited by 29
  6. 2024How Aligned are Human Chart Takeaways and LLM Predictions? A Case Study on Bar Charts with Varying Layoutscited by 10
  7. 2025CHART-6: Human-Centered Evaluation of Data Visualization Understanding in Vision-Language Modelscited by 5
  8. 2025A Rigorous Behavior Assessment of CNNs Using a Data-Domain Sampling Regimecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023GPT-3.5, GPT-4, or BARD? Evaluating LLMs Reasoning Ability in Zero-Shot Setting and Performance Boosting Through Prompts
  2. 2022Prompting GPT-3 To Be Reliable
  3. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)
  4. 2023Gemini vs GPT-4V: A Preliminary Comparison and Combination of Vision-Language Models Through Qualitative Cases
  5. 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Tasks
  6. 2023Lost in Translation: When GPT-4V(ision) Can't See Eye to Eye with Text. A Vision-Language-Consistency Analysis of VLLMs and Beyond
  7. 2024Putting GPT-4o to the Sword: A Comprehensive Evaluation of Language, Vision, Speech, and Multimodal Proficiency
  8. 2024GPT-4V Cannot Generate Radiology Reports Yet