mlsanityData to 14 Oct 2026

InfoChartQA: A Benchmark for Multimodal Question Answering on Infographic Charts

arXiv 2505.19028 ↗First posted 25 May 2025cs.CV cs.AIcited by 17

On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection

Abstract (arXiv)

Understanding infographic charts with design-driven visual elements (e.g., pictograms, icons) requires both visual recognition and reasoning, posing challenges for multimodal large language models (MLLMs). However, existing visual-question answering benchmarks fall short in evaluating these capabilities of MLLMs due to the lack of paired plain charts and visual-element-based questions. To bridge this gap, we introduce InfoChartQA, a benchmark for evaluating MLLMs on infographic chart understanding. It includes 5,642 pairs of infographic and plain charts, each sharing the same underlying data but differing in visual presentations. We further design visual-element-based questions to capture their unique visual designs and communicative intent. Evaluation of 20 MLLMs reveals a substantial performance decline on infographic charts, particularly for visual-element-based questions related to metaphors. The paired infographic and plain charts enable fine-grained error analysis and ablation studies, which highlight new opportunities for advancing MLLMs in infographic chart understanding. We release InfoChartQA at https://github.com/CoolDawnAnt/InfoChartQA.

Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 28 of its 42 references that are in the map. First posted on arXiv 25 May 2025.

Builds on

28 of 42 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs26 Jun
  2. 2024ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answering11 May
  3. 2024ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning19 Feb
  4. 2024ChartAssisstant: A Universal Chart Multimodal Language Model via Chart-to-Table Pre-training and Multitask Instruction Tuning4 Jan
  5. 2023ChartBench: A Benchmark for Complex Visual Reasoning in Charts26 Dec
  6. 2023ChartLlama: A Multimodal LLM for Chart Understanding and Generation27 Nov

Other references · 22

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  3. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  4. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  5. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  6. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  7. 2024Phi-4 Technical Reportcited by 711
  8. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
  9. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
  10. 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
  11. 2021InfographicVQAcited by 437
  12. 2018DVQA: Understanding Data Visualizations via Question Answeringcited by 340
10 more
  1. 2019PlotQA: Reasoning over Scientific Plotscited by 321
  2. 2017FigureQA: An Annotated Figure Dataset for Visual Reasoningcited by 319
  3. 2024Ovis: Structural Embedding Alignment for Multimodal Large Language Modelcited by 169
  4. 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 108
  5. 2024ChartGemma: Visual Instruction-tuning for Chart Reasoning in the Wildcited by 79
  6. 2024ChartInstruct: Instruction Tuning for Chart Comprehension and Reasoningcited by 68
  7. 2022OpenCQA: Open-ended Question Answering with Chartscited by 61
  8. 2020OoDAnalyzer: Interactive Analysis of Out-of-Distribution Samplescited by 33
  9. 2023Foundation Models Meet Visualizations: Challenges and Opportunitiescited by 31
  10. 2025ChartGalaxy: A Dataset for Infographic Chart Understanding and Generationcited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 10.

17 papers.

Sort:

By area:

  1. 2025ChartHal: A Fine-grained Framework Evaluating Hallucination of Large Vision Language Models in Chart Understandingcited by 5
  2. 2025Where on Earth? A Vision-Language Benchmark for Probing Model Geolocation Skills Across Scalescited by 5
  3. 2025InterChart: Benchmarking Visual Reasoning Across Decomposed and Distributed Chart Informationcited by 4
  4. 2025FRIEDA: Benchmarking Multi-Step Cartographic Reasoning in Vision-Language Modelscited by 3
  5. 2025InfoCausalQA:Can Models Perform Non-explicit Causal Reasoning Based on Infographic?cited by 1
  6. 2026Multimodal Information Fusion for Chart Understanding: A Survey of MLLMs -- Evolution, Limitations, and Cognitive Enhancementcited by 1
  7. 2025Benchmark It Yourself (BIY): Preparing a Dataset and Benchmarking AI Models for Scatterplot-Related Taskscited by 0
  8. 2025ViInfographicVQA: A Benchmark for Single and Multi-image Visual Question Answering on Vietnamese Infographicscited by 0
  9. 2026Chart Deep Research in LVLMs via Parallel Relative Policy Optimizationcited by 0
  10. 2026QASM-Eval: A Dataset to Train and Evaluate LLMs on OpenQASM-3 Beyond Quantum Circuitscited by 0
  11. 2026ChartWalker: Benchmarking the Cross-Chart RAG Task with Hierarchical Knowledge Graphscited by 0
  12. 2026Towards High-Level Semantic Intelligencecited by 0
5 more
  1. 2026ChartAnno: Benchmarking Multimodal Large Language Models for Chart Annotation Generationcited by 0
  2. 2026Does More Retrieved Evidence Help Visual Retrieval-Augmented Generation with Diffusion Language Models?cited by 0
  3. 2026InfoEdit: Probing Global Layout Reasoning in Infographic Editingcited by 0
  4. 2026It Takes Workflows to Evolve Better Workflowscited by 0
  5. 2026Stride: Scale-Aware Multi-Agent Evolutionary Refinement for Infographic Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Single Plots: A Benchmark for Question Answering on Multi-Charts
  2. 2024Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction Tuning
  3. 2024Unraveling the Truth: Do VLMs really Understand Charts? A Deep Dive into Consistency and Robustness
  4. 2025ChartMind: A Comprehensive Benchmark for Complex Real-world Multimodal Chart Question Answering
  5. 2024MultiChartQA: Benchmarking Vision-Language Models on Multi-Chart Problems
  6. 2024mChartQA: A universal benchmark for multimodal Chart Question Answer based on Vision-Language Alignment and Reasoning
  7. 2025POLYCHARTQA: Benchmarking Large Vision-Language Models with Multilingual Chart Question Answering
  8. 2026IGenBench: Benchmarking the Reliability of Text-to-Infographic Generation