mlsanityData to 14 Oct 2026

ChartCheck: Explainable Fact-Checking over Real-World Chart Images

arXiv 2311.07453 ↗First posted 13 Nov 2023cs.CL cs.CVcited by 26

Not on the map. Why?

Abstract (arXiv)

Whilst fact verification has attracted substantial interest in the natural language processing community, verifying misinforming statements against data visualizations such as charts has so far been overlooked. Charts are commonly used in the real-world to summarize and communicate key information, but they can also be easily misused to spread misinformation and promote certain agendas. In this paper, we introduce ChartCheck, a novel, large-scale dataset for explainable fact-checking against real-world charts, consisting of 1.7k charts and 10.5k human-written claims and explanations. We systematically evaluate ChartCheck using vision-language and chart-to-table models, and propose a baseline to the community. Finally, we study chart reasoning types and visual attributes that pose a challenge to these models

Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 26 of its 47 references that are in the map. First posted on arXiv 13 Nov 2023.

Builds on

26 of 47 references.

References · 26

  1. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  2. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
  3. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  4. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  5. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  6. 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,230
  7. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
  8. 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 434
  9. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 428
  10. 2021A Survey on Automated Fact-Checkingcited by 378
  11. 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 366
  12. 2018DVQA: Understanding Data Visualizations via Question Answeringcited by 340
14 more
  1. 2019PlotQA: Reasoning over Scientific Plotscited by 321
  2. 2020Explainable Automated Fact-Checking for Public Health Claimscited by 211
  3. 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
  4. 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 169
  5. 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 167
  6. 2022DePlot: One-shot visual language reasoning by plot-to-table translationcited by 160
  7. 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 160
  8. 2022MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derenderingcited by 133
  9. 2023Multimodal Automated Fact-Checking: A Surveycited by 53
  10. 2023Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checkingcited by 35
  11. 2019Answering Questions about Data Visualizations using Efficient Bimodal Fusioncited by 26
  12. 2022Misinformed by Visualization: What Do We Learn From Misinformative Visualizations?cited by 19
  13. 2021Viral Visualizations: How Coronavirus Skeptics Use Orthodox Data Practices to Promote Unorthodox Science Onlinecited by 7
  14. 2023Why Change My Design: Explaining Poorly Constructed Visualization Designs with Explorable Explanationscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 5; 2025: 9; 2026: 12.

26 papers.

Sort:

By area:

  1. 2024ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoningcited by 128
  2. 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 43
  3. 2024Are Large Vision Language Models up to the Challenge of Chart Comprehension and Reasoning? An Extensive Investigation into the Capabilities and Limitations of LVLMscited by 30
  4. 2024DataNarrative: Automated Data-Driven Storytelling with Visualizations and Textscited by 25
  5. 2024Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checkingcited by 18
  6. 2025SciVer: Evaluating Foundation Models for Multimodal Scientific Claim Verificationcited by 17
  7. 2025BigCharts-R1: Enhanced Chart Reasoning with Visual Reinforcement Finetuningcited by 13
  8. 2025MuSciClaims: Multimodal Scientific Claim Verificationcited by 8
  9. 2025ChartCap: Mitigating Hallucination of Dense Chart Captioningcited by 7
  10. 2026SciClaimEval: Cross-modal Claim Verification in Scientific Paperscited by 7
  11. 2025The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Paperscited by 6
  12. 2025Table-Text Alignment: Explaining Claim Verification Against Tables in Scientific Paperscited by 4
14 more
  1. 2025ClimateViz: A Benchmark for Statistical Reasoning and Fact Verification on Scientific Chartscited by 2
  2. 2025TSVer: A Benchmark for Fact Verification Against Time-Series Evidencecited by 2
  3. 2026Making Multimodal LLMs Reliable Chart Data Extractors: A Benchmark and Training Frameworkcited by 2
  4. 2026M2-Verify: A Large-Scale Multidomain Benchmark for Checking Multimodal Claim Consistencycited by 1
  5. 2025Benchmark It Yourself (BIY): Preparing a Dataset and Benchmarking AI Models for Scatterplot-Related Taskscited by 0
  6. 2026MEVER: Multi-Modal and Explainable Claim Verification with Graph-based Evidence Retrievalcited by 0
  7. 2026When Visuals Aren't the Problem: Evaluating Vision-Language Models on Misleading Data Visualizationscited by 0
  8. 2026Is a Picture Worth a Thousand Words? Adaptive Multimodal Fact-Checking with Visual Evidence Necessitycited by 0
  9. 2026When Verification Fails: How Compositionally Infeasible Claims Escape Rejectioncited by 0
  10. 2026IPO-Mine: A Toolkit and Dataset for Section-Structured Analysis of Long, Multimodal IPO Documentscited by 0
  11. 2026ElementCheck: Complexity-Aware Long-Form Text Factuality Evaluation via Sentence Elementscited by 0
  12. 2026InSight: A Benchmark for Agentic Claim Verification in Interactive Visualizationscited by 0
  13. 2026Faithful Chart Generation for Multimodal Deep Research: Frame-Evidence Co-Adaptationcited by 0
  14. 2026Do you "see" what I "see"? A Multi-panel Visual Question Answer Dataset for Large Language Model Chart Analysiscited by 0