mlsanityData to 7 Oct 2026

M4FC: a Multimodal, Multilingual, Multicultural, Multitask Real-World Fact-Checking Dataset

arXiv 2510.23508 ↗First posted 27 Oct 2025cs.CLcited by 7

Not on the map. Why?

Abstract (arXiv)

Existing real-world datasets for multimodal fact-checking have multiple limitations: they contain few instances, cover only one or two languages, focus on a single task, or rely on external news article sets to source true claims. To address these shortcomings, we introduce M4FC, a new real-world dataset comprising 4,982 images paired with 6,980 claims. The images, verified by professional fact-checkers from 22 organizations, represent a diverse range of cultural and geographic contexts. Each claim is available in one or two out of ten languages. M4FC spans six multimodal fact-checking tasks: visual claim extraction, claimant intent prediction, fake image detection, image contextualization, location verification, and verdict prediction. We provide baseline results for all tasks and analyze how combining intermediate tasks affects verdict prediction performance. We make our dataset and code publicly available.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 30 of its 57 references that are in the map. First posted on arXiv 27 Oct 2025.

Builds on

30 of 57 references.

References · 30

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  6. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  7. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  8. 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
  9. 2021NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Mediacited by 106
  10. 2022POTATO: The Portable Text Annotation Toolcited by 64
  11. 2024MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMscited by 60
  12. 2022MuMiN: A Large-Scale Multilingual Multimodal Fact-Checked Misinformation Social Network Datasetcited by 59
18 more
  1. 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyondcited by 55
  2. 2019Fact-Checking Meets Fauxtography: Verifying Claims About Imagescited by 52
  3. 2023Multimodal Automated Fact-Checking: A Surveycited by 51
  4. 2022Missing Counter-Evidence Renders NLP Fact-Checking Unrealistic for Misinformationcited by 45
  5. 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 42
  6. 2023VERITE: A Robust Benchmark for Multimodal Misinformation Detection Accounting for Unimodal Biascited by 37
  7. 2020Multimodal Analytics for Real-world News using Measures of Cross-modal Entity Consistencycited by 33
  8. 2018Deep Multimodal Image-Repurposing Detectioncited by 31
  9. 2024AMMeBa: A Large-Scale Survey and Dataset of Media-Based Misinformation In-The-Wildcited by 26
  10. 2022There is a Time and Place for Reasoning Beyond the Imagecited by 22
  11. 2025AVerImaTeC: A Dataset for Automatic Verification of Image-Text Claims with Evidence from the Webcited by 17
  12. 2020Edited Media Understanding Frames: Reasoning About the Intent and Implications of Visual Misinformationcited by 15
  13. 2024MiRAGeNews: Multimodal Realistic AI-Generated News Detectioncited by 15
  14. 2025COVE: COntext and VEracity prediction for out-of-context imagescited by 14
  15. 2024Multimodal Large Language Models to Support Real-World Fact-Checkingcited by 13
  16. 2024Similarity over Factuality: Are we making progress on multimodal out-of-context misinformation detection?cited by 11
  17. 2025XFacta: Contemporary, Real-World Dataset and Evaluation for Multimodal Misinformation Detection with Multimodal LLMscited by 6
  18. 2025Seeing Through Deception: Uncovering Misleading Creator Intent in Multimodal News with Vision-Language Modelscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.

  1. 2026Multimodal Claim Extraction for Fact-Checkingcited by 1
  2. 2026NewsRECON: News Article Retrieval for Image Contextualizationcited by 0
  3. 2026ReMMD: Realistic Multilingual Multi-Image Agentic Verification for Multimodal Misinformation Detectioncited by 0
  4. 2026Evidence Triangulation for Multimodal Fact-Checking in the Wildcited by 0
  5. 2026RCMN: Understanding Misleadingness in Influential Public Discoursecited by 0
  6. 2026Evaluating and Improving Evidence-Grounded Fact-Checking in LLMs via Multi-Round Evidence Ablationcited by 0
  7. 2026MIC: Explaining Image-Claim Inconsistencies in AI-Generated Multimodal Misinformationcited by 0