mlsanityData to 7 Oct 2026

MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claims

arXiv 1909.03242 ↗First posted 7 Sep 2019cs.CL cs.IR cs.LGcited by 169

Not on the map. Why?

Abstract (arXiv)

We contribute the largest publicly available dataset of naturally occurring factual claims for the purpose of automatic claim verification. It is collected from 26 fact checking websites in English, paired with textual sources and rich metadata, and labelled for veracity by human expert journalists. We present an in-depth analysis of the dataset, highlighting characteristics and challenges. Further, we present results for automatic veracity prediction, both with established baselines and with a novel method for joint ranking of evidence pages and predicting veracity that outperforms all baselines. Significant performance increases are achieved by encoding evidence, and by modelling metadata. Our best-performing model achieves a Macro F1 of 49.2%, showing that this is a challenging testbed for claim veracity prediction.

Key facts. Cited by 169 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Sep 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 34; 2022: 23; 2023: 29; 2024: 30; 2025: 27; 2026: 26.

169 papers.

Sort:

By area:

  1. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  2. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
  3. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
  4. 2023A Comprehensive Overview of Large Language Modelscited by 639
  5. 2021A Survey on Automated Fact-Checkingcited by 376
  6. 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
  7. 2021Mind the Gap: Assessing Temporal Generalization in Neural Language Modelscited by 226
  8. 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
  9. 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
  10. 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
  11. 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
  12. 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
38 more
  1. 2022Internet-augmented language models through few-shot prompting for open-domain question answeringcited by 131
  2. 2023Explore, Establish, Exploit: Red Teaming Language Models from Scratchcited by 111
  3. 2023Complex Claim Verification with Evidence Retrieved in the Wildcited by 110
  4. 2022End-to-End Multimodal Fact-Checking and Explanation Generation: A Challenging Dataset and Modelscited by 105
  5. 2021COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemiccited by 100
  6. 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
  7. 2021X-FACT: A New Benchmark Dataset for Multilingual Fact Checkingcited by 90
  8. 2022Evaluating the Factual Consistency of Large Language Models Through News Summarizationcited by 90
  9. 2023Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkerscited by 86
  10. 2021A Survey on Stance Detection for Mis- and Disinformation Identificationcited by 75
  11. 2023Automatic Evaluation of Attribution by Large Language Modelscited by 70
  12. 2022Generating Literal and Implied Subquestions to Fact-check Complex Claimscited by 66
  13. 2022MuMiN: A Large-Scale Multilingual Multimodal Fact-Checked Misinformation Social Network Datasetcited by 59
  14. 2022Generating Scientific Claims for Zero-Shot Scientific Fact Checkingcited by 59
  15. 2023FactKG: Fact Verification via Reasoning on Knowledge Graphscited by 57
  16. 2021Automated Fact-Checking: A Surveycited by 55
  17. 2023Scientific Fact-Checking: A Survey of Resources and Approachescited by 53
  18. 2022Missing Counter-Evidence Renders NLP Fact-Checking Unrealistic for Misinformationcited by 45
  19. 2021AmbiFC: Fact-Checking Ambiguous Claims with Evidencecited by 38
  20. 2022CHEF: A Pilot Chinese Dataset for Evidence-Based Fact-Checkingcited by 37
  21. 2021FaVIQ: FAct Verification from Information-seeking Questionscited by 36
  22. 2023HealthFC: Verifying Health Claims with Evidence-Based Medical Fact-Checkingcited by 35
  23. 2022Zoom Out and Observe: News Environment Perception for Fake News Detectioncited by 34
  24. 2023The Perils & Promises of Fact-checking with Large Language Modelscited by 31
  25. 2021Cross-Domain Label-Adaptive Stance Detectioncited by 30
  26. 2024JustiLM: Few-shot Justification Generation for Explainable Fact-Checking of Real-world Claimscited by 29
  27. 2024The Automated Verification of Textual Claims (AVeriTeC) Shared Taskcited by 29
  28. 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
  29. 2025Worse than Zero-shot? A Fact-Checking Dataset for Evaluating the Robustness of RAG Against Misleading Retrievalscited by 27
  30. 2021Integrating Pattern- and Fact-based Fake News Detection via Model Preference Learningcited by 25
  31. 2023Benchmarking the Generation of Fact Checking Explanationscited by 25
  32. 2023ChartCheck: Explainable Fact-Checking over Real-World Chart Imagescited by 25
  33. 2025Hallucination Detection in Large Language Models with Metamorphic Relationscited by 24
  34. 2023Factify 2: A Multimodal Fake News and Satire News Datasetcited by 23
  35. 2024Claim Verification in the Age of Large Language Models: A Surveycited by 23
  36. 2024QuanTemp: A real-world open-domain benchmark for fact-checking numerical claimscited by 22
  37. 2021NewsClaims: A New Benchmark for Claim Detection from News with Attribute Knowledgecited by 20
  38. 2023Emotion Detection for Misinformation: A Reviewcited by 20

50 most cited of 169 All 169 (JSON)