mlsanityData to 7 Oct 2026

X-FACT: A New Benchmark Dataset for Multilingual Fact Checking

arXiv 2106.09248 ↗First posted 17 Jun 2021cs.CLcited by 90

Not on the map. Why?

Abstract (arXiv)

In this work, we introduce X-FACT: the largest publicly available multilingual dataset for factual verification of naturally existing real-world claims. The dataset contains short statements in 25 languages and is labeled for veracity by expert fact-checkers. The dataset includes a multilingual evaluation benchmark that measures both out-of-domain generalization, and zero-shot capabilities of the multilingual models. Using state-of-the-art multilingual transformer-based models, we develop several automated fact-checking models that, along with textual claims, make use of additional metadata and evidence from news stories retrieved using a search engine. Empirically, our best model attains an F-score of around 40%, suggesting that our dataset is a challenging benchmark for evaluation of multilingual fact-checking models.

Key facts. Cited by 90 papers in the map (data through 7 Oct 2026). Builds on 16 of its 22 references that are in the map. First posted on arXiv 17 Jun 2021.

Builds on

16 of 22 references.

References · 16

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  3. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  4. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
  5. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 738
  6. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 425
  7. 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 361
  8. 2019Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERTcited by 301
  9. 2018Hypothesis Only Baselines in Natural Language Inferencecited by 291
  10. 2019Massively Multilingual Neural Machine Translationcited by 246
  11. 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
  12. 2017Automatic Detection of Fake Newscited by 145
4 more
  1. 201975 Languages, 1 Model: Parsing Universal Dependencies Universallycited by 90
  2. 2020INFOTABS: Inference on Tables as Semi-structured Datacited by 84
  3. 2020Fighting an Infodemic: COVID-19 Fake News Datasetcited by 82
  4. 2020FakeCovid -- A Multilingual Cross-domain Fact Check News Dataset for COVID-19cited by 60

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 11; 2023: 21; 2024: 25; 2025: 19; 2026: 12.

90 papers.

Sort:

By area:

  1. 2021A Survey on Automated Fact-Checkingcited by 376
  2. 2023Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Modelscited by 186
  3. 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
  4. 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
  5. 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 97
  6. 2022Generating Literal and Implied Subquestions to Fact-check Complex Claimscited by 66
  7. 2022MuMiN: A Large-Scale Multilingual Multimodal Fact-Checked Misinformation Social Network Datasetcited by 59
  8. 2025Large Language Models Share Representations of Latent Grammatical Concepts Across Typologically Diverse Languagescited by 57
  9. 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tablescited by 51
  10. 2023Multimodal Automated Fact-Checking: A Surveycited by 51
  11. 2024M-RewardBench: Evaluating Reward Models in Multilingual Settingscited by 50
  12. 2023Do Large Language Models Know about Facts?cited by 49
38 more
  1. 2022Missing Counter-Evidence Renders NLP Fact-Checking Unrealistic for Misinformationcited by 45
  2. 2022NusaCrowd: Open Source Initiative for Indonesian NLP Resourcescited by 38
  3. 2022CHEF: A Pilot Chinese Dataset for Evidence-Based Fact-Checkingcited by 37
  4. 2023HealthFC: Verifying Health Claims with Evidence-Based Medical Fact-Checkingcited by 35
  5. 2023Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checkingcited by 34
  6. 2024JustiLM: Few-shot Justification Generation for Explainable Fact-Checking of Real-world Claimscited by 29
  7. 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
  8. 2023Revisiting non-English Text Simplification: A Unified Multilingual Benchmarkcited by 27
  9. 2023Zero-shot Faithful Factual Error Correctioncited by 26
  10. 2023Fin-Fact: A Benchmark Dataset for Multimodal Financial Fact Checking and Explanation Generationcited by 25
  11. 2023FACTIFY-5WQA: 5W Aspect-based Fact Verification through Question Answeringcited by 24
  12. 2024Claim Verification in the Age of Large Language Models: A Surveycited by 23
  13. 2024Generative Large Language Models in Automated Fact-Checking: A Surveycited by 19
  14. 2025FACT-AUDIT: An Adaptive Multi-Agent Framework for Dynamic Fact-Checking Evaluation of Large Language Modelscited by 19
  15. 2024Multi-FAct: Assessing Factuality of Multilingual LLMs using FActScorecited by 18
  16. 2023Read it Twice: Towards Faithfully Interpretable Fact Verification by Revisiting Evidencecited by 17
  17. 2023FACTIFY3M: A Benchmark for Multimodal Fact Verification with Explainability through 5W Question-Answeringcited by 15
  18. 2024Do We Need Language-Specific Fact-Checking Models? The Case of Chinesecited by 15
  19. 2024Automated Justification Production for Claim Veracity in Fact Checking: A Survey on Architectures and Approachescited by 15
  20. 2022CONCRETE: Improving Cross-lingual Fact-checking with Cross-lingual Retrievalcited by 14
  21. 2022On the Impact of Temporal Concept Drift on Model Explanationscited by 14
  22. 2024Web Retrieval Agents for Evidence-Based Misinformation Detectioncited by 13
  23. 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Modelscited by 13
  24. 2024FactCheck Editor: Multilingual Text Editor with End-to-End fact-checkingcited by 12
  25. 2024Comparing Knowledge Sources for Open-Domain Scientific Claim Verificationcited by 10
  26. 2024A Guide to Misinformation Detection Data and Evaluationcited by 10
  27. 2022Stanceosaurus: Classifying Stance Towards Multilingual Misinformationcited by 8
  28. 2023Lost in Translation, Found in Spans: Identifying Claims in Multilingual Social Mediacited by 8
  29. 2025Beyond Translation: LLM-Based Data Generation for Multilingual Fact-Checkingcited by 8
  30. 2022Autonomation, Not Automation: Activities and Needs of European Fact-checkers as a Basis for Designing Human-Centered AI Systemscited by 7
  31. 2025Poly-FEVER: A Multilingual Fact Verification Benchmark for Hallucination Detection in Large Language Modelscited by 7
  32. 2025CCHall: A Novel Benchmark for Joint Cross-Lingual and Cross-Modal Hallucinations Detection in Large Language Modelscited by 7
  33. 2022CsFEVER and CTKFacts: Acquiring Czech data for fact verificationcited by 6
  34. 2021The Case for Claim Difficulty Assessment in Automatic Fact Checkingcited by 5
  35. 2024LiveFC: A System for Live Fact-Checking of Audio Streamscited by 5
  36. 2025Are Knowledge and Reference in Multilingual Language Models Cross-Lingually Consistent?cited by 5
  37. 2025Adversarial Attacks Against Automated Fact-Checking: A Surveycited by 5
  38. 2023Give Me More Details: Improving Fact-Checking with Latent Retrievalcited by 4

50 most cited of 90 All 90 (JSON)