mlsanityData to 7 Oct 2026

FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured information

arXiv 2106.05707 ↗First posted 10 Jun 2021cs.CLcited by 166

Not on the map. Why?

Cited by 31 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Fact verification has attracted a lot of attention in the machine learning and natural language processing communities, as it is one of the key methods for detecting misinformation. Existing large-scale benchmarks for this task have focused mostly on textual sources, i.e. unstructured information, and thus ignored the wealth of information available in structured formats, such as tables. In this paper we introduce a novel dataset and benchmark, Fact Extraction and VERification Over Unstructured and Structured information (FEVEROUS), which consists of 87,026 verified claims. Each claim is annotated with evidence in the form of sentences and/or cells from tables in Wikipedia, as well as a label indicating whether this evidence supports, refutes, or does not provide enough information to reach a verdict. Furthermore, we detail our efforts to track and minimize the biases present in the dataset and could be exploited by models, e.g. being able to predict the label without using evidence. Finally, we develop a baseline for verifying claims against text and tables which predicts both the correct evidence and verdict for 18% of the claims.

Key facts. Cited by 166 papers in the map (data through 7 Oct 2026). Builds on 33 of its 69 references that are in the map. First posted on arXiv 10 Jun 2021.

Builds on

33 of 69 references.

References · 33

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
  4. 2015A large annotated corpus for learning natural language inferencecited by 1,837
  5. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  6. 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
  7. 2019Adversarial NLI: A New Benchmark for Natural Language Understandingcited by 798
  8. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  9. 2016The Mythos of Model Interpretabilitycited by 716
  10. 2019TabNet: Attentive Interpretable Tabular Learningcited by 640
  11. 2020Fact or Fiction: Verifying Scientific Claimscited by 546
  12. 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 432
21 more
  1. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 425
  2. 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 361
  3. 2020HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Datacited by 263
  4. 2020Explainable Automated Fact-Checking for Public Health Claimscited by 209
  5. 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 199
  6. 2020CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claimscited by 195
  7. 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
  8. 2020Open Question Answering over Tables and Textcited by 163
  9. 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
  10. 2019Towards Debiasing Fact Verification Modelscited by 143
  11. 2017Detection and Resolution of Rumours in Social Media: A Surveycited by 103
  12. 2018Automated Fact Checking: Task formulations, methods and future directionscited by 96
  13. 2020INFOTABS: Inference on Tables as Semi-structured Datacited by 84
  14. 2020Explainable Automated Fact-Checking: A Surveycited by 83
  15. 2021A Survey on Stance Detection for Mis- and Disinformation Identificationcited by 75
  16. 2019A Richly Annotated Corpus for Different Tasks in Automated Fact-Checkingcited by 74
  17. 2019The Limitations of Stylometry for Detecting Machine-Generated Fake Newscited by 63
  18. 2018Integrating Stance Detection and Fact Checking in a Unified Corpuscited by 41
  19. 2020Stance Prediction and Claim Verification: An Arabic Perspectivecited by 25
  20. 2021Representations for Question Answering from Documents with Tables and Textcited by 21
  21. 2020Joint Verification and Reranking for Open Fact Checking Over Tablescited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 11; 2022: 15; 2023: 36; 2024: 31; 2025: 38; 2026: 35.

166 papers.

Sort:

By area:

  1. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  2. 2021A Survey on Automated Fact-Checkingcited by 376
  3. 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergycited by 343
  4. 2023Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoningcited by 177
  5. 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 157
  6. 2023Knowledge Graph Prompting for Multi-Document Question Answeringcited by 150
  7. 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
  8. 2023Table Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical Studycited by 116
  9. 2021Truthful AI: Developing and governing AI that does not liecited by 109
  10. 2022End-to-End Multimodal Fact-Checking and Explanation Generation: A Challenging Dataset and Modelscited by 105
  11. 2024Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMscited by 94
  12. 2023Answering Questions by Meta-Reasoning over Multiple Chains of Thoughtcited by 87
38 more
  1. 2023Automatic Evaluation of Attribution by Large Language Modelscited by 70
  2. 2022Generating Literal and Implied Subquestions to Fact-check Complex Claimscited by 66
  3. 2024Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wiselycited by 65
  4. 2021DialFact: A Benchmark for Fact-Checking in Dialoguecited by 62
  5. 2025A Survey of LLM-based Deep Search Agents: Paradigm, Optimization, Evaluation, and Challengescited by 58
  6. 2023FactKG: Fact Verification via Reasoning on Knowledge Graphscited by 57
  7. 2021Automated Fact-Checking: A Surveycited by 55
  8. 2021ProoFVer: Natural Logic Theorem Proving for Fact Verificationcited by 52
  9. 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tablescited by 51
  10. 2023Multimodal Automated Fact-Checking: A Surveycited by 51
  11. 2023Do Large Language Models Know about Facts?cited by 49
  12. 2022Missing Counter-Evidence Renders NLP Fact-Checking Unrealistic for Misinformationcited by 45
  13. 2023RobuT: A Systematic Study of Table QA Robustness Against Human-Annotated Adversarial Perturbationscited by 41
  14. 2022CHEF: A Pilot Chinese Dataset for Evidence-Based Fact-Checkingcited by 37
  15. 2023Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Modelscited by 37
  16. 2022Zoom Out and Observe: News Environment Perception for Fake News Detectioncited by 34
  17. 2023Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checkingcited by 34
  18. 2023TAP4LLM: Table Provider on Sampling, Augmenting, and Packing Semi-structured Data for Large Language Model Reasoningcited by 32
  19. 2022ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examplescited by 29
  20. 2023FactCHD: Benchmarking Fact-Conflicting Hallucination Detectioncited by 29
  21. 2024StructLM: Towards Building Generalist Models for Structured Knowledge Groundingcited by 29
  22. 2023Trends in Integration of Knowledge and Large Language Models: A Survey and Taxonomy of Methods, Benchmarks, and Applicationscited by 28
  23. 2025Worse than Zero-shot? A Fact-Checking Dataset for Evaluating the Robustness of RAG Against Misleading Retrievalscited by 27
  24. 2023Interpretable Unified Language Checkingcited by 26
  25. 2023QACHECK: A Demonstration System for Question-Guided Multi-Hop Fact-Checkingcited by 26
  26. 2024Position: Measure Dataset Diversity, Don't Just Claim Itcited by 26
  27. 2023ChartCheck: Explainable Fact-Checking over Real-World Chart Imagescited by 25
  28. 2024OpenTab: Advancing Large Language Models as Open-domain Table Reasonerscited by 25
  29. 2023FACTIFY-5WQA: 5W Aspect-based Fact Verification through Question Answeringcited by 24
  30. 2023FLEEK: Factual Error Detection and Correction with Evidence Retrieved from External Knowledgecited by 24
  31. 2023Effective Distillation of Table-based Reasoning Ability from LLMscited by 23
  32. 2024CABINET: Content Relevance based Noise Reduction for Table Question Answeringcited by 23
  33. 2024ProTrix: Building Models for Planning and Reasoning over Tables with Sentence Contextcited by 23
  34. 2024Claim Verification in the Age of Large Language Models: A Surveycited by 23
  35. 2024QuanTemp: A real-world open-domain benchmark for fact-checking numerical claimscited by 22
  36. 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applicationscited by 21
  37. 2021NewsClaims: A New Benchmark for Claim Detection from News with Attribute Knowledgecited by 20
  38. 2024FinDVer: Explainable Claim Verification over Long and Hybrid-Content Financial Documentscited by 19

50 most cited of 166 All 166 (JSON)