mlsanityData to 7 Oct 2026

COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemic

arXiv 2106.03794 ↗First posted 7 Jun 2021cs.CLcited by 100

Not on the map. Why?

Abstract (arXiv)

We introduce a FEVER-like dataset COVID-Fact of 4,086 claims concerning the COVID-19 pandemic. The dataset contains claims, evidence for the claims, and contradictory claims refuted by the evidence. Unlike previous approaches, we automatically detect true claims and their source articles and then generate counter-claims using automatic methods rather than employing human annotators. Along with our constructed resource, we formally present the task of identifying relevant evidence for the claims and verifying whether the evidence refutes or supports a given claim. In addition to scientific claims, our data contains simplified general claims from media sources, making it better suited for detecting general misinformation regarding COVID-19. Our experiments indicate that COVID-Fact will provide a challenging testbed for the development of new systems and our approach will reduce the costs of building domain-specific datasets for detecting misinformation.

Key facts. Cited by 100 papers in the map (data through 7 Oct 2026). Builds on 22 of its 39 references that are in the map. First posted on arXiv 7 Jun 2021.

Builds on

22 of 39 references.

References · 22

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  6. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
  7. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  8. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  9. 2020Fact or Fiction: Verifying Scientific Claimscited by 546
  10. 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 199
  11. 2020CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claimscited by 195
  12. 2020CORD-19: The COVID-19 Open Research Datasetcited by 179
10 more
  1. 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
  2. 2020Enabling Language Models to Fill in the Blankscited by 121
  3. 2019Transforming Delete, Retrieve, Generate Approach for Controlled Text Style Transfercited by 81
  4. 2019A Richly Annotated Corpus for Different Tasks in Automated Fact-Checkingcited by 74
  5. 2017What is the Essence of a Claim? Cross-Domain Claim Identificationcited by 31
  6. 2020DeSePtion: Dual Sequence Prediction and Adversarial Examples for Improved Fact-Checkingcited by 26
  7. 2019SemEval-2019 Task 8: Fact Checking in Community Question Answering Forumscited by 18
  8. 2020Misinformation Has High Perplexitycited by 15
  9. 2018Fact Checking in Community Forumscited by 10
  10. 2020Rapidly Deploying a Neural Search Engine for the COVID-19 Open Research Dataset: Preliminary Thoughts and Lessons Learnedcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 8; 2022: 18; 2023: 23; 2024: 16; 2025: 20; 2026: 15.

100 papers.

Sort:

By area:

  1. 2021A Survey on Automated Fact-Checkingcited by 376
  2. 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
  3. 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
  4. 2021MultiVerS: Improving scientific claim verification with weak supervision and full-document contextcited by 140
  5. 2022SciFact-Open: Towards open-domain scientific claim verificationcited by 94
  6. 2022Generating Literal and Implied Subquestions to Fact-check Complex Claimscited by 66
  7. 2021DialFact: A Benchmark for Fact-Checking in Dialoguecited by 62
  8. 2022Generating Scientific Claims for Zero-Shot Scientific Fact Checkingcited by 59
  9. 2021Automated Fact-Checking: A Surveycited by 55
  10. 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledgecited by 55
  11. 2023Scientific Fact-Checking: A Survey of Resources and Approachescited by 53
  12. 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tablescited by 51
38 more
  1. 2022Missing Counter-Evidence Renders NLP Fact-Checking Unrealistic for Misinformationcited by 45
  2. 2022Synthetic Disinformation Attacks on Automated Fact Verification Systemscited by 44
  3. 2023Reinforcement Learning-based Counter-Misinformation Response Generation: A Case Study of COVID-19 Vaccine Misinformationcited by 39
  4. 2024SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literaturecited by 37
  5. 2023HealthFC: Verifying Health Claims with Evidence-Based Medical Fact-Checkingcited by 35
  6. 2022CoVERT: A Corpus of Fact-checked Biomedical COVID-19 Tweetscited by 29
  7. 2023FactCHD: Benchmarking Fact-Conflicting Hallucination Detectioncited by 29
  8. 2023Check-COVID: Fact-Checking COVID-19 News Claims with Scientific Evidencecited by 25
  9. 2023Benchmarking the Generation of Fact Checking Explanationscited by 25
  10. 2023Fin-Fact: A Benchmark Dataset for Multimodal Financial Fact Checking and Explanation Generationcited by 25
  11. 2024Claim Verification in the Age of Large Language Models: A Surveycited by 23
  12. 2021NewsClaims: A New Benchmark for Claim Detection from News with Attribute Knowledgecited by 20
  13. 2024Generative Large Language Models in Automated Fact-Checking: A Surveycited by 19
  14. 2024LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tools and Self-Explanationscited by 16
  15. 2023COVID-VTS: Fact Extraction and Verification on Short Video Platformscited by 15
  16. 2022Modeling Information Change in Science Communication with Semantically Matched Paraphrasescited by 14
  17. 2022RedHOT: A Corpus of Annotated Medical Questions, Experiences, and Claims on Social Mediacited by 13
  18. 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Modelscited by 13
  19. 2025GraphCheck: Breaking Long-Term Text Barriers with Extracted Knowledge Graph-Powered Fact-Checkingcited by 12
  20. 2022Fact-Saboteurs: A Taxonomy of Evidence Manipulation Attacks against Fact-Verification Systemscited by 11
  21. 2025CLAIMCHECK: How Grounded are LLM Critiques of Scientific Papers?cited by 11
  22. 2024What Makes Medical Claims (Un)Verifiable? Analyzing Entity and Relation Properties for Fact Verificationcited by 10
  23. 2024Comparing Knowledge Sources for Open-Domain Scientific Claim Verificationcited by 10
  24. 2024A Guide to Misinformation Detection Data and Evaluationcited by 10
  25. 2021Categorising Fine-to-Coarse Grained Misinformation: An Empirical Study of COVID-19 Infodemiccited by 9
  26. 2022SciTweets -- A Dataset and Annotation Framework for Detecting Scientific Online Discoursecited by 9
  27. 2023Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AIcited by 9
  28. 2023Countering Misinformation via Emotional Response Generationcited by 9
  29. 2024Can Large Language Models Detect Misinformation in Scientific News Reporting?cited by 9
  30. 2025Matter-of-Fact: A Benchmark for Verifying the Feasibility of Literature-Supported Claims in Materials Sciencecited by 9
  31. 2025RealFactBench: A Benchmark for Evaluating Large Language Models in Real-World Fact-Checkingcited by 9
  32. 2025MuSciClaims: Multimodal Scientific Claim Verificationcited by 8
  33. 2022Entity-based Claim Representation Improves Fact-Checking of Medical Content in Tweetscited by 7
  34. 2022Combating Health Misinformation in Social Media: Characterization, Detection, Intervention, and Open Issuescited by 6
  35. 2023Prompt to be Consistent is Better than Self-Consistent? Few-Shot and Zero-Shot Fact Verification with Pre-trained Language Modelscited by 6
  36. 2023Can Large Language Models Discern Evidence for Scientific Hypotheses? Case Studies in the Social Sciencescited by 6
  37. 2025The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Paperscited by 6
  38. 2021The Case for Claim Difficulty Assessment in Automatic Fact Checkingcited by 5

50 most cited of 100 All 100 (JSON)