mlsanityData to 7 Oct 2026

Check-COVID: Fact-Checking COVID-19 News Claims with Scientific Evidence

arXiv 2305.18265 ↗First posted 29 May 2023cs.CL cs.AI cs.CYcited by 25

Not on the map. Why?

Abstract (arXiv)

We present a new fact-checking benchmark, Check-COVID, that requires systems to verify claims about COVID-19 from news using evidence from scientific articles. This approach to fact-checking is particularly challenging as it requires checking internet text written in everyday language against evidence from journal articles written in formal academic language. Check-COVID contains 1, 504 expert-annotated news claims about the coronavirus paired with sentence-level evidence from scientific journal articles and veracity labels. It includes both extracted (journalist-written) and composed (annotator-written) claims. Experiments using both a fact-checking specific system and GPT-3.5, which respectively achieve F1 scores of 76.99 and 69.90 on this task, reveal the difficulty of automatically fact-checking both claim types and the importance of in-domain data for good performance. Our data and models are released publicly at https://github.com/posuer/Check-COVID.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 18 of its 38 references that are in the map. First posted on arXiv 29 May 2023.

Builds on

18 of 38 references.

References · 18

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  4. 2020Fact or Fiction: Verifying Scientific Claimscited by 546
  5. 2019ERASER: A Benchmark to Evaluate Rationalized NLP Modelscited by 523
  6. 2020CORD-19: The COVID-19 Open Research Datasetcited by 179
  7. 2017Automatic Detection of Fake Newscited by 145
  8. 2019Towards Debiasing Fact Verification Modelscited by 143
  9. 2021COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemiccited by 100
  10. 2020CoAID: COVID-19 Healthcare Misinformation Datasetcited by 83
  11. 2020Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Societycited by 72
  12. 2021Towards Few-Shot Fact-Checking via Perplexitycited by 63
6 more
  1. 2020FakeCovid -- A Multilingual Cross-domain Fact Check News Dataset for COVID-19cited by 60
  2. 2022CoVERT: A Corpus of Fact-checked Biomedical COVID-19 Tweetscited by 29
  3. 2020A Benchmark Dataset of Check-worthy Factual Claimscited by 27
  4. 2019Proppy: A System to Unmask Propaganda in Online Newscited by 16
  5. 2020Misinformation Has High Perplexitycited by 15
  6. 2020Two Stage Transformer Model for COVID-19 Fake News Detection and Fact Checkingcited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 8; 2025: 7; 2026: 9.

25 papers.

Sort:

By area:

  1. 2024Evidence-Driven Retrieval Augmented Response Generation for Online Misinformationcited by 32
  2. 2024Retrieval Augmented Fact Verification by Synthesizing Contrastive Argumentscited by 25
  3. 2024Claim Verification in the Age of Large Language Models: A Surveycited by 23
  4. 2024Generative Large Language Models in Automated Fact-Checking: A Surveycited by 19
  5. 2024A Guide to Misinformation Detection Data and Evaluationcited by 10
  6. 2024Can Large Language Models Detect Misinformation in Scientific News Reporting?cited by 9
  7. 2023Are Large Language Models Good Fact Checkers: A Preliminary Studycited by 8
  8. 2025From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systemscited by 8
  9. 2025The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Paperscited by 6
  10. 2025CORRECT: Context- and Reference-Augmented Reasoning and Prompting for Fact-Checkingcited by 5
  11. 2026All That Glisters Is Not Gold: A Benchmark for Reference-Free Counterfactual Financial Misinformation Detectioncited by 4
  12. 2026Courtroom-Style Multi-Agent Debate with Progressive RAG and Role-Switching for Controversial Claim Verificationcited by 4
13 more
  1. 2025Speaking at the Right Level: Literacy-Controlled Counterspeech Generation with RAG-RLcited by 3
  2. 2025A Scoping Review of Natural Language Processing in Addressing Medically Inaccurate Information: Errors, Misinformation, and Hallucinationcited by 2
  3. 2025+VeriRel: Verification Feedback to Enhance Document Retrieval for Scientific Fact Checkingcited by 2
  4. 2025TSVer: A Benchmark for Fact Verification Against Time-Series Evidencecited by 2
  5. 2026M2-Verify: A Large-Scale Multidomain Benchmark for Checking Multimodal Claim Consistencycited by 1
  6. 2024Fact-checking based fake news detection: a reviewcited by 0
  7. 2024Bag of Lies: Robustness in Continuous Pre-training BERTcited by 0
  8. 2026MEVER: Multi-Modal and Explainable Claim Verification with Graph-based Evidence Retrievalcited by 0
  9. 2026CommunityFact: A Dynamic, Multilingual, Multi-domain Benchmark for Misinformation Detection in the Wildcited by 0
  10. 2026ToE: A Hierarchical and Explainable Claim Verification Framework with Dynamic Multi-source Evidence Retrieval and Aggregationcited by 0
  11. 2026GPE: Evaluating Robust Evidence Aggregation for Fact Verification under Controllable GEO-Style Poisoningcited by 0
  12. 2026Memory-First Fact-Checking: A Knowledge-Graph-Grounded Multi-Agent System for Misinformation Detectioncited by 0
  13. 2026Evaluating and Improving Evidence-Grounded Fact-Checking in LLMs via Multi-Round Evidence Ablationcited by 0