mlsanityData to 7 Oct 2026

Fact or Fiction: Verifying Scientific Claims

arXiv 2004.14974 ↗First posted 30 Apr 2020cs.CLcited by 546

Not on the map. Why?

Cited by 53 in Retrieval-augmented generation, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We introduce scientific claim verification, a new task to select abstracts from the research literature containing evidence that SUPPORTS or REFUTES a given scientific claim, and to identify rationales justifying each decision. To study this task, we construct SciFact, a dataset of 1.4K expert-written scientific claims paired with evidence-containing abstracts annotated with labels and rationales. We develop baseline models for SciFact, and demonstrate that simple domain adaptation techniques substantially improve performance compared to models trained on Wikipedia or political news. We show that our system is able to verify claims related to COVID-19 by identifying evidence from the CORD-19 corpus. Our experiments indicate that SciFact will provide a challenging testbed for the development of new systems designed to retrieve and reason over corpora containing specialized domain knowledge. Data and code for this new task are publicly available at https://github.com/allenai/scifact. A leaderboard and COVID-19 fact-checking demo are available at https://scifact.apps.allenai.org.

Key facts. Cited by 546 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Apr 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 42; 2022: 43; 2023: 78; 2024: 88; 2025: 120; 2026: 175.

546 papers.

Sort:

By area:

  1. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  2. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  3. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
  4. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
  5. 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 508
  6. 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 464
  7. 2021A Survey on Automated Fact-Checkingcited by 376
  8. 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 326
  9. 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
  10. 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 255
  11. 2024MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queriescited by 253
  12. 2023Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2cited by 227
38 more
  1. 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 182
  2. 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
  3. 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 166
  4. 2024Fact-Checking the Output of Large Language Models via Token-Level Uncertainty Quantificationcited by 159
  5. 2024BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrievalcited by 153
  6. 2023Query2doc: Query Expansion with Large Language Modelscited by 146
  7. 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
  8. 2024Fine-grained Hallucination Detection and Editing for Language Modelscited by 146
  9. 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
  10. 2021MultiVerS: Improving scientific claim verification with weak supervision and full-document contextcited by 140
  11. 2021Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processingcited by 126
  12. 2024Language agents achieve superhuman synthesis of scientific knowledgecited by 121
  13. 2021GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrievalcited by 119
  14. 2024VERISCORE: Evaluating the factuality of verifiable claims in long-form text generationcited by 114
  15. 2022Task-aware Retrieval with Instructionscited by 107
  16. 2023Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documentscited by 103
  17. 2021COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemiccited by 100
  18. 2025On the Theoretical Limitations of Embedding-Based Retrievalcited by 98
  19. 2023LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarizationcited by 96
  20. 2022SciFact-Open: Towards open-domain scientific claim verificationcited by 94
  21. 2021Time Waits for No One! Analysis and Challenges of Temporal Misalignmentcited by 91
  22. 2024The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Modelscited by 87
  23. 2024BM25S: Orders of magnitude faster lexical search via eager sparse scoringcited by 87
  24. 2023Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkerscited by 86
  25. 2021MS2: Multi-Document Summarization of Medical Studiescited by 80
  26. 2024One Thousand and One Pairs: A "novel" challenge for long-context language modelscited by 80
  27. 2022Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddingscited by 75
  28. 2023Automatic Evaluation of Attribution by Large Language Modelscited by 70
  29. 2023Self-Knowledge Guided Retrieval Augmentation for Large Language Modelscited by 69
  30. 2025Rank1: Test-Time Compute for Reranking in Information Retrievalcited by 68
  31. 2022Generating Literal and Implied Subquestions to Fact-check Complex Claimscited by 66
  32. 2021Can We Automate Scientific Reviewing?cited by 63
  33. 2021DialFact: A Benchmark for Fact-Checking in Dialoguecited by 62
  34. 2022Generating Scientific Claims for Zero-Shot Scientific Fact Checkingcited by 59
  35. 2025A Survey of LLM-based Deep Search Agents: Paradigm, Optimization, Evaluation, and Challengescited by 58
  36. 2021Automated Fact-Checking: A Surveycited by 55
  37. 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledgecited by 55
  38. 2023Scientific Fact-Checking: A Survey of Resources and Approachescited by 53

50 most cited of 546 All 546 (JSON)