mlsanityData to 7 Oct 2026

Overview and Insights from the SciVer Shared Task on Scientific Claim Verification

arXiv 2107.08188 ↗First posted 17 Jul 2021cs.CLcited by 17

Not on the map. Why?

Abstract (arXiv)

We present an overview of the SciVer shared task, presented at the 2nd Scholarly Document Processing (SDP) workshop at NAACL 2021. In this shared task, systems were provided a scientific claim and a corpus of research abstracts, and asked to identify which articles SUPPORT or REFUTE the claim as well as provide evidentiary sentences justifying those labels. 11 teams made a total of 14 submissions to the shared task leaderboard, leading to an improvement of more than +23 F1 on the primary task evaluation metric. In addition to surveying the participating systems, we provide several insights into modeling approaches to support continued progress and future research on the important and challenging task of scientific claim verification.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 15 of its 19 references that are in the map. First posted on arXiv 17 Jul 2021.

Builds on

15 of 19 references.

References · 15

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  5. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  6. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  7. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  8. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  9. 2020Fact or Fiction: Verifying Scientific Claimscited by 546
  10. 2020CORD-19: The COVID-19 Open Research Datasetcited by 179
  11. 2019Fine-grained Fact Verification with Kernel Graph Attention Networkcited by 105
  12. 2018BioSentVec: creating sentence embeddings for biomedical textscited by 47
3 more
  1. 2020Scientific Claim Verification with VERT5ERINIcited by 47
  2. 2020A Paragraph-level Multi-task Learning Model for Scientific Fact-Verificationcited by 29
  3. 2021QMUL-SDS at SCIVER: Step-by-Step Binary Classification for Scientific Claim Verificationcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 2; 2023: 3; 2024: 2; 2025: 3; 2026: 6.

17 papers.

Sort:

  1. 2021MultiVerS: Improving scientific claim verification with weak supervision and full-document contextcited by 140
  2. 2022SciFact-Open: Towards open-domain scientific claim verificationcited by 94
  3. 2023Scientific Fact-Checking: A Survey of Resources and Approachescited by 53
  4. 2023Fin-Fact: A Benchmark Dataset for Multimodal Financial Fact Checking and Explanation Generationcited by 25
  5. 2024Claim Verification in the Age of Large Language Models: A Surveycited by 23
  6. 2025CLAIMCHECK: How Grounded are LLM Critiques of Scientific Papers?cited by 11
  7. 2024Can Large Language Models Detect Misinformation in Scientific News Reporting?cited by 9
  8. 2026BibAgent: An Agentic Framework for Traceable Miscitation Detection in Scientific Literaturecited by 9
  9. 2022Entity-based Claim Representation Improves Fact-Checking of Medical Content in Tweetscited by 7
  10. 2025+VeriRel: Verification Feedback to Enhance Document Retrieval for Scientific Fact Checkingcited by 2
  11. 2023Logically at Factify 2: A Multi-Modal Fact Checking System Based on Evidence Retrieval techniques and Transformer Encoder Architecturecited by 1
  12. 2025Extending FKG.in: Towards a Food Claim Traceability Networkcited by 0
5 more
  1. 2026ClimateCheck 2026: Scientific Fact-Checking and Disinformation Narrative Classification of Climate-related Claimscited by 0
  2. 2026DeepSciVerify: Verifying Scientific Claim--Citation Alignment via LLM-Driven Evidence Escalationcited by 0
  3. 2026Symbolic Augmentation Closes a Canonical-Equivalence Blind Spot in Neural Fact-Checkerscited by 0
  4. 2026Evaluating and Improving Evidence-Grounded Fact-Checking in LLMs via Multi-Round Evidence Ablationcited by 0
  5. 2026Peerify: Benchmarking Peer-Review Claim Verificationcited by 0