Generating Scientific Claims for Zero-Shot Scientific Fact Checking
Not on the map. Why?
Abstract (arXiv)
Automated scientific fact checking is difficult due to the complexity of scientific language and a lack of significant amounts of training data, as annotation requires domain expertise. To address this challenge, we propose scientific claim generation, the task of generating one or more atomic and verifiable claims from scientific sentences, and demonstrate its usefulness in zero-shot fact checking for biomedical claims. We propose CLAIMGEN-BART, a new supervised method for generating claims supported by the literature, as well as KBIN, a novel method for generating claim negations. Additionally, we adapt an existing unsupervised entity-centric method of claim generation to biomedical claims, which we call CLAIMGEN-ENTITY. Experiments on zero-shot fact checking demonstrate that both CLAIMGEN-ENTITY and CLAIMGEN-BART, coupled with KBIN, achieve up to 90% performance of fully supervised models trained on manually annotated claims and evidence. A rigorous evaluation study demonstrates significant improvement in generated claim and negation quality over existing baselines
Key facts. Cited by 59 papers in the map (data through 7 Oct 2026). Builds on 30 of its 46 references that are in the map. First posted on arXiv 24 Mar 2022.
Builds on
30 of 46 references.
References · 30
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
- 2015A large annotated corpus for learning natural language inferencecited by 1,837
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2020Fact or Fiction: Verifying Scientific Claimscited by 546
- 2018Hypothesis Only Baselines in Natural Language Inferencecited by 291
- 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
- 2020Explainable Automated Fact-Checking for Public Health Claimscited by 209
- 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
18 more
- 2020A Survey of Evaluation Metrics Used for NLG Systemscited by 164
- 2021Decontextualization: Making Sentences Stand-Alonecited by 101
- 2021COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemiccited by 100
- 2018Transforming Question Answering Datasets Into Natural Language Inference Datasetscited by 99
- 2021MS2: Multi-Document Summarization of Medical Studiescited by 80
- 2019MedMentions: A Large Biomedical Corpus Annotated with UMLS Conceptscited by 79
- 2019Inferring Which Medical Treatments Work from Reports of Clinical Trialscited by 63
- 2020Scientific Claim Verification with VERT5ERINIcited by 47
- 2021Zero-shot Fact Verification by Claim Generationcited by 42
- 2020Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answeringcited by 41
- 2017A Supervised Approach to Extractive Summarisation of Scientific Paperscited by 33
- 2018Clinical Concept Embeddings Learned from Massive Sources of Multimodal Medical Datacited by 33
- 2020A Paragraph-level Multi-task Learning Model for Scientific Fact-Verificationcited by 29
- 2020Generating Label Cohesive and Well-Formed Adversarial Claimscited by 27
- 2021CiteWorth: Cite-Worthiness Detection for Improved Scientific Document Understandingcited by 17
- 2020NegatER: Unsupervised Discovery of Negatives in Commonsense Knowledge Basescited by 9
- 2017Multi-Task Learning of Keyphrase Boundary Classificationcited by 8
- 2013Broadening the Scope of Nanopublicationscited by 5
Built on by
Citing papers per year: 2022: 5; 2023: 17; 2024: 16; 2025: 15; 2026: 6.
59 papers.
Sort:
By area:
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2023LM vs LM: Detecting Factual Errors via Cross Examinationcited by 155
- 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
- 2022SciFact-Open: Towards open-domain scientific claim verificationcited by 94
- 2024CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklistscited by 87
- 2023Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkerscited by 86
- 2023Scientific Fact-Checking: A Survey of Resources and Approachescited by 53
- 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tablescited by 51
- 2024CiteME: Can Language Models Accurately Cite Scientific Claims?cited by 45
- 2023Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Modelscited by 37
- 2023Zero-shot Faithful Factual Error Correctioncited by 26
- 2024I Don't Know: Explicit Modeling of Uncertainty with an [IDK] Tokencited by 26
38 more
- 2024QuanTemp: A real-world open-domain benchmark for fact-checking numerical claimscited by 22
- 2025Towards Effective Extraction and Evaluation of Factual Claimscited by 18
- 2023DocLens: Multi-aspect Fine-grained Evaluation for Medical Text Generationcited by 16
- 2023APPLS: Evaluating Evaluation Metrics for Plain Language Summarizationcited by 15
- 2024TLDR: Token-Level Detective Reward Model for Large Vision Language Modelscited by 15
- 2022Modeling Information Change in Science Communication with Semantically Matched Paraphrasescited by 14
- 2024SciNews: From Scholarly Complexities to Public Narratives -- A Dataset for Scientific News Report Generationcited by 12
- 2022Fact Checking with Insufficient Evidencecited by 11
- 2024Comparing Knowledge Sources for Open-Domain Scientific Claim Verificationcited by 10
- 2022SciTweets -- A Dataset and Annotation Framework for Detecting Scientific Online Discoursecited by 9
- 2024Can Large Language Models Detect Misinformation in Scientific News Reporting?cited by 9
- 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluatorcited by 9
- 2023SCENE: Self-Labeled Counterfactuals for Extrapolating to Negative Examplescited by 8
- 2023QA-NatVer: Question Answering for Natural Logic-based Fact Verificationcited by 8
- 2023Zero-Shot Fact-Checking with Semantic Triples and Knowledge Graphscited by 8
- 2025Beyond Translation: LLM-Based Data Generation for Multilingual Fact-Checkingcited by 8
- 2022Entity-based Claim Representation Improves Fact-Checking of Medical Content in Tweetscited by 7
- 2025Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Modelscited by 7
- 2025Counterfactual Simulatability of LLM Explanations for Generation Taskscited by 7
- 2023Prompt to be Consistent is Better than Self-Consistent? Few-Shot and Zero-Shot Fact Verification with Pre-trained Language Modelscited by 6
- 2024Heterogeneous Graph Reasoning for Fact Checking over Texts and Tablescited by 5
- 2024Zero-Shot Fact Verification via Natural Logic and Large Language Modelscited by 5
- 2024FactEHR: A Dataset for Evaluating Factuality in Clinical Notes Using LLMscited by 5
- 2023Pipeline and Dataset Generation for Automated Fact-checking in Almost Any Languagecited by 4
- 2025SciClaimHunt: A Large Dataset for Evidence-based Scientific Claim Verificationcited by 4
- 2025PlainQAFact: Retrieval-augmented Factual Consistency Evaluation Metric for Biomedical Plain Language Summarizationcited by 4
- 2025MPCG: Multi-Round Persona-Conditioned Generation for Modeling the Evolution of Misinformation with LLMscited by 4
- 2023Interactively Learning Social Media Representations Improves News Source Factuality Detectioncited by 3
- 2025DxHF: Providing High-Quality Human Feedback for LLM Alignment via Interactive Decompositioncited by 3
- 2024Investigating Factuality in Long-Form Text Generation: The Roles of Self-Known and Self-Unknowncited by 2
- 2025SciClaims: An End-to-End Generative System for Biomedical Claim Analysiscited by 2
- 2025Think Right, Not More: Test-Time Scaling for Numerical Claim Verificationcited by 2
- 2025A Benchmark for Open-Domain Numerical Fact-Checking Enhanced by Claim Decompositioncited by 2
- 2026Med-V1: Small Language Models for Zero-shot and Scalable Biomedical Evidence Attributioncited by 2
- 2024MODOC: A Modular Interface for Flexible Interlinking of Text Retrieval and Text Generation Functionscited by 1
- 2025Hide or Highlight: Understanding the Impact of Factuality Expression on User Trustcited by 1
- 2025The Psychology of Falsehood: A Human-Centric Survey of Misinformation Detectioncited by 1
- 2023Cross-Domain Robustness of Transformer-based Keyphrase Generationcited by 0
50 most cited of 59 All 59 (JSON)
- 2026Peerify: Benchmarking Peer-Review Claim Verification2 Sep 2026
- 2026VetScore: Risk-Weighted Fact Verification for Veterinary Long-Form QA with Citations4 Aug 2026
- 2026Symbolic Augmentation Closes a Canonical-Equivalence Blind Spot in Neural Fact-Checkers19 May 2026
- 2026Language Mutations Sustain the Persistences of Conspiracy Theories on Social Media19 May 2026
- 2026Mask-to-Correct^+: Leveraging Retriever Diversity for Masking-guided Faithful Fact Correction21 Apr 2026
- 2026Med-V1: Small Language Models for Zero-shot and Scalable Biomedical Evidence Attribution5 Mar 2026
- 2025EmeraldMind: A Knowledge Graph-Augmented Framework for Greenwashing Detection12 Dec 2025
- 2025A Benchmark for Open-Domain Numerical Fact-Checking Enhanced by Claim Decomposition24 Oct 2025
- 2025Think Right, Not More: Test-Time Scaling for Numerical Claim Verification26 Sep 2025
- 2025MPCG: Multi-Round Persona-Conditioned Generation for Modeling the Evolution of Misinformation with LLMs20 Sep 2025
- 2025The Psychology of Falsehood: A Human-Centric Survey of Misinformation Detection19 Sep 2025
- 2025Hide or Highlight: Understanding the Impact of Factuality Expression on User Trust9 Aug 2025
38 more
- 2025DxHF: Providing High-Quality Human Feedback for LLM Alignment via Interactive Decomposition24 Jul 2025
- 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluator16 Jul 2025
- 2025Counterfactual Simulatability of LLM Explanations for Generation Tasks27 May 2025
- 2025Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Models20 May 2025
- 2025SciClaims: An End-to-End Generative System for Biomedical Claim Analysis24 Mar 2025
- 2025PlainQAFact: Retrieval-augmented Factual Consistency Evaluation Metric for Biomedical Plain Language Summarization11 Mar 2025
- 2025Beyond Translation: LLM-Based Data Generation for Multilingual Fact-Checking21 Feb 2025
- 2025Towards Effective Extraction and Evaluation of Factual Claims15 Feb 2025
- 2025SciClaimHunt: A Large Dataset for Evidence-based Scientific Claim Verification14 Feb 2025
- 2024FactEHR: A Dataset for Evaluating Factuality in Clinical Notes Using LLMs17 Dec 2024
- 2024I Don't Know: Explicit Modeling of Uncertainty with an [IDK] Token9 Dec 2024
- 2024Investigating Factuality in Long-Form Text Generation: The Roles of Self-Known and Self-Unknown24 Nov 2024
- 2024Health Misinformation in Social Networks: A Survey of IT Approaches24 Oct 2024
- 2024TLDR: Token-Level Detective Reward Model for Large Vision Language Models7 Oct 2024
- 2024Zero-Shot Fact Verification via Natural Logic and Large Language Models4 Oct 2024
- 2024MODOC: A Modular Interface for Flexible Interlinking of Text Retrieval and Text Generation Functions26 Aug 2024
- 2024CiteME: Can Language Models Accurately Cite Scientific Claims?10 Jul 2024
- 2024FinGen: A Dataset for Argument Generation in Finance31 May 2024
- 2024CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklists27 Mar 2024
- 2024Fact Checking Beyond Training Set27 Mar 2024
- 2024SciNews: From Scholarly Complexities to Public Narratives -- A Dataset for Scientific News Report Generation26 Mar 2024
- 2024QuanTemp: A real-world open-domain benchmark for fact-checking numerical claims25 Mar 2024
- 2024Can Large Language Models Detect Misinformation in Scientific News Reporting?22 Feb 2024
- 2024Heterogeneous Graph Reasoning for Fact Checking over Texts and Tables20 Feb 2024
- 2024Comparing Knowledge Sources for Open-Domain Scientific Claim Verification5 Feb 2024
- 2023Zero-Shot Fact-Checking with Semantic Triples and Knowledge Graphs19 Dec 2023
- 2023Cross-Domain Robustness of Transformer-based Keyphrase Generation17 Dec 2023
- 2023Pipeline and Dataset Generation for Automated Fact-checking in Almost Any Language15 Dec 2023
- 2023DocLens: Multi-aspect Fine-grained Evaluation for Medical Text Generation16 Nov 2023
- 2023Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers15 Nov 2023
- 2023QA-NatVer: Question Answering for Natural Logic-based Fact Verification22 Oct 2023
- 2023Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Models8 Oct 2023
- 2023Interactively Learning Social Media Representations Improves News Source Factuality Detection26 Sep 2023
- 2023Prompt to be Consistent is Better than Self-Consistent? Few-Shot and Zero-Shot Fact Verification with Pre-trained Language Models5 Jun 2023
- 2023Scientific Fact-Checking: A Survey of Resources and Approaches26 May 2023
- 2023APPLS: Evaluating Evaluation Metrics for Plain Language Summarization23 May 2023
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation23 May 2023
- 2023LM vs LM: Detecting Factual Errors via Cross Examination22 May 2023
50 newest of 59 All 59 (JSON)
- 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
- 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tablescited by 51
- 2023Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Modelscited by 37
- 2024Heterogeneous Graph Reasoning for Fact Checking over Texts and Tablescited by 5
- 2025Think Right, Not More: Test-Time Scaling for Numerical Claim Verificationcited by 2
- 2025Think Right, Not More: Test-Time Scaling for Numerical Claim Verification26 Sep 2025
- 2024Heterogeneous Graph Reasoning for Fact Checking over Texts and Tables20 Feb 2024
- 2023Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Models8 Oct 2023
- 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables22 May 2023
- 2023Fact-Checking Complex Claims with Program-Guided Reasoning22 May 2023
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2023LM vs LM: Detecting Factual Errors via Cross Examinationcited by 155
- 2022SciFact-Open: Towards open-domain scientific claim verificationcited by 94
- 2024CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklistscited by 87
- 2023Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkerscited by 86
- 2023Scientific Fact-Checking: A Survey of Resources and Approachescited by 53
- 2024CiteME: Can Language Models Accurately Cite Scientific Claims?cited by 45
- 2023Zero-shot Faithful Factual Error Correctioncited by 26
- 2024I Don't Know: Explicit Modeling of Uncertainty with an [IDK] Tokencited by 26
- 2024QuanTemp: A real-world open-domain benchmark for fact-checking numerical claimscited by 22
- 2025Towards Effective Extraction and Evaluation of Factual Claimscited by 18
- 2023DocLens: Multi-aspect Fine-grained Evaluation for Medical Text Generationcited by 16
12 most cited of 50 All 50 (JSON)
- 2026Peerify: Benchmarking Peer-Review Claim Verification2 Sep 2026
- 2026VetScore: Risk-Weighted Fact Verification for Veterinary Long-Form QA with Citations4 Aug 2026
- 2026Symbolic Augmentation Closes a Canonical-Equivalence Blind Spot in Neural Fact-Checkers19 May 2026
- 2026Language Mutations Sustain the Persistences of Conspiracy Theories on Social Media19 May 2026
- 2026Mask-to-Correct^+: Leveraging Retriever Diversity for Masking-guided Faithful Fact Correction21 Apr 2026
- 2026Med-V1: Small Language Models for Zero-shot and Scalable Biomedical Evidence Attribution5 Mar 2026
- 2025A Benchmark for Open-Domain Numerical Fact-Checking Enhanced by Claim Decomposition24 Oct 2025
- 2025MPCG: Multi-Round Persona-Conditioned Generation for Modeling the Evolution of Misinformation with LLMs20 Sep 2025
- 2025The Psychology of Falsehood: A Human-Centric Survey of Misinformation Detection19 Sep 2025
- 2025Hide or Highlight: Understanding the Impact of Factuality Expression on User Trust9 Aug 2025
- 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluator16 Jul 2025
- 2025Counterfactual Simulatability of LLM Explanations for Generation Tasks27 May 2025
12 newest of 50 All 50 (JSON)