Self-Checker: Plug-and-Play Modules for Fact-Checking with Large Language Models
Not on the map. Why?
Abstract (arXiv)
Fact-checking is an essential task in NLP that is commonly utilized for validating the factual accuracy of claims. Prior work has mainly focused on fine-tuning pre-trained languages models on specific datasets, which can be computationally intensive and time-consuming. With the rapid development of large language models (LLMs), such as ChatGPT and GPT-3, researchers are now exploring their in-context learning capabilities for a wide range of tasks. In this paper, we aim to assess the capacity of LLMs for fact-checking by introducing Self-Checker, a framework comprising a set of plug-and-play modules that facilitate fact-checking by purely prompting LLMs in an almost zero-shot setting. This framework provides a fast and efficient way to construct fact-checking systems in low-resource environments. Empirical results demonstrate the potential of Self-Checker in utilizing LLMs for fact-checking. However, there is still significant room for improvement compared to SOTA fine-tuned models, which suggests that LLM adoption could be a promising approach for future fact-checking research.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 25 of its 41 references that are in the map. First posted on arXiv 24 May 2023.
Builds on
25 of 41 references.
References · 25
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
- 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 425
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2023Evaluating Verifiability in Generative Search Enginescited by 297
- 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
- 2016A Decomposable Attention Model for Natural Language Inferencecited by 214
- 2023Verify-and-Edit: A Knowledge-Enhanced Chain-of-Thought Frameworkcited by 139
13 more
- 2023WiCE: Real-World Entailment for Claims in Wikipediacited by 118
- 2020INFOTABS: Inference on Tables as Semi-structured Datacited by 84
- 2019BERT for Evidence Retrieval and Claim Verificationcited by 57
- 2023FactKG: Fact Verification via Reasoning on Knowledge Graphscited by 57
- 2021Automated Fact-Checking: A Surveycited by 55
- 2021ProoFVer: Natural Logic Theorem Proving for Fact Verificationcited by 52
- 2021A Survey on Multimodal Disinformation Detectioncited by 47
- 2020Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Mediacited by 46
- 2020Evidence-based Factual Error Correctioncited by 44
- 2018Overview of the CLEF-2018 CheckThat! Lab on Automatic Identification and Verification of Political Claims. Task 1: Check-Worthinesscited by 41
- 2021FRUIT: Faithfully Reflecting Updated Information in Textcited by 39
- 2023Zero-shot Faithful Factual Error Correctioncited by 26
- 2023BEVERS: A General, Simple, and Performant Framework for Automatic Fact Verificationcited by 11
Built on by
Citing papers per year: 2023: 7; 2024: 11; 2025: 8; 2026: 5.
31 papers.
Sort:
By area:
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
- 2023Cognitive Mirage: A Review of Hallucinations in Large Language Modelscited by 83
- 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 42
- 2024Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales?cited by 40
- 2024Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Modelscited by 27
- 2024Claim Verification in the Age of Large Language Models: A Surveycited by 23
- 2024Pelican: Correcting Hallucination in Vision-LLMs via Claim Decomposition and Program of Thought Verificationcited by 17
- 2024Understanding the Effects of Iterative Prompting on Truthfulnesscited by 14
- 2023StrategyLLM: Large Language Models as Strategy Generators, Executors, Optimizers, and Evaluators for Problem Solvingcited by 13
- 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Modelscited by 13
- 2023AutoHall: Automated Factuality Hallucination Dataset Generation for Large Language Modelscited by 10
19 more
- 2024Assessing the Reasoning Capabilities of LLMs in the context of Evidence-based Claim Verificationcited by 9
- 2025Orchestrating Agents and Data for Enterprise: A Blueprint Architecture for Compound AIcited by 9
- 2024Re-Ex: Revising after Explanation Reduces the Factual Errors in LLM Responsescited by 6
- 2024SELU: Self-Learning Embodied MLLMs in Unknown Environmentscited by 6
- 2025Evaluating open-source Large Language Models for automated fact-checkingcited by 6
- 2023Generating Explanations to Understand and Repair Embedding-based Entity Alignmentcited by 5
- 2023KGQuiz: Evaluating the Generalization of Encoded Knowledge in Large Language Modelscited by 4
- 2024Familiarity-Aware Evidence Compression for Retrieval-Augmented Generationcited by 4
- 2025MAD-Fact: A Multi-Agent Debate Framework for Long-Form Factuality Evaluation in LLMscited by 4
- 2025STRIVE: Structured Reasoning for Self-Improvement in Claim Verificationcited by 3
- 2024Mining the Explainability and Generalization: Fact Verification Based on Self-Instructioncited by 0
- 2025Towards Robust Fact-Checking: A Multi-Agent System with Advanced Evidence Retrievalcited by 0
- 2025Sample, Align, Synthesize: Graph-Based Response Synthesis with ConGrscited by 0
- 2025EmeraldMind: A Knowledge Graph-Augmented Framework for Greenwashing Detectioncited by 0
- 2026Fact-Checking with Large Language Models via Probabilistic Certainty and Consistencycited by 0
- 2026MERMAID: Memory-Enhanced Retrieval and Reasoning with Multi-Agent Iterative Knowledge Grounding for Veracity Assessmentcited by 0
- 2026The Alignment Bottleneck in Decomposition-Based Claim Verificationcited by 0
- 2026NTS-CoT: Mitigating Hallucinations in LLM-based News Timeline Summarization with Chain-of-Thought Reasoningcited by 0
- 2026Hallucinations in LLMs: A Lifecycle-Based Survey of Causes, Detection, Mitigation, and Preventioncited by 0
- 2026Hallucinations in LLMs: A Lifecycle-Based Survey of Causes, Detection, Mitigation, and Prevention20 Jul 2026
- 2026NTS-CoT: Mitigating Hallucinations in LLM-based News Timeline Summarization with Chain-of-Thought Reasoning11 Jun 2026
- 2026The Alignment Bottleneck in Decomposition-Based Claim Verification11 Feb 2026
- 2026MERMAID: Memory-Enhanced Retrieval and Reasoning with Multi-Agent Iterative Knowledge Grounding for Veracity Assessment29 Jan 2026
- 2026Fact-Checking with Large Language Models via Probabilistic Certainty and Consistency5 Jan 2026
- 2025EmeraldMind: A Knowledge Graph-Augmented Framework for Greenwashing Detection12 Dec 2025
- 2025MAD-Fact: A Multi-Agent Debate Framework for Long-Form Factuality Evaluation in LLMs27 Oct 2025
- 2025Sample, Align, Synthesize: Graph-Based Response Synthesis with ConGrs3 Oct 2025
- 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Models5 Aug 2025
- 2025Towards Robust Fact-Checking: A Multi-Agent System with Advanced Evidence Retrieval22 Jun 2025
- 2025Orchestrating Agents and Data for Enterprise: A Blueprint Architecture for Compound AI10 Apr 2025
- 2025Evaluating open-source Large Language Models for automated fact-checking7 Mar 2025
19 more
- 2025STRIVE: Structured Reasoning for Self-Improvement in Claim Verification17 Feb 2025
- 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Experts13 Dec 2024
- 2024Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales?31 Oct 2024
- 2024SELU: Self-Learning Embodied MLLMs in Unknown Environments4 Oct 2024
- 2024Familiarity-Aware Evidence Compression for Retrieval-Augmented Generation19 Sep 2024
- 2024Claim Verification in the Age of Large Language Models: A Survey26 Aug 2024
- 2024Pelican: Correcting Hallucination in Vision-LLMs via Claim Decomposition and Program of Thought Verification2 Jul 2024
- 2024Mining the Explainability and Generalization: Fact Verification Based on Self-Instruction21 May 2024
- 2024Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models26 Mar 2024
- 2024Re-Ex: Revising after Explanation Reduces the Factual Errors in LLM Responses27 Feb 2024
- 2024Assessing the Reasoning Capabilities of LLMs in the context of Evidence-based Claim Verification16 Feb 2024
- 2024Understanding the Effects of Iterative Prompting on Truthfulness9 Feb 2024
- 2023Generating Explanations to Understand and Repair Embedding-based Entity Alignment8 Dec 2023
- 2023StrategyLLM: Large Language Models as Strategy Generators, Executors, Optimizers, and Evaluators for Problem Solving15 Nov 2023
- 2023KGQuiz: Evaluating the Generalization of Encoded Knowledge in Large Language Models15 Oct 2023
- 2023AutoHall: Automated Factuality Hallucination Dataset Generation for Large Language Models30 Sep 2023
- 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep 2023
- 2023Cognitive Mirage: A Review of Hallucinations in Large Language Models13 Sep 2023
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models3 Sep 2023
- 2024Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales?cited by 40
- 2024Pelican: Correcting Hallucination in Vision-LLMs via Claim Decomposition and Program of Thought Verificationcited by 17
- 2023StrategyLLM: Large Language Models as Strategy Generators, Executors, Optimizers, and Evaluators for Problem Solvingcited by 13
- 2024Assessing the Reasoning Capabilities of LLMs in the context of Evidence-based Claim Verificationcited by 9
- 2025STRIVE: Structured Reasoning for Self-Improvement in Claim Verificationcited by 3
- 2026MERMAID: Memory-Enhanced Retrieval and Reasoning with Multi-Agent Iterative Knowledge Grounding for Veracity Assessmentcited by 0
- 2026NTS-CoT: Mitigating Hallucinations in LLM-based News Timeline Summarization with Chain-of-Thought Reasoningcited by 0
- 2026NTS-CoT: Mitigating Hallucinations in LLM-based News Timeline Summarization with Chain-of-Thought Reasoning11 Jun 2026
- 2026MERMAID: Memory-Enhanced Retrieval and Reasoning with Multi-Agent Iterative Knowledge Grounding for Veracity Assessment29 Jan 2026
- 2025STRIVE: Structured Reasoning for Self-Improvement in Claim Verification17 Feb 2025
- 2024Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales?31 Oct 2024
- 2024Pelican: Correcting Hallucination in Vision-LLMs via Claim Decomposition and Program of Thought Verification2 Jul 2024
- 2024Assessing the Reasoning Capabilities of LLMs in the context of Evidence-based Claim Verification16 Feb 2024
- 2023StrategyLLM: Large Language Models as Strategy Generators, Executors, Optimizers, and Evaluators for Problem Solving15 Nov 2023
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2025Orchestrating Agents and Data for Enterprise: A Blueprint Architecture for Compound AIcited by 9
- 2025MAD-Fact: A Multi-Agent Debate Framework for Long-Form Factuality Evaluation in LLMscited by 4
- 2025Towards Robust Fact-Checking: A Multi-Agent System with Advanced Evidence Retrievalcited by 0
- 2025EmeraldMind: A Knowledge Graph-Augmented Framework for Greenwashing Detectioncited by 0
- 2025EmeraldMind: A Knowledge Graph-Augmented Framework for Greenwashing Detection12 Dec 2025
- 2025MAD-Fact: A Multi-Agent Debate Framework for Long-Form Factuality Evaluation in LLMs27 Oct 2025
- 2025Towards Robust Fact-Checking: A Multi-Agent System with Advanced Evidence Retrieval22 Jun 2025
- 2025Orchestrating Agents and Data for Enterprise: A Blueprint Architecture for Compound AI10 Apr 2025
- 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep 2023
- 2024Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Modelscited by 27
- 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Modelscited by 13
- 2024Familiarity-Aware Evidence Compression for Retrieval-Augmented Generationcited by 4
- 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Models5 Aug 2025
- 2024Familiarity-Aware Evidence Compression for Retrieval-Augmented Generation19 Sep 2024
- 2024Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models26 Mar 2024
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
- 2023Cognitive Mirage: A Review of Hallucinations in Large Language Modelscited by 83
- 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 42
- 2024Claim Verification in the Age of Large Language Models: A Surveycited by 23
- 2024Understanding the Effects of Iterative Prompting on Truthfulnesscited by 14
- 2023AutoHall: Automated Factuality Hallucination Dataset Generation for Large Language Modelscited by 10
- 2024Re-Ex: Revising after Explanation Reduces the Factual Errors in LLM Responsescited by 6
- 2025Evaluating open-source Large Language Models for automated fact-checkingcited by 6
- 2023Generating Explanations to Understand and Repair Embedding-based Entity Alignmentcited by 5
- 2023KGQuiz: Evaluating the Generalization of Encoded Knowledge in Large Language Modelscited by 4
- 2025Sample, Align, Synthesize: Graph-Based Response Synthesis with ConGrscited by 0
- 2026Fact-Checking with Large Language Models via Probabilistic Certainty and Consistencycited by 0
12 most cited of 14 All 14 (JSON)
- 2026Hallucinations in LLMs: A Lifecycle-Based Survey of Causes, Detection, Mitigation, and Prevention20 Jul 2026
- 2026The Alignment Bottleneck in Decomposition-Based Claim Verification11 Feb 2026
- 2026Fact-Checking with Large Language Models via Probabilistic Certainty and Consistency5 Jan 2026
- 2025Sample, Align, Synthesize: Graph-Based Response Synthesis with ConGrs3 Oct 2025
- 2025Evaluating open-source Large Language Models for automated fact-checking7 Mar 2025
- 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Experts13 Dec 2024
- 2024Claim Verification in the Age of Large Language Models: A Survey26 Aug 2024
- 2024Re-Ex: Revising after Explanation Reduces the Factual Errors in LLM Responses27 Feb 2024
- 2024Understanding the Effects of Iterative Prompting on Truthfulness9 Feb 2024
- 2023Generating Explanations to Understand and Repair Embedding-based Entity Alignment8 Dec 2023
- 2023KGQuiz: Evaluating the Generalization of Encoded Knowledge in Large Language Models15 Oct 2023
- 2023AutoHall: Automated Factuality Hallucination Dataset Generation for Large Language Models30 Sep 2023
12 newest of 14 All 14 (JSON)