FACT-GPT: Fact-Checking Augmentation via Claim Matching with LLMs
Not on the map. Why?
Abstract (arXiv)
Our society is facing rampant misinformation harming public health and trust. To address the societal challenge, we introduce FACT-GPT, a system leveraging Large Language Models (LLMs) to automate the claim matching stage of fact-checking. FACT-GPT, trained on a synthetic dataset, identifies social media content that aligns with, contradicts, or is irrelevant to previously debunked claims. Our evaluation shows that our specialized LLMs can match the accuracy of larger models in identifying related claims, closely mirroring human judgment. This research provides an automated solution for efficient claim matching, demonstrates the potential of LLMs in supporting fact-checkers, and offers valuable resources for further research in the field.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Builds on 13 of its 30 references that are in the map. First posted on arXiv 8 Feb 2024.
Builds on
13 of 30 references.
References · 13
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
- 2023ChatGPT: Jack of all trades, master of nonecited by 204
- 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
- 2023Factuality Challenges in the Era of Large Language Modelscited by 126
- 2020That is a Known Lie: Detecting Previously Fact-Checked Claimscited by 82
- 2023Testing the Reliability of ChatGPT for Text Annotation and Classification: A Cautionary Remarkcited by 54
- 2023Reinforcement Learning-based Counter-Misinformation Response Generation: A Case Study of COVID-19 Vaccine Misinformationcited by 39
- 2021Towards Fine-Grained Reasoning for Fake News Detectioncited by 32
- 2021Assisting the Human Fact-Checkers: Detecting All Previously Fact-Checked Claims in a Documentcited by 19
- 2023Retrieving false claims on Twitter during the Russia-Ukraine conflictcited by 5
- 2022Construction of Large-Scale Misinformation Labeled Datasets from Social Media Discourse using Label Refinementcited by 4
1 more
Built on by
Citing papers per year: 2024: 9; 2025: 15; 2026: 3.
27 papers.
Sort:
By area:
- 2024LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Textscited by 87
- 2024Retrieval Augmented Fact Verification by Synthesizing Contrastive Argumentscited by 25
- 2024Detecting AI-Generated Text: Factors Influencing Detectability with Current Methodscited by 23
- 2024LLM Uncertainty Quantification through Directional Entailment Graph and Claim Level Response Augmentationcited by 23
- 2024Generative Large Language Models in Automated Fact-Checking: A Surveycited by 19
- 2025Uncertainty Quantification of Large Language Models through Multi-Dimensional Responsescited by 18
- 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Modelscited by 13
- 2025Zero-shot and Few-shot Learning with Instruction-following LLMs for Claim Matching in Automated Fact-checkingcited by 12
- 2025RealFactBench: A Benchmark for Evaluating Large Language Models in Real-World Fact-Checkingcited by 9
- 2025Limited Effectiveness of LLM-based Data Augmentation for COVID-19 Misinformation Stance Detectioncited by 7
- 2024LlamaLens: Specialized Multilingual LLM for Analyzing News and Social Media Contentcited by 6
- 2025Large Language Models for Multilingual Previously Fact-Checked Claim Detectioncited by 6
15 more
- 2025RAMA: Retrieval-Augmented Multi-Agent Framework for Misinformation Detection in Multimodal Fact-Checkingcited by 5
- 2024FactGenius: Combining Zero-Shot Prompting and Fuzzy Relation Mining to Improve Fact Verification with Knowledge Graphscited by 4
- 2025STRIVE: Structured Reasoning for Self-Improvement in Claim Verificationcited by 3
- 2025Assessing the Potential of Generative Agents in Crowdsourced Fact-Checkingcited by 3
- 2024VERITAS-NLI : Validation and Extraction of Reliable Information Through Automated Scraping and Natural Language Inferencecited by 1
- 2025A Generative-AI-Driven Claim Retrieval System Capable of Detecting and Retrieving Claims from Social Media Platforms in Multiple Languagescited by 1
- 2025Entailed Opinion Matters: Improving the Fact-Checking Performance of Language Models by Relying on their Entailment Abilitycited by 1
- 2026How Human Feedback Shapes AI-generated Community Notescited by 1
- 2024ViMGuard: A Novel Multi-Modal System for Video Misinformation Guardingcited by 0
- 2025Enhancing Multi-Hop Fact Verification with Structured Knowledge-Augmented Large Language Modelscited by 0
- 2025(Fact) Check Your Biascited by 0
- 2025Agent-based Automated Claim Matching with Instruction-following LLMscited by 0
- 2025Use of Retrieval-Augmented Large Language Model Agent for Long-Form COVID-19 Fact-Checkingcited by 0
- 2026Angry but Accurate: Detecting and Profiling the Counter-Misinformation Ecosystem on Twittercited by 0
- 2026Detecting and Explaining Fake News Short Videos with Multimodal Content and Real-World Evidencecited by 0
- 2026Detecting and Explaining Fake News Short Videos with Multimodal Content and Real-World Evidence11 Sep 2026
- 2026Angry but Accurate: Detecting and Profiling the Counter-Misinformation Ecosystem on Twitter3 Jul 2026
- 2026How Human Feedback Shapes AI-generated Community Notes29 Jun 2026
- 2025Agent-based Automated Claim Matching with Instruction-following LLMs27 Oct 2025
- 2025Use of Retrieval-Augmented Large Language Model Agent for Long-Form COVID-19 Fact-Checking10 Oct 2025
- 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Models5 Aug 2025
- 2025RAMA: Retrieval-Augmented Multi-Agent Framework for Misinformation Detection in Multimodal Fact-Checking12 Jul 2025
- 2025(Fact) Check Your Bias26 Jun 2025
- 2025RealFactBench: A Benchmark for Evaluating Large Language Models in Real-World Fact-Checking14 Jun 2025
- 2025Entailed Opinion Matters: Improving the Fact-Checking Performance of Language Models by Relying on their Entailment Ability21 May 2025
- 2025A Generative-AI-Driven Claim Retrieval System Capable of Detecting and Retrieving Claims from Social Media Platforms in Multiple Languages29 Apr 2025
- 2025Assessing the Potential of Generative Agents in Crowdsourced Fact-Checking24 Apr 2025
15 more
- 2025Enhancing Multi-Hop Fact Verification with Structured Knowledge-Augmented Large Language Models11 Mar 2025
- 2025Large Language Models for Multilingual Previously Fact-Checked Claim Detection4 Mar 2025
- 2025Limited Effectiveness of LLM-based Data Augmentation for COVID-19 Misinformation Stance Detection4 Mar 2025
- 2025Uncertainty Quantification of Large Language Models through Multi-Dimensional Responses24 Feb 2025
- 2025STRIVE: Structured Reasoning for Self-Improvement in Claim Verification17 Feb 2025
- 2025Zero-shot and Few-shot Learning with Instruction-following LLMs for Claim Matching in Automated Fact-checking18 Jan 2025
- 2024LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Texts31 Dec 2024
- 2024ViMGuard: A Novel Multi-Modal System for Video Misinformation Guarding22 Oct 2024
- 2024LlamaLens: Specialized Multilingual LLM for Analyzing News and Social Media Content20 Oct 2024
- 2024VERITAS-NLI : Validation and Extraction of Reliable Information Through Automated Scraping and Natural Language Inference12 Oct 2024
- 2024Generative Large Language Models in Automated Fact-Checking: A Survey2 Jul 2024
- 2024LLM Uncertainty Quantification through Directional Entailment Graph and Claim Level Response Augmentation1 Jul 2024
- 2024Detecting AI-Generated Text: Factors Influencing Detectability with Current Methods21 Jun 2024
- 2024Retrieval Augmented Fact Verification by Synthesizing Contrastive Arguments14 Jun 2024
- 2024FactGenius: Combining Zero-Shot Prompting and Fuzzy Relation Mining to Improve Fact Verification with Knowledge Graphs3 Jun 2024
- 2024Retrieval Augmented Fact Verification by Synthesizing Contrastive Argumentscited by 25
- 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Modelscited by 13
- 2025RAMA: Retrieval-Augmented Multi-Agent Framework for Misinformation Detection in Multimodal Fact-Checkingcited by 5
- 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Models5 Aug 2025
- 2025RAMA: Retrieval-Augmented Multi-Agent Framework for Misinformation Detection in Multimodal Fact-Checking12 Jul 2025
- 2024Retrieval Augmented Fact Verification by Synthesizing Contrastive Arguments14 Jun 2024
- 2026How Human Feedback Shapes AI-generated Community Notescited by 1
- 2026How Human Feedback Shapes AI-generated Community Notes29 Jun 2026
- 2024LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Textscited by 87
- 2024Detecting AI-Generated Text: Factors Influencing Detectability with Current Methodscited by 23
- 2024LLM Uncertainty Quantification through Directional Entailment Graph and Claim Level Response Augmentationcited by 23
- 2024Generative Large Language Models in Automated Fact-Checking: A Surveycited by 19
- 2025Uncertainty Quantification of Large Language Models through Multi-Dimensional Responsescited by 18
- 2025Zero-shot and Few-shot Learning with Instruction-following LLMs for Claim Matching in Automated Fact-checkingcited by 12
- 2025RealFactBench: A Benchmark for Evaluating Large Language Models in Real-World Fact-Checkingcited by 9
- 2025Limited Effectiveness of LLM-based Data Augmentation for COVID-19 Misinformation Stance Detectioncited by 7
- 2024LlamaLens: Specialized Multilingual LLM for Analyzing News and Social Media Contentcited by 6
- 2025Large Language Models for Multilingual Previously Fact-Checked Claim Detectioncited by 6
- 2024FactGenius: Combining Zero-Shot Prompting and Fuzzy Relation Mining to Improve Fact Verification with Knowledge Graphscited by 4
- 2024VERITAS-NLI : Validation and Extraction of Reliable Information Through Automated Scraping and Natural Language Inferencecited by 1
12 most cited of 20 All 20 (JSON)
- 2026Detecting and Explaining Fake News Short Videos with Multimodal Content and Real-World Evidence11 Sep 2026
- 2026Angry but Accurate: Detecting and Profiling the Counter-Misinformation Ecosystem on Twitter3 Jul 2026
- 2025Use of Retrieval-Augmented Large Language Model Agent for Long-Form COVID-19 Fact-Checking10 Oct 2025
- 2025(Fact) Check Your Bias26 Jun 2025
- 2025RealFactBench: A Benchmark for Evaluating Large Language Models in Real-World Fact-Checking14 Jun 2025
- 2025Entailed Opinion Matters: Improving the Fact-Checking Performance of Language Models by Relying on their Entailment Ability21 May 2025
- 2025A Generative-AI-Driven Claim Retrieval System Capable of Detecting and Retrieving Claims from Social Media Platforms in Multiple Languages29 Apr 2025
- 2025Enhancing Multi-Hop Fact Verification with Structured Knowledge-Augmented Large Language Models11 Mar 2025
- 2025Large Language Models for Multilingual Previously Fact-Checked Claim Detection4 Mar 2025
- 2025Limited Effectiveness of LLM-based Data Augmentation for COVID-19 Misinformation Stance Detection4 Mar 2025
- 2025Uncertainty Quantification of Large Language Models through Multi-Dimensional Responses24 Feb 2025
- 2025Zero-shot and Few-shot Learning with Instruction-following LLMs for Claim Matching in Automated Fact-checking18 Jan 2025
12 newest of 20 All 20 (JSON)