GraphCheck: Breaking Long-Term Text Barriers with Extracted Knowledge Graph-Powered Fact-Checking
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are widely used, but they often generate subtle factual errors, especially in long-form text. These errors are fatal in some specialized domains such as medicine. Existing fact-checking with grounding documents methods face two main challenges: (1) they struggle to understand complex multihop relations in long documents, often overlooking subtle factual errors; (2) most specialized methods rely on pairwise comparisons, requiring multiple model calls, leading to high resource and computational costs. To address these challenges, we propose GraphCheck, a fact-checking framework that uses extracted knowledge graphs to enhance text representation. Graph Neural Networks further process these graphs as a soft prompt, enabling LLMs to incorporate structured knowledge more effectively. Enhanced with graph-based reasoning, GraphCheck captures multihop reasoning chains that are often overlooked by existing methods, enabling precise and efficient fact-checking in a single inference call. Experimental results on seven benchmarks spanning both general and medical domains demonstrate up to a 7.1% overall improvement over baseline models. Notably, GraphCheck outperforms existing specialized fact-checkers and achieves comparable performance with state-of-the-art LLMs, such as DeepSeek-V3 and OpenAI-o1, with significantly fewer parameters.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 34 of its 58 references that are in the map. First posted on arXiv 23 Feb 2025.
Builds on
34 of 58 references.
References · 34
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2017Graph Attention Networkscited by 8,923
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,317
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 812
- 2020SummEval: Re-evaluating Summarization Evaluationcited by 674
- 2020Fact or Fiction: Verifying Scientific Claimscited by 554
- 2019Graph Transformer Networkscited by 523
- 2023How Language Model Hallucinations Can Snowballcited by 311
- 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Functioncited by 288
- 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 257
22 more
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 238
- 2020Explainable Automated Fact-Checking for Public Health Claimscited by 211
- 2023GPT4Graph: Can Large Language Models Understand Graph Structured Data ? An Empirical Evaluation and Benchmarkingcited by 210
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 192
- 2023Sources of Hallucination by Large Language Models on Inference Taskscited by 169
- 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoningcited by 128
- 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
- 2022Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectorscited by 104
- 2021COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemiccited by 100
- 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 79
- 2024Can GNN be Good Adapter for LLMs?cited by 71
- 2024A Chain-of-Thought Is as Strong as Its Weakest Link: A Benchmark for Verifiers of Reasoning Chainscited by 65
- 2023FactKG: Fact Verification via Reasoning on Knowledge Graphscited by 57
- 2024Can LLMs Produce Faithful Explanations For Fact-checking? Towards Faithful Explainable Fact-Checking via Multi-Agent Debatecited by 48
- 2022FactGraph: Evaluating Factuality in Summarization with Semantic Graph Representationscited by 41
- 2024KG-Rank: Enhancing Large Language Models for Medical QA with Knowledge Graphs and Ranking Techniquescited by 37
- 2024GraphEval: A Knowledge-Graph Based LLM Hallucination Evaluation Frameworkcited by 30
- 2024Analyzing LLM Behavior in Dialogue Summarization: Unveiling Circumstantial Hallucination Trendscited by 25
- 2023Towards Interpretable and Efficient Automatic Reference-Based Summarization Evaluationcited by 24
- 2023Large Language Models on Wikipedia-Style Survey Generation: an Evaluation in NLP Conceptscited by 11
- 2023AMRFact: Enhancing Summarization Factuality Evaluation with AMR-Driven Negative Samples Generationcited by 11
- 2024Evaluating the Factuality of Large Language Models using Large-Scale Knowledge Graphscited by 10
Built on by
Citing papers per year: 2025: 5; 2026: 7.
12 papers.
- 2025LLMs for Customized Marketing Content Generation and Evaluation at Scalecited by 9
- 2025Quantifying the Impact of Structured Output Format on Large Language Models through Causal Inferencecited by 5
- 2026Multi-Sourced, Multi-Agent Evidence Retrieval for Fact-Checkingcited by 3
- 2025Fact in Fragments: Deconstructing Complex Claims via LLM-based Atomic Fact Extraction and Verificationcited by 2
- 2025Mitigating hallucinations in healthcare LLMs with granular fact-checking and domain-specific adaptationcited by 1
- 2026A Large-Scale Multi-Dimensional Empirical Study of LLMs for Conversation Summarizationcited by 1
- 2025Exploring the Role of Knowledge Graph-Based RAG in Japanese Medical Question Answering with Small-Scale LLMscited by 0
- 2026Global Consistency Repair for Natural-Language Claim Setscited by 0
- 2026KG-Guard: Graph-Based Hallucination Detection for Knowledge Base Question Answeringcited by 0
- 2026Does Finetuning with Scientific Data Increase Hallucinations? A Multi-domain Factuality Evaluation of LLMscited by 0
- 2026Readable but Not Controllable: Neuron-Level Evidence for Medical LLM Hallucinationcited by 0
- 2026A Citation-Grounded Benchmark for Trustworthy Earnings Call Transcript Analysis with Large Language Modelscited by 0
- 2026A Citation-Grounded Benchmark for Trustworthy Earnings Call Transcript Analysis with Large Language Models1 Oct 2026
- 2026Readable but Not Controllable: Neuron-Level Evidence for Medical LLM Hallucination30 Jun 2026
- 2026Does Finetuning with Scientific Data Increase Hallucinations? A Multi-domain Factuality Evaluation of LLMs19 Jun 2026
- 2026A Large-Scale Multi-Dimensional Empirical Study of LLMs for Conversation Summarization14 Jun 2026
- 2026KG-Guard: Graph-Based Hallucination Detection for Knowledge Base Question Answering29 May 2026
- 2026Multi-Sourced, Multi-Agent Evidence Retrieval for Fact-Checking27 Feb 2026
- 2026Global Consistency Repair for Natural-Language Claim Sets20 Jan 2026
- 2025Mitigating hallucinations in healthcare LLMs with granular fact-checking and domain-specific adaptation18 Dec 2025
- 2025Quantifying the Impact of Structured Output Format on Large Language Models through Causal Inference26 Sep 2025
- 2025LLMs for Customized Marketing Content Generation and Evaluation at Scale22 Jun 2025
- 2025Fact in Fragments: Deconstructing Complex Claims via LLM-based Atomic Fact Extraction and Verification9 Jun 2025
- 2025Exploring the Role of Knowledge Graph-Based RAG in Japanese Medical Question Answering with Small-Scale LLMs15 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2024Heterogeneous Graph Reasoning for Fact Checking over Texts and Tables
- 2026Benchmarking Large Language Models for Knowledge Graph Validation
- 2025GraphCheck: Multipath Fact-Checking with Entity-Relationship Graphs
- 2026Beyond Verdicts: A Graph-Based Analysis of Human and LLM Reasoning in Scientific Fact-Checking
- 2025Enhancing Large Language Models with Reliable Knowledge Graphs
- 2023KG-GPT: A General Framework for Reasoning on Knowledge Graphs Using Large Language Models
- 2025FactCG: Enhancing Fact Checkers with Graph-Based Multi-Hop Data
- 2025Hybrid Fact-Checking that Integrates Knowledge Graphs, Large Language Models, and Search-Based Retrieval Agents Improves Interpretable Claim Verification