Towards Unification of Hallucination Detection and Fact Verification for Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) frequently exhibit hallucinations, generating content that appears fluent and coherent but is factually incorrect. Such errors undermine trust and hinder their adoption in real-world applications. To address this challenge, two distinct research paradigms have emerged: model-centric Hallucination Detection (HD) and text-centric Fact Verification (FV). Despite sharing the same goal, these paradigms have evolved in isolation, using distinct assumptions, datasets, and evaluation protocols. This separation has created a research schism that hinders their collective progress. In this work, we take a decisive step toward bridging this divide. We introduce UniFact, a unified evaluation framework that enables direct, instance-level comparison between FV and HD by dynamically generating model outputs and corresponding factuality labels. Through large-scale experiments across multiple LLM families and detection methods, we reveal three key findings: (1) No paradigm is universally superior; (2) HD and FV capture complementary facets of factual errors; and (3) hybrid approaches that integrate both methods consistently achieve state-of-the-art performance. Beyond benchmarking, we provide the first in-depth analysis of why FV and HD diverged, as well as empirical evidence supporting the need for their unification. The comprehensive experimental results call for a new, integrated research agenda toward unifying Hallucination Detection and Fact Verification in LLMs. We have open-sourced all the code, data, and baseline implementation at: https://github.com/oneal2000/UniFact/
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 38 of its 72 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
38 of 72 references.
References · 38
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
- 2022A Survey on In-context Learningcited by 717
- 2023The Internal State of an LLM Knows When It's Lyingcited by 644
26 more
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 221
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
- 2018Combining Fact Extraction and Verification with Neural Semantic Matching Networkscited by 120
- 2019GEAR: Graph-based Evidence Aggregating and Reasoning for Fact Verificationcited by 100
- 2023Enhancing Uncertainty-Based Hallucination Detection with Stronger Focuscited by 98
- 2023Towards LLM-based Fact Verification on News Claims with a Hierarchical Step-by-Step Prompting Methodcited by 97
- 2017Beyond News Contents: The Role of Social Context for Fake News Detectioncited by 91
- 2019BERT for Evidence Retrieval and Claim Verificationcited by 57
- 2021ProoFVer: Natural Logic Theorem Proving for Fact Verificationcited by 52
- 2024Large Language Model-based Human-Agent Collaboration for Complex Task Solvingcited by 38
- 2024Improving Uncertainty Quantification in Large Language Models via Semantic Embeddingscited by 30
- 2024InterrogateLLM: Zero-Resource Hallucination Detection in LLM-Generated Answerscited by 26
- 2024Knowledge Editing through Chain-of-Thoughtcited by 26
- 2024Towards a Search Engine for Machines: Unified Ranking for Multiple Retrieval-Augmented Large Language Modelscited by 23
- 2025JuDGE: Benchmarking Judgment Document Generation for Chinese Legal Systemcited by 18
- 2023Read it Twice: Towards Faithfully Interpretable Fact Verification by Revisiting Evidencecited by 17
- 2024Mitigating Entity-Level Hallucination in Large Language Modelscited by 17
- 2023Wikiformer: Pre-training with Structured Information of Wikipedia for Ad-hoc Retrievalcited by 15
- 2025SINdex: Semantic INconsistency Index for Hallucination Detection in LLMscited by 14
- 2025SurGE: A Benchmark and Evaluation Framework for Scientific Survey Generationcited by 14
- 2025Joint Evaluation of Answer and Reasoning Consistency for Hallucination Detection in Large Reasoning Modelscited by 13
- 2023THUIR2 at NTCIR-16 Session Search (SS) Taskcited by 12
- 2024LeKUBE: A Legal Knowledge Update BEnchmarkcited by 12
- 2025Decoupling Reasoning and Knowledge Injection for In-Context Knowledge Editingcited by 12
- 2022Reinforcement Learning to Rank Using Coarse-grained Rewardscited by 5
- 2025Generalized Pseudo-Relevance Feedbackcited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.