Uncertainty Quantification for Hallucination Detection in Large Language Models: Foundations, Methodology, and Future Directions
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of large language models (LLMs) has transformed the landscape of natural language processing, enabling breakthroughs across a wide range of areas including question answering, machine translation, and text summarization. Yet, their deployment in real-world applications has raised concerns over reliability and trustworthiness, as LLMs remain prone to hallucinations that produce plausible but factually incorrect outputs. Uncertainty quantification (UQ) has emerged as a central research direction to address this issue, offering principled measures for assessing the trustworthiness of model generations. We begin by introducing the foundations of UQ, from its formal definition to the traditional distinction between epistemic and aleatoric uncertainty, and then highlight how these concepts have been adapted to the context of LLMs. Building on this, we examine the role of UQ in hallucination detection, where quantifying uncertainty provides a mechanism for identifying unreliable generations and improving reliability. We systematically categorize a wide spectrum of existing methods along multiple dimensions and present empirical results for several representative approaches. Finally, we discuss current limitations and outline promising future research directions, providing a clearer picture of the current landscape of LLM UQ for hallucination detection.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 53 of its 79 references that are in the map. First posted on arXiv 14 Oct 2025.
Builds on
53 of 79 references.
References · 53
- 2023GPT-4 Technical Reportcited by 18,396
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2016Variational Inference: A Review for Statisticianscited by 1,472
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
38 more
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 913
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
- 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 812
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 692
- 2023The Internal State of an LLM Knows When It's Lyingcited by 659
- 2023Active Retrieval Augmented Generationcited by 516
- 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 324
- 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 323
- 2023Generating with Confidence: Uncertainty Quantification for Black-box Large Language Modelscited by 293
- 2024Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMscited by 259
- 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 251
- 2024Don't Hallucinate, Abstain: Identifying LLM Knowledge Gaps via Multi-LLM Collaborationcited by 180
- 2015Kernel Interpolation for Scalable Structured Gaussian Processes (KISS-GP)cited by 177
- 2024Kernel Language Entropy: Fine-grained Uncertainty Quantification for LLMs from Semantic Similaritiescited by 159
- 2023LM vs LM: Detecting Factual Errors via Cross Examinationcited by 156
- 2023Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Modelscited by 150
- 2024Lookback Lens: Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Mapscited by 142
- 2023Verify-and-Edit: A Knowledge-Enhanced Chain-of-Thought Frameworkcited by 139
- 2023Solving Math Word Problems by Combining Language Models With Symbolic Solverscited by 124
- 2023Quantifying Uncertainty in Answers from any Language Model and Enhancing their Trustworthinesscited by 122
- 2024To Believe or Not to Believe Your LLMcited by 120
- 2024Benchmarking Uncertainty Quantification Methods for Large Language Models with LM-Polygraphcited by 105
- 2023Enhancing Uncertainty-Based Hallucination Detection with Stronger Focuscited by 99
- 2024HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detectioncited by 99
- 2022Mutual Information Alleviates Hallucinations in Abstractive Summarizationcited by 68
- 2023Knowing What LLMs DO NOT Know: A Simple Yet Effective Self-Detection Methodcited by 51
- 2024MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in Generative LLMscited by 46
- 2024Towards Uncertainty-Aware Language Agentcited by 32
- 2025Position: Uncertainty Quantification Needs Reassessment for Large-language Model Agentscited by 32
- 2023Quantification of Uncertainty with Adversarial Modelscited by 28
- 2024From Risk to Uncertainty: Generating Predictive Uncertainty Measures via Bayesian Estimationcited by 28
- 2024Do Not Design, Learn: A Trainable Scoring Function for Uncertainty Estimation in Generative LLMscited by 23
- 2024LLM Uncertainty Quantification through Directional Entailment Graph and Claim Level Response Augmentationcited by 23
- 2025Reconsidering LLM Uncertainty Estimation Methods in the Wildcited by 17
- 2024Contextualized Sequence Likelihood: Enhanced Confidence Scores for Natural Language Generationcited by 16
- 2024On Information-Theoretic Measures of Predictive Uncertaintycited by 16
- 2025Language Model Uncertainty Quantification with Attention Chaincited by 14
- 2022Deep-Ensemble-Based Uncertainty Quantification in Spatiotemporal Graph Neural Networks for Traffic Forecastingcited by 10
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 8.
11 papers.
- 2025HaluMem: Evaluating Hallucinations in Memory Systems of Agentscited by 54
- 2025Certified Self-Consistency: Statistical Guarantees and Test-Time Training for Reliable Reasoning in LLMscited by 12
- 2026Semantic Uncertainty Quantification of Hallucinations in LLMs: A Quantum Tensor Network Based Methodcited by 7
- 2026On Calibration of Large Language Models: From Response To Capabilitycited by 7
- 2026Hallucinations Undermine Trust; Metacognition is a Way Forwardcited by 5
- 2025HARMONY: Hidden Activation Representations and Model Output-Aware Uncertainty Estimation for Vision-Language Modelscited by 3
- 2026Uncertainty Propagation in LLM-Based Systemscited by 3
- 2026SAVAA: Mitigating Hallucinations in LVLMs via Step-wise Adaptive Visual Attention Amplificationcited by 2
- 2026Sanity Checks for Long-Form Hallucination Detectioncited by 1
- 2026How Do Uncertainty Estimators Align with Hallucination Occurrence in LLMs?cited by 0
- 2026Leveraging Visual Signals for Robust Token-Level Uncertainty in Vision-Language Generationcited by 0
- 2026Leveraging Visual Signals for Robust Token-Level Uncertainty in Vision-Language Generation26 May 2026
- 2026How Do Uncertainty Estimators Align with Hallucination Occurrence in LLMs?26 May 2026
- 2026Sanity Checks for Long-Form Hallucination Detection8 May 2026
- 2026Hallucinations Undermine Trust; Metacognition is a Way Forward2 May 2026
- 2026Uncertainty Propagation in LLM-Based Systems26 Apr 2026
- 2026SAVAA: Mitigating Hallucinations in LVLMs via Step-wise Adaptive Visual Attention Amplification14 Feb 2026
- 2026On Calibration of Large Language Models: From Response To Capability14 Feb 2026
- 2026Semantic Uncertainty Quantification of Hallucinations in LLMs: A Quantum Tensor Network Based Method27 Jan 2026
- 2025HaluMem: Evaluating Hallucinations in Memory Systems of Agents5 Nov 2025
- 2025HARMONY: Hidden Activation Representations and Model Output-Aware Uncertainty Estimation for Vision-Language Models25 Oct 2025
- 2025Certified Self-Consistency: Statistical Guarantees and Test-Time Training for Reliable Reasoning in LLMs20 Oct 2025