mlsanityData to 14 Oct 2026

Uncertainty Quantification for Hallucination Detection in Large Language Models: Foundations, Methodology, and Future Directions

arXiv 2510.12040 ↗First posted 14 Oct 2025cs.CLcited by 11

Not on the map. Why?

Abstract (arXiv)

The rapid advancement of large language models (LLMs) has transformed the landscape of natural language processing, enabling breakthroughs across a wide range of areas including question answering, machine translation, and text summarization. Yet, their deployment in real-world applications has raised concerns over reliability and trustworthiness, as LLMs remain prone to hallucinations that produce plausible but factually incorrect outputs. Uncertainty quantification (UQ) has emerged as a central research direction to address this issue, offering principled measures for assessing the trustworthiness of model generations. We begin by introducing the foundations of UQ, from its formal definition to the traditional distinction between epistemic and aleatoric uncertainty, and then highlight how these concepts have been adapted to the context of LLMs. Building on this, we examine the role of UQ in hallucination detection, where quantifying uncertainty provides a mechanism for identifying unreliable generations and improving reliability. We systematically categorize a wide spectrum of existing methods along multiple dimensions and present empirical results for several representative approaches. Finally, we discuss current limitations and outline promising future research directions, providing a clearer picture of the current landscape of LLM UQ for hallucination detection.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 53 of its 79 references that are in the map. First posted on arXiv 14 Oct 2025.

Builds on

53 of 79 references.

References · 53

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2017On Calibration of Modern Neural Networkscited by 4,960
  5. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  6. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  7. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  8. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  9. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  10. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
  11. 2016Variational Inference: A Review for Statisticianscited by 1,472
  12. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
38 more
  1. 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 913
  2. 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
  3. 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 812
  4. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 692
  5. 2023The Internal State of an LLM Knows When It's Lyingcited by 659
  6. 2023Active Retrieval Augmented Generationcited by 516
  7. 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 324
  8. 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 323
  9. 2023Generating with Confidence: Uncertainty Quantification for Black-box Large Language Modelscited by 293
  10. 2024Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMscited by 259
  11. 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 251
  12. 2024Don't Hallucinate, Abstain: Identifying LLM Knowledge Gaps via Multi-LLM Collaborationcited by 180
  13. 2015Kernel Interpolation for Scalable Structured Gaussian Processes (KISS-GP)cited by 177
  14. 2024Kernel Language Entropy: Fine-grained Uncertainty Quantification for LLMs from Semantic Similaritiescited by 159
  15. 2023LM vs LM: Detecting Factual Errors via Cross Examinationcited by 156
  16. 2023Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Modelscited by 150
  17. 2024Lookback Lens: Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Mapscited by 142
  18. 2023Verify-and-Edit: A Knowledge-Enhanced Chain-of-Thought Frameworkcited by 139
  19. 2023Solving Math Word Problems by Combining Language Models With Symbolic Solverscited by 124
  20. 2023Quantifying Uncertainty in Answers from any Language Model and Enhancing their Trustworthinesscited by 122
  21. 2024To Believe or Not to Believe Your LLMcited by 120
  22. 2024Benchmarking Uncertainty Quantification Methods for Large Language Models with LM-Polygraphcited by 105
  23. 2023Enhancing Uncertainty-Based Hallucination Detection with Stronger Focuscited by 99
  24. 2024HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detectioncited by 99
  25. 2022Mutual Information Alleviates Hallucinations in Abstractive Summarizationcited by 68
  26. 2023Knowing What LLMs DO NOT Know: A Simple Yet Effective Self-Detection Methodcited by 51
  27. 2024MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in Generative LLMscited by 46
  28. 2024Towards Uncertainty-Aware Language Agentcited by 32
  29. 2025Position: Uncertainty Quantification Needs Reassessment for Large-language Model Agentscited by 32
  30. 2023Quantification of Uncertainty with Adversarial Modelscited by 28
  31. 2024From Risk to Uncertainty: Generating Predictive Uncertainty Measures via Bayesian Estimationcited by 28
  32. 2024Do Not Design, Learn: A Trainable Scoring Function for Uncertainty Estimation in Generative LLMscited by 23
  33. 2024LLM Uncertainty Quantification through Directional Entailment Graph and Claim Level Response Augmentationcited by 23
  34. 2025Reconsidering LLM Uncertainty Estimation Methods in the Wildcited by 17
  35. 2024Contextualized Sequence Likelihood: Enhanced Confidence Scores for Natural Language Generationcited by 16
  36. 2024On Information-Theoretic Measures of Predictive Uncertaintycited by 16
  37. 2025Language Model Uncertainty Quantification with Attention Chaincited by 14
  38. 2022Deep-Ensemble-Based Uncertainty Quantification in Spatiotemporal Graph Neural Networks for Traffic Forecastingcited by 10

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 8.

11 papers.