D2HScore: Reasoning-Aware Hallucination Detection via Semantic Breadth and Depth Analysis in LLMs
On the map: LLM reasoning → Hallucination detection and mitigation
Abstract (arXiv)
Although large Language Models (LLMs) have achieved remarkable success, their practical application is often hindered by the generation of non-factual content, which is called "hallucination". Ensuring the reliability of LLMs' outputs is a critical challenge, particularly in high-stakes domains such as finance, security, and healthcare. In this work, we revisit hallucination detection from the perspective of model architecture and generation dynamics. Leveraging the multi-layer structure and autoregressive decoding process of LLMs, we decompose hallucination signals into two complementary dimensions: the semantic breadth of token representations within each layer, and the semantic depth of core concepts as they evolve across layers. Based on this insight, we propose D2HScore (Dispersion and Drift-based Hallucination Score), a training-free and label-free framework that jointly measures: (1) Intra-Layer Dispersion, which quantifies the semantic diversity of token representations within each layer; and (2) Inter-Layer Drift, which tracks the progressive transformation of key token representations across layers. To ensure drift reflects the evolution of meaningful semantics rather than noisy or redundant tokens, we guide token selection using attention signals. By capturing both the horizontal and vertical dynamics of representation during inference, D2HScore provides an interpretable and lightweight proxy for hallucination detection. Extensive experiments across five open-source LLMs and five widely used benchmarks demonstrate that D2HScore consistently outperforms existing training-free baselines.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Hallucination detection and mitigation, one of 17 directions in LLM reasoning. Builds on 21 of its 31 references that are in the map. First posted on arXiv 15 Sep 2025.
Builds on
21 of 31 references.
References · 21
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023A Survey of Large Language Modelscited by 2,537
- 2022Language Models (Mostly) Know What They Knowcited by 1,783
- 2024OpenAI o1 System Cardcited by 1,220
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
- 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 518
9 more
- 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 317
- 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 300
- 2022Prompting GPT-3 To Be Reliablecited by 258
- 2025WritingBench: A Comprehensive Benchmark for Generative Writingcited by 95
- 2023SAC3: Reliable Hallucination Detection in Black-Box Language Models via Semantic-aware Cross-check Consistencycited by 89
- 2024Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Modelscited by 84
- 2024Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluationcited by 56
- 2024SPUQ: Perturbation-Based Uncertainty Quantification for Large Language Modelscited by 54
- 2024Small Agent Can Also Rock! Empowering Small Language Models as Hallucination Detectorcited by 20
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Seeing but Not Thinking: Routing Distraction in Multimodal Mixture-of-Expertscited by 8
- 2026HalluGuard: Demystifying Data-Driven and Reasoning-Driven Hallucinations in LLMscited by 5
- 2026Does Bielik Know What It Doesn't Know? Activation Dispersion Separates Entity Familiarity from Factual Reliability Across Model Scalecited by 1
- 2026Useful Features, Backward Scores: OOD in Language-Model Trajectoriescited by 0
- 2026Graded Entity-Familiarity Readouts in Language Models: Polish Adaptation, Cross-Language Robustness, and Refusal Steeringcited by 0
- 2026Graded Entity-Familiarity Readouts in Language Models: Polish Adaptation, Cross-Language Robustness, and Refusal Steering15 Jul 2026
- 2026Does Bielik Know What It Doesn't Know? Activation Dispersion Separates Entity Familiarity from Factual Reliability Across Model Scale8 Jul 2026
- 2026Useful Features, Backward Scores: OOD in Language-Model Trajectories30 Apr 2026
- 2026Seeing but Not Thinking: Routing Distraction in Multimodal Mixture-of-Experts9 Apr 2026
- 2026HalluGuard: Demystifying Data-Driven and Reasoning-Driven Hallucinations in LLMs26 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026BEACON: Behavioral Entropy Aggregation for Cross-Model Hallucination Detection in Large Language Models
- 2026Scalable Token-Level Hallucination Detection in Large Language Models
- 2026Domain-Specific Hallucination Detection in Large Language Models
- 2025SelfCheck-Eval: A Multi-Module Framework for Zero-Resource Hallucination Detection in Large Language Models
- 2025HARP: Hallucination Detection via Reasoning Subspace Projection
- 2026External Observers May See More Clearly: Cross-Model Span-Level Hallucination Detection in Large Language Models via Hidden State Probing
- 2026Why LLMs Hallucinate on Structured Knowledge: A Mechanistic Analysis of Reasoning over Linearized Representations
- 2025ORION Grounded in Context: Retrieval-Based Method for Hallucination Detection