mlsanityData to 7 Oct 2026

D2HScore: Reasoning-Aware Hallucination Detection via Semantic Breadth and Depth Analysis in LLMs

arXiv 2509.11569 ↗First posted 15 Sep 2025cs.CLcited by 5

On the map: LLM reasoning → Hallucination detection and mitigation

Abstract (arXiv)

Although large Language Models (LLMs) have achieved remarkable success, their practical application is often hindered by the generation of non-factual content, which is called "hallucination". Ensuring the reliability of LLMs' outputs is a critical challenge, particularly in high-stakes domains such as finance, security, and healthcare. In this work, we revisit hallucination detection from the perspective of model architecture and generation dynamics. Leveraging the multi-layer structure and autoregressive decoding process of LLMs, we decompose hallucination signals into two complementary dimensions: the semantic breadth of token representations within each layer, and the semantic depth of core concepts as they evolve across layers. Based on this insight, we propose D2HScore (Dispersion and Drift-based Hallucination Score), a training-free and label-free framework that jointly measures: (1) Intra-Layer Dispersion, which quantifies the semantic diversity of token representations within each layer; and (2) Inter-Layer Drift, which tracks the progressive transformation of key token representations across layers. To ensure drift reflects the evolution of meaningful semantics rather than noisy or redundant tokens, we guide token selection using attention signals. By capturing both the horizontal and vertical dynamics of representation during inference, D2HScore provides an interpretable and lightweight proxy for hallucination detection. Extensive experiments across five open-source LLMs and five widely used benchmarks demonstrate that D2HScore consistently outperforms existing training-free baselines.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Hallucination detection and mitigation, one of 17 directions in LLM reasoning. Builds on 21 of its 31 references that are in the map. First posted on arXiv 15 Sep 2025.

Builds on

21 of 31 references.

References · 21

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  6. 2023A Survey of Large Language Modelscited by 2,537
  7. 2022Language Models (Mostly) Know What They Knowcited by 1,783
  8. 2024OpenAI o1 System Cardcited by 1,220
  9. 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
  10. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  11. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
  12. 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 518
9 more
  1. 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 317
  2. 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 300
  3. 2022Prompting GPT-3 To Be Reliablecited by 258
  4. 2025WritingBench: A Comprehensive Benchmark for Generative Writingcited by 95
  5. 2023SAC3: Reliable Hallucination Detection in Black-Box Language Models via Semantic-aware Cross-check Consistencycited by 89
  6. 2024Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Modelscited by 84
  7. 2024Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluationcited by 56
  8. 2024SPUQ: Perturbation-Based Uncertainty Quantification for Large Language Modelscited by 54
  9. 2024Small Agent Can Also Rock! Empowering Small Language Models as Hallucination Detectorcited by 20

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026BEACON: Behavioral Entropy Aggregation for Cross-Model Hallucination Detection in Large Language Models
  2. 2026Scalable Token-Level Hallucination Detection in Large Language Models
  3. 2026Domain-Specific Hallucination Detection in Large Language Models
  4. 2025SelfCheck-Eval: A Multi-Module Framework for Zero-Resource Hallucination Detection in Large Language Models
  5. 2025HARP: Hallucination Detection via Reasoning Subspace Projection
  6. 2026External Observers May See More Clearly: Cross-Model Span-Level Hallucination Detection in Large Language Models via Hidden State Probing
  7. 2026Why LLMs Hallucinate on Structured Knowledge: A Mechanistic Analysis of Reasoning over Linearized Representations
  8. 2025ORION Grounded in Context: Retrieval-Based Method for Hallucination Detection