mlsanityData to 7 Oct 2026

Hallucination Detection via Internal States and Structured Reasoning Consistency in Large Language Models

arXiv 2510.11529 ↗First posted 13 Oct 2025cs.CLcited by 0

On the map: LLM reasoning → Hallucination detection and mitigation

Abstract (arXiv)

The detection of sophisticated hallucinations in Large Language Models (LLMs) is hampered by a ``Detection Dilemma'': methods probing internal states (Internal State Probing) excel at identifying factual inconsistencies but fail on logical fallacies, while those verifying externalized reasoning (Chain-of-Thought Verification) show the opposite behavior. This schism creates a task-dependent blind spot: Chain-of-Thought Verification fails on fact-intensive tasks like open-domain QA where reasoning is ungrounded, while Internal State Probing is ineffective on logic-intensive tasks like mathematical reasoning where models are confidently wrong. We resolve this with a unified framework that bridges this critical gap. However, unification is hindered by two fundamental challenges: the Signal Scarcity Barrier, as coarse symbolic reasoning chains lack signals directly comparable to fine-grained internal states, and the Representational Alignment Barrier, a deep-seated mismatch between their underlying semantic spaces. To overcome these, we introduce a multi-path reasoning mechanism to obtain more comparable, fine-grained signals, and a segment-aware temporalized cross-attention module to adaptively fuse these now-aligned representations, pinpointing subtle dissonances. Extensive experiments on three diverse benchmarks and two leading LLMs demonstrate that our framework consistently and significantly outperforms strong baselines. Our code is available: https://github.com/peach918/HalluDet.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Hallucination detection and mitigation, one of 17 directions in LLM reasoning. Builds on 25 of its 29 references that are in the map. First posted on arXiv 13 Oct 2025.

Builds on

25 of 29 references.

References · 25

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  5. 2024Qwen2.5 Technical Reportcited by 4,713
  6. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  7. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  8. 2023A Survey of Large Language Modelscited by 2,537
  9. 2021Ethical and social risks of harm from Language Modelscited by 957
  10. 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
  11. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  12. 2023The Internal State of an LLM Knows When It's Lyingcited by 644
13 more
  1. 2022Large Language Models are Better Reasoners with Self-Verificationcited by 304
  2. 2024Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMscited by 246
  3. 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 231
  4. 2024V-STaR: Training Verifiers for Self-Taught Reasonerscited by 214
  5. 2025Why Language Models Hallucinatecited by 205
  6. 2024HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detectioncited by 96
  7. 2024Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Modelscited by 84
  8. 2023RCOT: Detecting and Rectifying Factual Inconsistency in Reasoning by Reversing Chain-of-Thoughtcited by 47
  9. 2023A Closer Look at the Self-Verification Abilities of Large Language Models in Logical Reasoningcited by 41
  10. 2024Detecting Hallucinations in Large Language Model Generation: A Token Probability Approachcited by 40
  11. 2024InternalInspector I2: Robust Confidence Estimation in LLMs through Internal Statescited by 29
  12. 2024Transferable and Efficient Non-Factual Content Detection via Probe Training with Offline Consistency Checkingcited by 7
  13. 2025Bridging External and Parametric Knowledge: Mitigating Hallucination of LLMs with Shared-Private Semantic Synergy in Dual-Stream Knowledgecited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Auditing Meta-Cognitive Hallucinations in Reasoning Large Language Models
  2. 2026Attention Dispersion as a Diagnostic Signal for Hallucination in Large Language Models
  3. 2026Streaming Hallucination Detection in Long Chain-of-Thought Reasoning
  4. 2026External Observers May See More Clearly: Cross-Model Span-Level Hallucination Detection in Large Language Models via Hidden State Probing
  5. 2026Sanity Checks for Long-Form Hallucination Detection
  6. 2026Scalable Token-Level Hallucination Detection in Large Language Models
  7. 2025Detection and Mitigation of Hallucination in Large Reasoning Models: A Mechanistic Perspective
  8. 2026Why LLMs Hallucinate on Structured Knowledge: A Mechanistic Analysis of Reasoning over Linearized Representations