The Geometry of Truth: Layer-wise Semantic Dynamics for Hallucination Detection in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) often produce fluent yet factually incorrect statements-a phenomenon known as hallucination-posing serious risks in high-stakes domains. We present Layer-wise Semantic Dynamics (LSD), a geometric framework for hallucination detection that analyzes the evolution of hidden-state semantics across transformer layers. Unlike prior methods that rely on multiple sampling passes or external verification sources, LSD operates intrinsically within the model's representational space. Using margin-based contrastive learning, LSD aligns hidden activations with ground-truth embeddings derived from a factual encoder, revealing a distinct separation in semantic trajectories: factual responses preserve stable alignment, while hallucinations exhibit pronounced semantic drift across depth. Evaluated on the TruthfulQA and synthetic factual-hallucination datasets, LSD achieves an F1-score of 0.92, AUROC of 0.96, and clustering accuracy of 0.89, outperforming SelfCheckGPT and Semantic Entropy baselines while requiring only a single forward pass. This efficiency yields a 5-20x speedup over sampling-based methods without sacrificing precision or interpretability. LSD offers a scalable, model-agnostic mechanism for real-time hallucination monitoring and provides new insights into the geometry of factual consistency within large language models.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 12 of its 15 references that are in the map. First posted on arXiv 6 Oct 2025.
Builds on
12 of 15 references.
References · 12
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
- 2023The Internal State of an LLM Knows When It's Lyingcited by 659
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 353
- 2023Linear Representations of Sentiment in Large Language Modelscited by 163
- 2022Analyzing Transformers in Embedding Spacecited by 132
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026DRIFT: Detecting Representational Inconsistencies for Factual Truthfulnesscited by 4
- 2026The Surprising Universality of LLM Outputs: A Real-Time Verification Primitivecited by 3
- 2026A Geometric Taxonomy of Hallucinations in LLMscited by 1
- 2026FinReflectKG -- HalluBench: GraphRAG Hallucination Benchmark for Financial Question Answering Systemscited by 1
- 2026EcoThink: A Green Adaptive Inference Framework for Sustainable and Accessible Agentscited by 1
- 2026Riemannian Geometry for Pre-trained Language Model Embeddingscited by 0
- 2026HalluTracer: Pre-Decoding Truthfulness Prediction via Depth-Averaged Probe-Logitcited by 0
- 2026HalluTracer: Pre-Decoding Truthfulness Prediction via Depth-Averaged Probe-Logit17 Aug 2026
- 2026Riemannian Geometry for Pre-trained Language Model Embeddings8 Jul 2026
- 2026The Surprising Universality of LLM Outputs: A Real-Time Verification Primitive28 Apr 2026
- 2026EcoThink: A Green Adaptive Inference Framework for Sustainable and Accessible Agents26 Mar 2026
- 2026FinReflectKG -- HalluBench: GraphRAG Hallucination Benchmark for Financial Question Answering Systems11 Mar 2026
- 2026A Geometric Taxonomy of Hallucinations in LLMs26 Jan 2026
- 2026DRIFT: Detecting Representational Inconsistencies for Factual Truthfulness20 Jan 2026