Temporal Multi-Signal Fusion for Token-Level Hallucination Detection
Not on the map. Why?
Abstract (arXiv)
Token-level hallucination detectors score each token independently from a single signal, and fail exactly when the generating model is confidently wrong. This paper instead treats hallucination as a temporally extended span and detects it by sequence labeling: each token is scored from a 33-dimensional feature stream that fuses text statistics, Natural Language Inference (NLI) entailment, and language model surprisal, with no access to model internals. A Bidirectional Gated Recurrent Unit (BiGRU) over these features reaches an AUC of 0.840 on RAGTruth (10 seeds), an 11-point gain over an independent logistic-regression baseline (p = 0.002, Wilcoxon signed-rank). A controlled decomposition attributes most of the gain to temporal order rather than model capacity: evidence propagates from confident positions to ambiguous neighbors within a span. The same 0.845 ceiling recurs across recurrent, state-space (Mamba), and attention architectures, locating the bottleneck in the feature set rather than the model. Because it reads only the generated text and external signals, the detector works on closed-source models, and it keeps working on text produced by language models it never saw during training, losing under 4% AUC.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 35 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
28 of 35 references.
References · 28
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
- 2024TinyLlama: An Open-Source Small Language Modelcited by 604
- 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 317
- 2023RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Modelscited by 272
- 2024Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMscited by 246
- 2024Lookback Lens: Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Mapscited by 140
- 2023LM-Polygraph: Uncertainty Estimation for Language Modelscited by 130
- 2024Do I Know This Entity? Knowledge Awareness and Hallucinations in Language Modelscited by 114
- 2024ReDeEP: Detecting Hallucination in Retrieval-Augmented Generation via Mechanistic Interpretabilitycited by 100
16 more
- 2025Real-Time Detection of Hallucinated Entities in Long-Form Generationcited by 33
- 2025LettuceDetect: A Hallucination Detection Framework for RAG Applicationscited by 32
- 2025Trust Me, I'm Wrong: LLMs Hallucinate with Certainty Despite Knowing the Answercited by 26
- 2017Optimal Hyperparameters for Deep LSTM-Networks for Sequence Labeling Taskscited by 17
- 2025Learned Hallucination Detection in Black-Box LLMs using Token-level Entropy Production Ratecited by 9
- 2025A Single Direction of Truth: An Observer Model's Linear Residual Probe Exposes and Steers Contextual Hallucinationscited by 8
- 2026HALT: Hallucination Assessment via Log-probs as Time seriescited by 8
- 2025Do LLMs Really Know What They Don't Know? Internal States Mainly Reflect Knowledge Recall Rather Than Truthfulnesscited by 7
- 2025Representation-based Broad Hallucination Detectors Fail to Generalize Out of Distributioncited by 4
- 2026Lyapunov Probes for Hallucination Detection in Large Foundation Modelscited by 3
- 2026HalluSAE: Detecting Hallucinations in Large Language Models via Sparse Auto-Encoderscited by 3
- 2026Automatic Layer Selection for Hallucination Detectioncited by 3
- 2025HIDE and Seek: Detecting Hallucinations in Language Models via Decoupled Representationscited by 2
- 2026Detection Without Correction: A Robust Asymmetry in Activation-Based Hallucination Probingcited by 2
- 2026Hallucination as Trajectory Commitment: Causal Evidence for Asymmetric Attractor Dynamics in Transformer Generationcited by 2
- 2026Hallucination Detection via Activations of Open-Weight Proxy Analyzerscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Predictive Coding and Information Bottleneck for Hallucination Detection in Large Language Models
- 2026Scalable Token-Level Hallucination Detection in Large Language Models
- 2025D2HScore: Reasoning-Aware Hallucination Detection via Semantic Breadth and Depth Analysis in LLMs
- 2026Beyond the Global Scores: Fine-Grained Token Grounding as a Robust Detector of LVLM Hallucinations
- 2026External Observers May See More Clearly: Cross-Model Span-Level Hallucination Detection in Large Language Models via Hidden State Probing
- 2026BEACON: Behavioral Entropy Aggregation for Cross-Model Hallucination Detection in Large Language Models
- 2025MTRE: Multi-Token Reliability Estimation for Hallucination Detection in VLMs
- 2026Domain-Specific Hallucination Detection in Large Language Models