TRE: Training-Free Hallucination Detection for Diffusion Language Models
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Diffusion large language models (D-LLMs) have recently gained increasing attention, yet their reliability is significantly hindered by the hallucination problem. Existing hallucination detection approaches for D-LLMs mainly follow a training-based paradigm, relying on data-driven training to optimize the detector. Such reliance not only limits their generalizability across domains models but also incurs additional training cost and deployment overhead. To address these limitations, we propose TRE, a training-free hallucination detection metric for D-LLMs. TRE is a parameter-free and single-run metric that estimates hallucination risk directly from the entropy signals of a single generation, without requiring any detector training or repeated sampling. TRE extracts entropy signals within the D-LLM decoding process along both the spatial and temporal dimensions. From a token-level spatial perspective, we focus on revealing tokens as the most informative carriers of uncertainty, capturing where uncertainty is actively committed. From a diffusion step-level temporal perspective, we empirically identify the dominance of late-step entropy and hence aggregate these signals with a simple linear weighting scheme to obtain TRE. Extensive experiments on multiple D-LLMs and QA datasets demonstrate that TRE achieves competitive performance, while enjoying strong generalizability, efficiency, and robustness.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 49 of its 60 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
49 of 60 references.
Closest ancestors · 2
Same direction, newest first
- 2026TDGNet: Hallucination Detection in Diffusion Language Models via Temporal Dynamic Graphs8 Feb
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions10 Feb
Other references · 47
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
35 more
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
- 2025Large Language Diffusion Modelscited by 912
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 900
- 2024Simple and Effective Masked Diffusion Language Modelscited by 848
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
- 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 745
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 698
- 2023The Internal State of an LLM Knows When It's Lyingcited by 659
- 2025Dream 7B: Diffusion Large Language Modelscited by 544
- 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 409
- 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 341
- 2022Understanding Diffusion Models: A Unified Perspectivecited by 340
- 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 323
- 2023Generating with Confidence: Uncertainty Quantification for Black-box Large Language Modelscited by 293
- 2024Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMscited by 259
- 2022Out-of-Distribution Detection and Selective Generation for Conditional Language Modelscited by 197
- 2023Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Modelscited by 150
- 2025Accelerating Diffusion LLMs via Adaptive Parallel Decodingcited by 112
- 2022FaithDial: A Faithful Benchmark for Information-Seeking Dialoguecited by 109
- 2021Step-unrolled Denoising Autoencoders for Text Generationcited by 102
- 2023Enhancing Uncertainty-Based Hallucination Detection with Stronger Focuscited by 99
- 2024TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Spacecited by 91
- 2022Investigating Selective Prediction Approaches Across Several Tasks in IID, OOD, and Adversarial Settingscited by 66
- 2025Steer LLM Latents for Hallucination Detectioncited by 50
- 2025BlindGuard: Safeguarding LLM-based Multi-Agent Systems under Unknown Attackscited by 38
- 2026DynHD: Hallucination Detection for Diffusion Large Language Models via Denoising Dynamics Deviation Learningcited by 15
- 2025Uncertainty-Aware Graph Neural Networks: A Multi-Hop Evidence Fusion Approachcited by 14
- 2025A Survey of Generalization of Graph Anomaly Detection: From Transfer Learning to Foundation Modelscited by 14
- 2025Correcting False Alarms from Unseen: Adapting Graph Anomaly Detectors at Test Timecited by 12
- 2024Prompt-Guided Internal States for Hallucination Detection of Large Language Modelscited by 8
- 2025TraceDet: Hallucination Detection from the Decoding Trace of Diffusion Large Language Modelscited by 8
- 2024Influence-Oriented Personalized Federated Learningcited by 7
- 2026Lost in Diffusion: Uncovering Hallucination Patterns and Failure Modes in Diffusion Large Language Modelscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026DeMTS: Denoising Trajectories as Multivariate Time Series for Hallucination Detection in Diffusion Language Models
- 2026BEACON: Behavioral Entropy Aggregation for Cross-Model Hallucination Detection in Large Language Models
- 2026Predictive Coding and Information Bottleneck for Hallucination Detection in Large Language Models
- 2026HalluSAE: Detecting Hallucinations in Large Language Models via Sparse Auto-Encoders
- 2026External Observers May See More Clearly: Cross-Model Span-Level Hallucination Detection in Large Language Models via Hidden State Probing
- 2025Hallucination Detection and Mitigation with Diffusion in Multi-Variate Time-Series Foundation Models
- 2026Domain-Specific Hallucination Detection in Large Language Models
- 2025Theoretical Foundations and Mitigation of Hallucination in Large Language Models