mlsanityData to 14 Oct 2026

TRE: Training-Free Hallucination Detection for Diffusion Language Models

arXiv 2607.22661 ↗First posted 29 Jun 2026cs.AIcited by 1

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Diffusion large language models (D-LLMs) have recently gained increasing attention, yet their reliability is significantly hindered by the hallucination problem. Existing hallucination detection approaches for D-LLMs mainly follow a training-based paradigm, relying on data-driven training to optimize the detector. Such reliance not only limits their generalizability across domains models but also incurs additional training cost and deployment overhead. To address these limitations, we propose TRE, a training-free hallucination detection metric for D-LLMs. TRE is a parameter-free and single-run metric that estimates hallucination risk directly from the entropy signals of a single generation, without requiring any detector training or repeated sampling. TRE extracts entropy signals within the D-LLM decoding process along both the spatial and temporal dimensions. From a token-level spatial perspective, we focus on revealing tokens as the most informative carriers of uncertainty, capturing where uncertainty is actively committed. From a diffusion step-level temporal perspective, we empirically identify the dominance of late-step entropy and hence aggregate these signals with a simple linear weighting scheme to obtain TRE. Extensive experiments on multiple D-LLMs and QA datasets demonstrate that TRE achieves competitive performance, while enjoying strong generalizability, efficiency, and robustness.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 49 of its 60 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

49 of 60 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026TDGNet: Hallucination Detection in Diffusion Language Models via Temporal Dynamic Graphs8 Feb
  2. 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions10 Feb

Other references · 47

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  5. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  6. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  7. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  8. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
  9. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  10. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  11. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  12. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
35 more
  1. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
  2. 2025Large Language Diffusion Modelscited by 912
  3. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 900
  4. 2024Simple and Effective Masked Diffusion Language Modelscited by 848
  5. 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
  6. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
  7. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
  8. 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 745
  9. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 698
  10. 2023The Internal State of an LLM Knows When It's Lyingcited by 659
  11. 2025Dream 7B: Diffusion Large Language Modelscited by 544
  12. 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 409
  13. 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 341
  14. 2022Understanding Diffusion Models: A Unified Perspectivecited by 340
  15. 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 323
  16. 2023Generating with Confidence: Uncertainty Quantification for Black-box Large Language Modelscited by 293
  17. 2024Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMscited by 259
  18. 2022Out-of-Distribution Detection and Selective Generation for Conditional Language Modelscited by 197
  19. 2023Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Modelscited by 150
  20. 2025Accelerating Diffusion LLMs via Adaptive Parallel Decodingcited by 112
  21. 2022FaithDial: A Faithful Benchmark for Information-Seeking Dialoguecited by 109
  22. 2021Step-unrolled Denoising Autoencoders for Text Generationcited by 102
  23. 2023Enhancing Uncertainty-Based Hallucination Detection with Stronger Focuscited by 99
  24. 2024TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Spacecited by 91
  25. 2022Investigating Selective Prediction Approaches Across Several Tasks in IID, OOD, and Adversarial Settingscited by 66
  26. 2025Steer LLM Latents for Hallucination Detectioncited by 50
  27. 2025BlindGuard: Safeguarding LLM-based Multi-Agent Systems under Unknown Attackscited by 38
  28. 2026DynHD: Hallucination Detection for Diffusion Large Language Models via Denoising Dynamics Deviation Learningcited by 15
  29. 2025Uncertainty-Aware Graph Neural Networks: A Multi-Hop Evidence Fusion Approachcited by 14
  30. 2025A Survey of Generalization of Graph Anomaly Detection: From Transfer Learning to Foundation Modelscited by 14
  31. 2025Correcting False Alarms from Unseen: Adapting Graph Anomaly Detectors at Test Timecited by 12
  32. 2024Prompt-Guided Internal States for Hallucination Detection of Large Language Modelscited by 8
  33. 2025TraceDet: Hallucination Detection from the Decoding Trace of Diffusion Large Language Modelscited by 8
  34. 2024Influence-Oriented Personalized Federated Learningcited by 7
  35. 2026Lost in Diffusion: Uncovering Hallucination Patterns and Failure Modes in Diffusion Large Language Modelscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026DeMTS: Denoising Trajectories as Multivariate Time Series for Hallucination Detection in Diffusion Language Models
  2. 2026BEACON: Behavioral Entropy Aggregation for Cross-Model Hallucination Detection in Large Language Models
  3. 2026Predictive Coding and Information Bottleneck for Hallucination Detection in Large Language Models
  4. 2026HalluSAE: Detecting Hallucinations in Large Language Models via Sparse Auto-Encoders
  5. 2026External Observers May See More Clearly: Cross-Model Span-Level Hallucination Detection in Large Language Models via Hidden State Probing
  6. 2025Hallucination Detection and Mitigation with Diffusion in Multi-Variate Time-Series Foundation Models
  7. 2026Domain-Specific Hallucination Detection in Large Language Models
  8. 2025Theoretical Foundations and Mitigation of Hallucination in Large Language Models