mlsanityData to 7 Oct 2026

The Energy of Falsehood: Detecting Hallucinations via Diffusion Model Likelihoods

arXiv 2602.11364 ↗First posted 11 Feb 2026cs.CL cs.AIcited by 0

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Large Language Models (LLMs) frequently hallucinate plausible but incorrect assertions, a vulnerability often missed by uncertainty metrics when models are confidently wrong. We propose DiffuTruth, an unsupervised framework that reconceptualizes fact verification via non equilibrium thermodynamics, positing that factual truths act as stable attractors on a generative manifold while hallucinations are unstable. We introduce the Generative Stress Test, claims are corrupted with noise and reconstructed using a discrete text diffusion model. We define Semantic Energy, a metric measuring the semantic divergence between the original claim and its reconstruction using an NLI critic. Unlike vector space errors, Semantic Energy isolates deep factual contradictions. We further propose a Hybrid Calibration fusing this stability signal with discriminative confidence. Extensive experiments on FEVER demonstrate DiffuTruth achieves a state of the art unsupervised AUROC of 0.725, outperforming baselines by 1.5 percent through the correction of overconfident predictions. Furthermore, we show superior zero shot generalization on the multi hop HOVER dataset, outperforming baselines by over 4 percent, confirming the robustness of thermodynamic truth properties to distribution shifts.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 26 of its 41 references that are in the map. First posted on arXiv 11 Feb 2026.

Builds on

26 of 41 references.

References · 26

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  6. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  9. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  10. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  11. 2022Language Models (Mostly) Know What They Knowcited by 1,783
  12. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
14 more
  1. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  2. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
  3. 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
  4. 2022Teaching Models to Express Their Uncertainty in Wordscited by 731
  5. 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
  6. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 439
  7. 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 344
  8. 2023A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generationcited by 202
  9. 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 199
  10. 2022SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Controlcited by 191
  11. 2018Combining Fact Extraction and Verification with Neural Semantic Matching Networkscited by 120
  12. 2019GEAR: Graph-based Evidence Aggregating and Reasoning for Fact Verificationcited by 100
  13. 2020Residual Energy-Based Models for Text Generationcited by 95
  14. 2020Energy-Based Reranking: Improving Neural Machine Translation Using Energy-Based Modelscited by 44

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025HalluField: Detecting LLM Hallucinations via Field-Theoretic Modeling
  2. 2025Mathematical Analysis of Hallucination Dynamics in Large Language Models: Uncertainty Quantification, Advanced Decoding, and Principled Mitigation
  3. 2025The Curious Case of Factuality Finetuning: Models' Internal Beliefs Can Improve Factuality
  4. 2026Thermodynamic Signatures of Reasoning: Free-Energy and Spectral-Form-Factor Diagnostics for Hallucination Detection in Large Language Models
  5. 2026Listen to the Layers: Mitigating Hallucinations with Inter-Layer Disagreement
  6. 2025Revisiting Hallucination Detection with Effective Rank-based Uncertainty
  7. 2026AURORA: Asymmetry and Update-Induced Rotation for Robust Hallucination Detection in Large Language Models
  8. 2024Fine-grained Hallucination Detection and Editing for Language Models