DeMTS: Denoising Trajectories as Multivariate Time Series for Hallucination Detection in Diffusion Language Models
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Diffusion large language models (D-LLMs) have emerged as a promising paradigm for text generation. However, similar to autoregressive LLMs, D-LLMs remain vulnerable to hallucinations, where fluent outputs may contain factually incorrect or unsupported content. Although existing hallucination detection methods for D-LLMs attempt to leverage uncertainty trajectories of the denoising process to better identify hallucination signals, they typically compress the trajectories along either the temporal or token dimension, overlooking the useful information encoded in the complete two-dimensional token-step structure. Consequently, they may fail to capture hallucination-relevant patterns, such as inconsistent convergence and cross-token fault propagation, leading to suboptimal detection performance. To bridge this gap, we propose a D-LLM hallucination detection framework that formulates the Denoising trajectories as Multivariate Time Series over learnable latent variables (DeMTS for short). DeMTS employs a trajectory-preserving token-to-variable assignment module to convert token signals into stable latent variables. Based on these variables, we propose dynamic multivariate temporal modeling to progressively integrate inter-variable dependency modeling with temporal encoding for hallucination prediction. Extensive experiments on two D-LLMs backbones and three benchmarks demonstrate that DeMTS outperforms existing hallucination detection methods while maintaining strong robustness, efficiency, and cross-task transferability.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 24 of its 49 references that are in the map. First posted on arXiv 24 Jul 2026.
Builds on
24 of 49 references.
Closest ancestors · 2
Same direction, newest first
- 2026TDGNet: Hallucination Detection in Diffusion Language Models via Temporal Dynamic Graphs8 Feb
- 2025Towards Understanding Text Hallucination of Diffusion Models via Local Generation Bias5 Mar
Other references · 22
- 2025Qwen3 Technical Reportcited by 8,820
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
- 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 251
- 2022Out-of-Distribution Detection and Selective Generation for Conditional Language Modelscited by 197
- 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100Bcited by 166
- 2025HalluLens: LLM Hallucination Benchmarkcited by 92
- 2025A Comprehensive Survey of Deep Learning for Multivariate Time Series Forecasting: A Channel Strategy Perspectivecited by 58
- 2025Steer LLM Latents for Hallucination Detectioncited by 50
10 more
- 2019Insertion-based Decoding with automatically Inferred Generation Ordercited by 43
- 2026DynHD: Hallucination Detection for Diffusion Large Language Models via Denoising Dynamics Deviation Learningcited by 15
- 2025Raising the Bar in Graph OOD Generalization: Invariant Learning Beyond Explicit Environment Modelingcited by 9
- 2025From Denoising to Refining: A Corrective Framework for Vision-Language Diffusion Modelcited by 9
- 2026FedCIGAR: A Personalized Reconstruction Approach for Federated Graph-level Anomaly Detectioncited by 6
- 2018Middle-Out Decodingcited by 5
- 2025Multi-Stage Verification-Centric Framework for Mitigating Hallucination in Multi-Modal RAGcited by 5
- 2026HalluSAE: Detecting Hallucinations in Large Language Models via Sparse Auto-Encoderscited by 5
- 2026Towards Anomaly Detection on Relational Datacited by 5
- 2026DRIFT: Detecting Representational Inconsistencies for Factual Truthfulnesscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026TRE: Training-Free Hallucination Detection for Diffusion Language Models
- 2025Hallucination Detection and Mitigation with Diffusion in Multi-Variate Time-Series Foundation Models
- 2026Lost in Diffusion: Uncovering Hallucination Patterns and Failure Modes in Diffusion Large Language Models
- 2025Theoretical Foundations and Mitigation of Hallucination in Large Language Models
- 2026AURORA: Asymmetry and Update-Induced Rotation for Robust Hallucination Detection in Large Language Models
- 2025D2HScore: Reasoning-Aware Hallucination Detection via Semantic Breadth and Depth Analysis in LLMs
- 2026Domain-Specific Hallucination Detection in Large Language Models
- 2026Scalable Token-Level Hallucination Detection in Large Language Models