MEND: Label-Free Detection, Localisation, and Correction of Latent Hallucination in World Models
On the map: World models → Latent predictive world models also fits: Video-generation world models and simulators
Abstract (arXiv)
World Models are appearing as the next major frontier in computer vision. However, their robustness is currently largely unexplored. We identify the phenomenon of hallucination in latent World Models: given a state and an action, the predicted next latent can decode to a scene that never occurs. Because the prediction is statistically ordinary and is fed back autoregressively by the model, the error is both silent and compounding. We study whether such latent hallucination can be detected, localised, and corrected at inference time, on a frozen self-supervised world model in the absence of ground-truth error labels. We introduce Masked Empirical-Bayes Neural Denoising (MEND), a single conditional score network trained by denoising score matching on real transitions, whose score field serves three roles: its magnitude detects hallucination, its per-token field localises it to specific image patches, and it defines an inference-time correction direction. On two navigation environments MEND detects hallucination with an AUROC of up to 0.80 without using actions, exceeding a single-Gaussian density baseline while also localising the error (per-token AUPRC up to 0.87) and correcting it, all from one score field. Our correction reliably reduces single-step latent error and improves predictions. We identify that a part of the error is tangent to the data manifold, hence, we focus on detection and localisation while highlighting promises of the correction.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 21 of its 24 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
21 of 24 references.
Closest ancestors · 3
Same direction, newest first
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels13 Mar
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning7 Nov
- 2018Learning Latent Dynamics for Planning from Pixels12 Nov
Other references · 18
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2022Denoising Diffusion Restoration Modelscited by 951
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
6 more
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
- 2022Score-Based Generative Models Detect Manifoldscited by 121
- 2020Multiscale Score Matching for Out-of-Distribution Detectioncited by 36
- 2025World Models That Know When They Don't Know - Controllable Video Generation with Calibrated Uncertaintycited by 16
- 2025GHOST: Hallucination-Inducing Image Generation for Multimodal LLMscited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Mitigating Object Hallucination via Robust Local Perception Search
- 2026Beyond the Global Scores: Fine-Grained Token Grounding as a Robust Detector of LVLM Hallucinations
- 2026UHP Detection: LVLMs have their Unique Hallucination Pattern in the Consistency Space
- 2026Hallucination in World Models is Predictable and Preventable
- 2026TDGNet: Hallucination Detection in Diffusion Language Models via Temporal Dynamic Graphs
- 2025Diving into Mitigating Hallucinations from a Vision Perspective for Large Vision-Language Models
- 2024Reducing Hallucinations in Vision-Language Models via Latent Space Steering
- 2026Score-Control for Hallucination Reduction in Diffusion Models