Reading the Room: Implicit Confusion Encoding in Recurrent World Model States
On the map: World models → Latent predictive world models
Abstract (arXiv)
World models built on the RSSM architecture, such as DreamerV3, keep a recurrent hidden state ht trained only to reduce prediction error. We show this state also tracks its own confusion, hiding in plain sight: nearly orthogonal to ht's directions of greatest variance, invisible to any variance-based method. It is functionally distinct from ensemble disagreement, which flags new inputs, and reconstruction error, which flags bad predictions right now. On a test holding prediction error fixed while confusion varies, a linear probe on ht finds the signal (AUROC 0.72, 5 runs), while an ensemble baseline scores below chance. A discounted count of recent high-error steps explains 80% of the probe's output (R2=0.80). We confirm the signal is causally used, not merely present, by editing ht directly and watching behaviour change, including a check using real values from other trajectories instead of synthetic edits. Its geometry and closed form generalize across three control tasks; the decisive dissociation test itself holds cleanly on only one, and its practical use, deciding when to check reality instead of trusting imagination, generalizes to only two of the three tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 12 of its 21 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
12 of 21 references.
References · 12
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
- 2020Planning to Explore via Self-Supervised World Modelscited by 368
- 2023Emergent Linear Representations in World Models of Self-Supervised Sequence Modelscited by 319
- 2023Is This the Subspace You Are Looking for? An Interpretability Illusion for Subspace Activation Patchingcited by 80
- 2020Trust the Model When It Is Confident: Masked Model-based Actor-Criticcited by 36
- 2026When to Trust Imagination: Adaptive Action Execution for World Action Modelscited by 20
- 2024Planning in a recurrent neural network that plays Sokobancited by 18
- 2026Biased Dreams: Limitations to Epistemic Uncertainty Quantification in Latent Dynamics Modelscited by 5
- 2021Acting upon Imagination: when to trust imagined trajectories in model based reinforcement learningcited by 3
- 2025DreamerV3-XP: Optimizing exploration through uncertainty estimationcited by 2
- 2026Probabilistic Dreaming for World Modelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Rethinking State Tracking in Recurrent Models Through Error Control Dynamics
- 2026Compact but Moving: Intervention-Relevant Geometry in Recurrent World Models
- 2026Counterfactual Action Evaluation, Observation Bottlenecks, and Representation Geometry in Joint-Embedding Predictive World Models
- 2026Low-Rank Dynamics-Effective Latent Carriers for Counterfactual Rollout in Learned World Models
- 2026World Models with Predictable Long-Horizon Marginals
- 2026Dense Supervision Is Not Enough: The Readout Blind Spot in Looped Language Models
- 2026Spatiotemporal Hidden-State Dynamics as a Signature of Internal Reasoning in Large Language Models
- 2026Where Does Reasoning Break? Step-Level Hallucination Detection via Hidden-State Transport Geometry