One Lens, Many Worlds : A Capability-Typed Interface for World-Model Interpretability
On the map: World models → World models for language agents
Abstract (arXiv)
World models are now built on substantially different computational substrates. Latent recurrent state-space models such as PlaNet and the Dreamer family compress observations into recurrent states; token-based models such as IRIS quantize observations into a learned codebook and predict autoregressively with a transformer; and joint-embedding predictive architectures such as I-JEPA predict in a learned latent space with no pixel decoder. The interpretability methods applied to these models, including probing, activation patching, sparse autoencoders, and surprise analysis, share a common set of primitives, yet they are re-implemented from scratch for each architecture because existing hook-and-cache tooling assumes a transformer language model with no notion of actions, environment steps, or imagined rollouts. We argue that this fragmentation reflects the tooling rather than the models, and that the shared structure of world models is captured by a small typed interface. We present WorldModelLens, an open-source interpretability substrate organized around a capability-typed adapter: every model implements four required methods (encode, transition, initial state, sample) and declares a set of optional heads (decode, reward, continue, actor, critic) through an explicit capability descriptor, so that reinforcement-learning and self-supervised world models are first-class without either imitating the other. A single hook and cache layer exposes time-indexed activations, imagination rollouts, and intervention replay over this interface, allowing each analysis to be written once.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 10 of its 66 references that are in the map. First posted on arXiv 7 Jun 2026.
Builds on
10 of 66 references.
Closest ancestors · 1
Same direction, newest first
Other references · 9
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2017SmoothGrad: removing noise by adding noisecited by 1,109
- 2024Scaling and evaluating sparse autoencoderscited by 553
- 2020Captum: A unified and generic model interpretability library for PyTorchcited by 547
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2023Localizing Model Behavior with Path Patchingcited by 195
- 2024Improving Dictionary Learning with Gated Sparse Autoencoderscited by 179
- 2024NNsight and NDIF: Democratizing Access to Open-Weight Foundation Model Internalscited by 45
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026What Matters for World Modeling in Vision-Language-Action Models?
- 2025Four Principles for Physically Interpretable World Models
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Models
- 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Tasks
- 2025From Masks to Worlds: A Hitchhiker's Guide to World Models
- 2026Devol-ONE: One Autoregressive Mixture of Transformers to Unify Vision-Language-Action and Latent World Modeling
- 2024Toward Universal and Interpretable World Models for Open-ended Learning Agents
- 2025Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluation