Low-Rank Dynamics-Effective Latent Carriers for Counterfactual Rollout in Learned World Models
On the map: World models → Latent predictive world models
Abstract (arXiv)
We ask whether a small, directly addressable hidden-state intervention can place a learned world model on an intended counterfactual future and then let the model's own dynamics carry that future forward. In a controlled two-object collision environment, we study a 192-dimensional recurrent model trained on factual and locally edited counterfactual trajectories. Candidate carriers are learned from training-only counterfactual-minus-factual hidden differences, and an affine map predicts carrier coordinates from the factual state and requested edit without access to the native counterfactual hidden state at test time. For bounded single-component velocity edits, rank 4 is the smallest tested rank on the preregistered grid that satisfies the development criteria. A one-shot rank-4 patch launches a 12-transition autonomous rollout without future observations, teacher forcing, repeated hidden-state correction, or physical-state clamping. The frozen procedure satisfies the preregistered 2-of-3 fresh-checkpoint replication rule and remains reusable at nearby anchors. The same Single-derived carrier and Single-only affine map also support bounded same-object two-component requests. Across the matched training regimes, broader counterfactual support was associated mainly with better Joint rollout accuracy and more additive Joint hidden responses. Composition-related structure is enriched in the rank-4 subspace but is not confined to it, and local recurrent diagnostics show strong one-step coupling from the carrier to the rest of the hidden state. A position-edit stress test fails the required specificity controls. Together, these results support a compact dynamics-effective intervention-entry interface, not a closed four-dimensional state or an intrinsic state dimension.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 26 of its 29 references that are in the map. First posted on arXiv 15 Aug 2026.
Builds on
26 of 29 references.
Closest ancestors · 4
Same direction, newest first
- 2026Is Forward Prediction Enough? Physical State Grounding for JEPA World Models7 Aug
- 2026GAUGE: A Measurement-Grounded Benchmark for Physical Fidelity in Simulation Engines and Video World Models6 Aug
- 2026Causal Physics Steering in Video World Models via Concept Activation Vectors23 May
- 2018Learning Latent Dynamics for Planning from Pixels12 Nov
Other references · 22
- 2018World Modelscited by 1,513
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2020Concept Bottleneck Modelscited by 1,032
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2024Genie: Generative Interactive Environmentscited by 747
- 2019Designing and Interpreting Probes with Control Taskscited by 640
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 484
- 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 455
- 2023LEACE: Perfect linear concept erasure in closed formcited by 267
- 2023Finding Alignments Between Interpretable Causal Variables and Distributed Neural Representationscited by 209
- 2019DeepMDP: Learning Continuous Latent Space Models for Representation Learningcited by 207
10 more
- 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 153
- 2022SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Modelscited by 147
- 2021Inducing Causal Structure for Interpretable Neural Networkscited by 110
- 2025Intuitive physics understanding emerges from self-supervised pretraining on natural videoscited by 70
- 2021Action-Sufficient State Representation Learning for Control with Structural Constraintscited by 31
- 2024How Reliable are Causal Probing Interventions?cited by 11
- 2026What Makes Video World Model Latents Action-Relevant: Prediction over Reconstructioncited by 9
- 2026What Do World Models Learn in RL? Probing Latent Representations in Learned Environment Simulatorscited by 5
- 2026CRONOS: Benchmarking Counterfactual Physical Consistency in Video Modelscited by 4
- 2026Latent State Design for World Models under Sufficiency Constraintscited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Compact but Moving: Intervention-Relevant Geometry in Recurrent World Models
- 2026Counterfactual Action Evaluation, Observation Bottlenecks, and Representation Geometry in Joint-Embedding Predictive World Models
- 2026Event-Conditioned Diagnostics of Kinematic, Contact, and Object-Permanence Structure in Passive Object-State World Models
- 2026OneWorld: Learning Consistent Physics Across Actions in World Models
- 2023Understanding Physical Dynamics with Counterfactual World Modeling
- 2026Learning Counterfactual World Models for Embodied Reasoning under Partial Observability
- 2026AD-WM: Action-Discriminative World Models for Counterfactual Model Predictive Control
- 2026Conservation Buys Stability and Factoring Buys Counterfactuals in Physical World Models