mlsanityData to 7 Oct 2026

Compact but Moving: Intervention-Relevant Geometry in Recurrent World Models

arXiv 2609.21787 ↗First posted 18 Sep 2026cs.ROcited by 0

On the map: World models → Latent predictive world models

Abstract (arXiv)

Learned world models may have compact interventions even when their recurrent state is high-dimensional, but it is unclear what happens to such a correction after it enters the model. We study this question in a controlled recurrent world model where prior work identified a checkpoint-specific rank-4 interface for one-shot counterfactual velocity interventions. The correction rapidly leaves this fixed entry subspace during autonomous rollout. Nevertheless, a low-rank image obtained by transporting the entry directions through the factual recurrent Jacobian chain continues to capture most of the nonlinear correction. Restarts using the tangent-predicted correction preserve substantial counterfactual future function. This transport/function pattern recurs across independently trained structured-GRU models and a parameter-matched LSTM initialized with a privileged compact correction. We further characterize a finite-horizon future-response operator over the full recurrent carrier. Patching shifts its leading future-sensitive directions toward the matched native-counterfactual organization, and the local operator accurately ranks finite perturbation effects over the registered direction panels at the patched and native-counterfactual basepoints. A separate full-amplitude assay finds substantial factual-endpoint tangent residuals and supports response reconfiguration in two of three checkpoints. Together, these results show that compact intervention structure can persist as a moving, state-dependent local geometry embedded in high-dimensional recurrent dynamics, without implying a fixed or dynamically closed low-dimensional state.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. First posted on arXiv 18 Sep 2026.

Builds on

0 of 0 references.

No references here yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Low-Rank Dynamics-Effective Latent Carriers for Counterfactual Rollout in Learned World Models
  2. 2026FIRM-WM: State-factorized factual-interventional recurrent modeling for reward-free visual planning
  3. 2026Learning Counterfactual World Models for Embodied Reasoning under Partial Observability
  4. 2026Flow Equivariant World Models: Memory for Partially Observed Dynamic Environments
  5. 2026Correcting a learned physical invariant improves world-model rollouts
  6. 2026RolloutFaith: Auditing Persistent Internal Interventions in Visual World Model
  7. 2025Reimagination with Test-time Observation Interventions: Distractor-Robust World Model Predictions for Visual Model Predictive Control
  8. 2026The Intervention Gap in Latent World Models