Twin Rollouts: Noise-Coupled Counterfactual Branching in Interactive Video World Models
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Interactive video world models generate rollouts autoregressively under an action stream, yet they are trained and evaluated almost exclusively on factual prediction. We study counterfactual generation inside the rollout: given a trajectory the model has itself generated, what would have happened had the actions differed from step t* onward? We formalize noise-coupled twin rollouts --- a factual and a counterfactual branch sharing the generated prefix and the future exogenous noise sequence, diverging only in the action stream at an intervention point. Because the factual branch is self-generated, its exogenous noise is known exactly: the abduction step of Pearl's counterfactual procedure is exact by construction, sidestepping the approximate-inversion problem faced by editing-based pipelines. Noise coupling further turns the minimal-change principle into a per-sample verifiable property: we define a spatiotemporal locality metric that penalizes divergence outside the causal descendants of the intervention, computable against simulator ground truth without a learned judge. Forking the simulator state at t* yields ground-truth counterfactual re-renders, which we use as verifiable rewards for post-training. This note establishes the formal framework, metric definitions, and positioning; experiments are forthcoming.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 10 of its 10 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
10 of 10 references.
Closest ancestors · 1
Same direction, newest first
Other references · 9
- 2022Diffusion Causal Models for Counterfactual Estimationcited by 87
- 2025RLVR-World: Training World Models with Reinforcement Learningcited by 38
- 2025Diffusion Counterfactual Generation with Semantic Abductioncited by 8
- 2026What-If World: A Causal Benchmark for General World Models in Embodied Scenarioscited by 6
- 2025Causally Steered Diffusion for Automated Video Counterfactual Generationcited by 5
- 2025Causal-Adapter: Taming Text-to-Image Diffusion for Faithful Counterfactual Generationcited by 4
- 2025Counterfactual World Models via Digital Twin-conditioned Video Diffusioncited by 4
- 2026CounterScene: Counterfactual Causal Reasoning in Generative World Models for Safety-Critical Closed-Loop Evaluationcited by 3
- 2026Autonomous Video Generation with Counterfactual Controllability for Self-Evolving World Modelscited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026ActionSplice: In-Flight Action Editing for Interactive World Models
- 2026ReSync: Re-Aligning the Two Clocks of Asynchronous World-Action Models
- 2026MiniWorld: Democratizing the Training of Video World Models from Scratch
- 2026Low-Rank Dynamics-Effective Latent Carriers for Counterfactual Rollout in Learned World Models
- 2026Nano World Models: A Minimalist Implementation of Future Video Prediction
- 2026A Mechanistic View on Video Generation as World Models: State and Dynamics
- 2026CtrlWAM: Controllable World Action Models with Aligned Intent and Foresight
- 2026NoiseGate: Learning Per-Latent Timestep Schedules as Information Gating in World Action Models