mlsanityData to 7 Oct 2026

A Chosen Future Can Still Be Rewritten: Causal Writability in Video Models

arXiv 2609.15980 ↗First posted 14 Sep 2026cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

When a video model generates physically incorrect motion, did it fail to learn the correct motion, or did it learn it but fail to use it? We show the latter: the correct motion remains available inside the model and can still be made to control the generated video. We train on videos where red masses oscillate slowly and blue masses oscillate quickly, then test a red mass with fast observed motion. Even when the model generates slow motion in this conflicting case, a low-dimensional edit predicted from simple physical variables restores the correct fast motion. We call this ability causal writability. At fixed strength, we find a sharp depth boundary: the same edit changes the video before the boundary but not after it. This closure marks commitment for that write. The motion signal nevertheless remains, and a stronger downstream write can restore physical motion, while excessive gain overshoots. Early causal writability predicts which errors training later corrects: those errors are writable at more network depths than errors that persist. We reproduce both causal writability and its sharp closure in a pretrained 1.3B video model, supporting generality across model scale and training regime.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 22 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

20 of 22 references.

References · 20

  1. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  2. 2022Video Diffusion Modelscited by 2,280
  3. 2020Shortcut Learning in Deep Neural Networkscited by 1,928
  4. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  5. 2018World Modelscited by 1,444
  6. 2020Underspecification Presents Challenges for Credibility in Modern Machine Learningcited by 488
  7. 2022Git Re-Basin: Merging Models modulo Permutation Symmetriescited by 460
  8. 2023Towards Best Practices of Activation Patching in Language Models: Metrics and Methodscited by 328
  9. 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 204
  10. 2021Revisiting Model Stitching to Compare Neural Representationscited by 203
  11. 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 88
  12. 2023Is This the Subspace You Are Looking for? An Interpretability Illusion for Subspace Activation Patchingcited by 75
8 more
  1. 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 32
  2. 2026Manifold Steering Reveals the Shared Geometry of Neural Network Representation and Behaviorcited by 22
  3. 2026Interpreting Physics in Video World Modelscited by 18
  4. 2025Activation Space Interventions Can Be Transferred Between Large Language Modelscited by 17
  5. 2026Causal Physics Steering in Video World Models via Concept Activation Vectorscited by 4
  6. 2026The Invisible Hand of Physics: When Video Diffusion Models Know More Than They Showcited by 4
  7. 2026Do Models Share Safety Representations? Cross-Model Steering for Safe Visual Generationcited by 2
  8. 2026Meltdown: Circuits and Bifurcations in Point-Cloud-Conditioned 3D Diffusion Transformerscited by 1

Built on by

Not cited yet.