mlsanityData to 7 Oct 2026

Identifiable World Models from Pretrained Diffusion Representations

arXiv 2610.07028 ↗First posted 4 Oct 2026cs.LGcited by 0

On the map: World models → Latent predictive world models

also in 1 more
Abstract (arXiv)

Diffusion-based world models can generate and predict trajectories in high-dimensional dynamical systems, but predictive accuracy does not imply that their latent coordinates recover the underlying state variables or causal interactions. We ask whether a frozen pretrained diffusion model can be equipped with identifiable coordinates without retraining its generative backbone. We show that auxiliary-variable nonlinear ICA guarantees can be transferred to Contrastive Diffusion Alignment (ConDA), which learns only a lightweight alignment map on top of frozen diffusion latents. Under standard TCL/GCL assumptions, the aligned representation identifies latent dynamical states up to permutation and componentwise invertible transformations, preserves the latent dynamic structural causal model, and reduces lagged graph recovery to transition-Jacobian sparsity. We evaluate TCL-, GCL-, and CEBRA-based ConDA against TDRL, CaRiNG, IDOL, temporal SuaVE, and iVAE across physical and robotic video systems. TCL and GCL achieve near-perfect blockwise state recovery and competitive lagged graph recovery, including exact recovery in a simulated falling-body system. In a simulated bipedal robot, learned dynamics recover the sign and temporal structure of responses to held-out control perturbations. These results show that a frozen generative diffusion model can be equipped with coordinates that are identifiable, structurally interpretable, and useful for analyzing intervention-relevant dynamics.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. First posted on arXiv 4 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning Transferable Dynamics Priors from Action to World Modeling
  2. 2026Reconstruction or Semantics? What Makes a Latent Space Useful for Robotic World Models
  3. 2026Diffusion Sequence Models for Generative In-Context Meta-Learning of Robot Dynamics
  4. 2025DDAT: Diffusion Policies Enforcing Dynamically Admissible Robot Trajectories
  5. 2026LeapBot-WA: World-Anchor Action Models via Predictive Latent Alignments
  6. 2025Contrastive Diffusion Alignment: Learning Structured Latents for Controllable Generation
  7. 2026Flow Equivariant World Models: Memory for Partially Observed Dynamic Environments
  8. 2025Sample from What You See: Visuomotor Policy Learning via Diffusion Bridge with Observation-Embedded Stochastic Differential Equation