Identifiable World Models from Pretrained Diffusion Representations
On the map: World models → Latent predictive world models
also in 1 more
Abstract (arXiv)
Diffusion-based world models can generate and predict trajectories in high-dimensional dynamical systems, but predictive accuracy does not imply that their latent coordinates recover the underlying state variables or causal interactions. We ask whether a frozen pretrained diffusion model can be equipped with identifiable coordinates without retraining its generative backbone. We show that auxiliary-variable nonlinear ICA guarantees can be transferred to Contrastive Diffusion Alignment (ConDA), which learns only a lightweight alignment map on top of frozen diffusion latents. Under standard TCL/GCL assumptions, the aligned representation identifies latent dynamical states up to permutation and componentwise invertible transformations, preserves the latent dynamic structural causal model, and reduces lagged graph recovery to transition-Jacobian sparsity. We evaluate TCL-, GCL-, and CEBRA-based ConDA against TDRL, CaRiNG, IDOL, temporal SuaVE, and iVAE across physical and robotic video systems. TCL and GCL achieve near-perfect blockwise state recovery and competitive lagged graph recovery, including exact recovery in a simulated falling-body system. In a simulated bipedal robot, learned dynamics recover the sign and temporal structure of responses to held-out control perturbations. These results show that a frozen generative diffusion model can be equipped with coordinates that are identifiable, structurally interpretable, and useful for analyzing intervention-relevant dynamics.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. First posted on arXiv 4 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Learning Transferable Dynamics Priors from Action to World Modeling
- 2026Reconstruction or Semantics? What Makes a Latent Space Useful for Robotic World Models
- 2026Diffusion Sequence Models for Generative In-Context Meta-Learning of Robot Dynamics
- 2025DDAT: Diffusion Policies Enforcing Dynamically Admissible Robot Trajectories
- 2026LeapBot-WA: World-Anchor Action Models via Predictive Latent Alignments
- 2025Contrastive Diffusion Alignment: Learning Structured Latents for Controllable Generation
- 2026Flow Equivariant World Models: Memory for Partially Observed Dynamic Environments
- 2025Sample from What You See: Visuomotor Policy Learning via Diffusion Bridge with Observation-Embedded Stochastic Differential Equation