mlsanityData to 7 Oct 2026

Causal-JEPA: Learning World Models through Object-Level Latent Masking

arXiv 2602.11389 ↗First posted 11 Feb 2026cs.AIcited by 25

On the map: World models → Latent predictive world models

Abstract (arXiv)

World models require robust relational understanding to support prediction, reasoning, and control. While object-centric representations provide a useful abstraction, they are not sufficient to capture interaction-dependent dynamics. We therefore propose C-JEPA, a simple and flexible object-centric world model that extends masked joint embedding prediction from image patches to object-centric representations. By masking object-level latents and requiring each masked object state to be inferred from the surrounding context, C-JEPA imposes structured partial observability during training, creating counterfactual-like prediction queries that discourage shortcut solutions and make interaction-dependent prediction necessary under the learning objective. Empirically, C-JEPA leads to consistent gains in visual question answering, with an absolute improvement of about 20% in counterfactual reasoning over the same architecture without object-level masking. On agent control tasks, C-JEPA enables substantially more efficient planning by using only 1% of the total latent input features required by patch-based world models, while achieving comparable performance. Finally, we provide a formal analysis demonstrating that object-level masking induces useful inductive bias by controlling observability. Our code is available at https://github.com/galilai-group/cjepa.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 40 of its 54 references that are in the map. First posted on arXiv 11 Feb 2026.

Builds on

40 of 54 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026stable-worldmodel-v1: Reproducible World Modeling Research and Evaluation9 Feb
  2. 2025Object-Centric World Models for Causality-Aware Reinforcement Learning18 Nov
  3. 2025Learning Interactive World Model for Object-Centric Reinforcement Learning4 Nov
  4. 2024SPARTAN: A Sparse Transformer World Model Attending to What Matters11 Nov
  5. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning7 Nov
  6. 2024Revisiting Feature Prediction for Learning Visual Representations from Video15 Feb
  7. 2021Conditional Object-Centric Learning from Video24 Nov
  8. 2019Contrastive Learning of Structured World Models27 Nov
  9. 2018Learning Latent Dynamics for Planning from Pixels12 Nov

Other references · 31

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  4. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  5. 2019Invariant Risk Minimizationcited by 1,832
  6. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
  7. 2020Object-Centric Learning with Slot Attentioncited by 865
  8. 2023Vision Transformers Need Registerscited by 844
  9. 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
  10. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  11. 2015Causal inference using invariant prediction: identification and confidence intervalscited by 533
  12. 2022SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Modelscited by 146
19 more
  1. 2022Simple Unsupervised Object-Centric Learning for Complex and Naturalistic Videoscited by 139
  2. 2019PHYRE: A New Benchmark for Physical Reasoningcited by 137
  3. 2024MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpaintingcited by 101
  4. 2023Object-Centric Learning for Real-World Videos by Predicting Temporal Feature Similaritiescited by 78
  5. 2021Causal Influence Detection for Improving Efficiency in Reinforcement Learningcited by 70
  6. 2020Attention over learned object embeddings enables complex visual reasoningcited by 59
  7. 2021Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learningcited by 53
  8. 2023Self-supervised Object-Centric Learning for Videoscited by 49
  9. 2023Motion-Guided Masking for Spatiotemporal Representation Learningcited by 30
  10. 2021Generative Video Transformer: Can Objects be the Words?cited by 24
  11. 2024SOLD: Slot Object-Centric Latent Dynamics Models for Relational Manipulation Learning from Pixelscited by 23
  12. 2023Masked Images Are Counterfactual Samples for Robust Fine-tuningcited by 20
  13. 2023Object-Centric Video Prediction via Decoupling of Object Dynamics and Interactionscited by 19
  14. 2025Rethinking JEPA: Compute-Efficient Video SSL with Frozen Teacherscited by 11
  15. 2025SMILE: Infusing Spatial and Motion Semantics in Masked Video Learningcited by 9
  16. 2025stable-pretraining-v1: Foundation Model Research Made Simplecited by 9
  17. 2025Object-Centric Pretraining via Target Encoder Bootstrappingcited by 6
  18. 2025Towards Causal Representation Learning with Observable Sources as Auxiliariescited by 1
  19. 2025Dynamic Sparsity: Challenging Common Sparsity Assumptions for Learning World Models in Robotic Reinforcement Learning Benchmarkscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 25.

25 papers.

Sort:

By area:

  1. 2026INTACT: Isomorphic Intent-to-Action Learning for Search-Free World Modelscited by 7
  2. 2026A Generalization Theory for JEPA-Based World Modelscited by 5
  3. 2026Temporal-Distance JEPA: Plan-Aware Representation Learning for Latent World Model Predictive Controlcited by 5
  4. 2026Qantara: Bridge-Flow Training for Multi-Paradigm JEPA Controlcited by 4
  5. 2026From Observation to Insight: Mechanistic World Models and the Quest for Autonomous Discoverycited by 4
  6. 2026Slot-MPC: Goal-Conditioned Model Predictive Control with Object-Centric Representationscited by 3
  7. 2026ProWorld: Progress-Aware Hyperbolic World Models for Long-Horizon Visual Goal Reachingcited by 3
  8. 2026Unifying Object-Centric World Models and Diffusion Policy: A Hierarchical Framework for Multi-Stage Robotic Taskscited by 2
  9. 2026Toward World Modeling of Physiological Signals with Chaos-Theoretic Balancing and Latent Dynamicscited by 0
  10. 2026Einstein World Modelscited by 0
  11. 2026Grounding Spatial Relations in a Compact World Model: Instruction Leakage and a Goal-Free Dynamics Fixcited by 0
  12. 2026Learning Implicit Causal World Models from Multi-Agent Demonstrationscited by 0
13 more
  1. 2026SR-JEPA: Learning Predictive Latent State in 3D Scenescited by 0
  2. 2026Toward a Causal Data Management Ecosystem for Decision Making and Agentic AIcited by 0
  3. 2026Better Slots, Better Worlds: Representation Quality & Robustness in Object-Centric World Modelscited by 0
  4. 2026Conservation Buys Stability and Factoring Buys Counterfactuals in Physical World Modelscited by 0
  5. 2026Representation World Model: Learning States, Transition and Executable Plans in Representationcited by 0
  6. 2026Underwater C3-JEPA: An Object-Centric Cross-View World Model for ROV Salvagecited by 0
  7. 2026I Act Therefore I Am: When Is JEPA's Action-Conditioning Enough to Learn Causal Mechanisms?cited by 0
  8. 2026MultiEcho: An Experimental Science of Learned Worldscited by 0
  9. 2026LRC-JEPA: Disentangling Dynamics and Residual Context for Efficient World Modelscited by 0
  10. 2026Control-Geometry Straightening for Sampling-Based Latent Planningcited by 0
  11. 2026Do-JEPA: From Masking to Intervention in Latent World Modelscited by 0
  12. 2026Stable and Counterfactually Robust Physical World Models from Imposed Structure and Learned Physicscited by 0
  13. 2026CausalDreamer: Learning Predictive World Models with Latent Disentanglementcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Entity-Centric World Models: Interaction-Aware Masking for Causal Video Prediction
  2. 2026World-as-Graph: Relational World Modeling Through Latent Space Graphs
  3. 2026Diagnosing JEPA World Models with Action-Conditioned Predictive Consistency
  4. 2026Orthogonal JEPA: Factorized Predictive States for Latent World Models
  5. 2026UniJEPA: A Unified Joint-Embedding Predictive Architecture for Task-Agnostic Visual World Modeling
  6. 2025seq-JEPA: Autoregressive Predictive Learning of Invariant-Equivariant World Models
  7. 2026No Gaussian Required: Contrastive Inverse Dynamics for JEPA World Models
  8. 2026DLLM-JEPA: Joint Embedding Predictive Architectures for Masked Diffusion Language Models