mlsanityData to 7 Oct 2026

JEPA-Anything: Learning Predictive Models across Different Worlds

arXiv 2609.20800 ↗First posted 17 Sep 2026cs.CLcited by 1

On the map: World models → Latent predictive world models also fits: Medical and surgical world models

Abstract (arXiv)

World modeling enables intelligence to anticipate consequences, guide interventions, and learn from interaction. Yet predictive models remain domain-specific: can a common learning principle support world modeling across radically different systems? We introduce JEPA-Anything, a domain-agnostic framework based on orthogonal predictive factorization (OPF). Extending joint-embedding predictive architectures, OPF decomposes latent targets into complementary factors, learns them through dedicated pathways, and recombines them within a shared predictive design. We evaluate JEPA-Anything across seven domains: vision, biology, clinical trajectories, control, molecular dynamics, physical fields, and weather. Experiments span representation learning, intervention prediction, out-of-distribution generalization, and long-horizon dynamics, including 10 matched dynamics tasks, forecasting of over 1,000 clinical events, and 100-step molecular rollouts across four systems. Against matched JEPA baselines, JEPA-Anything improves reported metrics on all 10 dynamics tasks and reduces single-intervention prediction error on Interventional Pong by 34.8%. It achieves the lowest one-step and 100-step molecular errors among compared methods in all four systems. Beyond prediction, a factor-nominated biological intervention receives experimental support in cell co-cultures, patient-derived organoids, tumor fragments, and mice; latent orbital modes recover the Keplerian scaling exponent with a fitted slope of -1.4991. These results support a common factorized predictive principle across heterogeneous worlds, connecting world modeling with intervention and experimentally grounded scientific discovery. Code: https://github.com/Gen-Verse/JEPA-Anything

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 26 of its 38 references that are in the map. First posted on arXiv 17 Sep 2026.

Builds on

26 of 38 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning7 Nov
  2. 2024Revisiting Feature Prediction for Learning Visual Representations from Video15 Feb
  3. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture19 Jan
  4. 2022Joint Embedding Predictive Architectures Focus on Slow Features20 Nov
  5. 2019Contrastive Learning of Structured World Models27 Nov

Other references · 21

  1. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  2. 2025DINOv3cited by 1,297
  3. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  4. 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
  5. 2018DeepMind Control Suitecited by 935
  6. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
  7. 2020Object-Centric Learning with Slot Attentioncited by 865
  8. 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
  9. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  10. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
  11. 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
  12. 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
9 more
  1. 2022CITRIS: Causal Identifiability from Temporal Intervened Sequencescited by 132
  2. 2020CausalWorld: A Robotic Manipulation Benchmark for Causal Structure and Transfer Learningcited by 109
  3. 2024Learning by Reconstruction Produces Uninformative Features For Perceptioncited by 54
  4. 2024APEBench: A Benchmark for Autoregressive Neural Emulators of PDEscited by 51
  5. 2025Force-Free Molecular Dynamics Through Autoregressive Equivariant Networkscited by 13
  6. 2026Cell-JEPA: Latent Representation Learning for Single-Cell Transcriptomicscited by 3
  7. 2026Discovery Foundation Models: Toward Open-Ended Discovery Intelligencecited by 3
  8. 2026ScienceBuddy: Recursive-in-Recursive Self-Improvement for Interactive Scientific Agentscited by 3
  9. 2026ScienceIDE: Turning World's Scientific Codebase into Agent Learnable Environmentscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Orthogonal JEPA: Factorized Predictive States for Latent World Models
  2. 2026Do-JEPA: From Masking to Intervention in Latent World Models
  3. 2026A Generalization Theory for JEPA-Based World Models
  4. 2026JEPA-x: Cross-Predictive Physics Grounding for Forecastable Latent Dynamics
  5. 2026PhyLatent: Learning Dynamics-Relevant Representations for JEPA World Models
  6. 2026Branch-JEPA: Finite-Support Predictive Distributions for JEPA World Models
  7. 2026I Act Therefore I Am: When Is JEPA's Action-Conditioning Enough to Learn Causal Mechanisms?
  8. 2026Mol-JEPA: A multimodal Joint Embedding Predictive Architecture for Molecules