mlsanityData to 14 Oct 2026

Phys-JEPA: Physics-Informed Latent World Models for Multivariate Time-Series Forecasting

arXiv 2606.16076 ↗First posted 15 Jun 2026cs.LG cs.AI cs.GTcited by 4

On the map: World models → Latent predictive world models

Abstract (arXiv)

Multivariate forecasting in physical systems requires models that predict coupled temporal variables while preserving meaningful state evolution. Deep forecasters can fit temporal correlations, and physics-informed models can regularize predictions with scientific constraints, but these directions are often connected only at the decoded-output level. As a result, the hidden predictive state that generates future trajectories may remain statistically useful but physically unstructured. We introduce Phys-JEPA, a physics-informed joint-embedding predictive architecture for multivariate time-series forecasting. Phys-JEPA learns a latent world model in which predictive states are decomposed into physical and residual components, and physical consistency is imposed directly on latent states and latent transitions rather than only on decoded forecasts. This formulation uses known physical variables to organize the representation space while retaining residual capacity for unresolved dynamics. On Jena Climate 2009--2016, Phys-JEPA reduces aggregate MSE from 0.12482 to 0.12273 and temperature MSE from 0.01892 to 0.01831 at H=24. On Traffic, full Phys-JEPA improves aggregate MSE over the supervised baseline across all tested horizons, reducing H=192 MSE from 0.800784 to 0.773873. On Electricity, the best variant depends on horizon: static latent consistency is strongest at H=24 and H=48, while full Phys-JEPA gives the best aggregate and target-variable MSE at H=192. These initial results suggest that moving physics-informed learning from output space to latent predictive state space is a promising direction for interpretable temporal world models.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 21 of its 28 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

21 of 28 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Revisiting Feature Prediction for Learning Visual Representations from Video15 Feb
  2. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture19 Jan

Other references · 19

  1. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  2. 2018Neural Ordinary Differential Equationscited by 3,779
  3. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  4. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  6. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
  7. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  8. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  9. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  10. 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,057
  11. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  12. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
7 more
  1. 2019Hamiltonian Neural Networkscited by 712
  2. 2020Universal Differential Equations for Scientific Machine Learningcited by 353
  3. 2019Latent ODEs for Irregularly-Sampled Time Seriescited by 183
  4. 2017Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modelingcited by 131
  5. 2020Physics-Guided Machine Learning for Scientific Discovery: An Application in Simulating Lake Temperature Profilescited by 59
  6. 2024T-JEPA: A Joint-Embedding Predictive Architecture for Trajectory Similarity Computationcited by 12
  7. 2024LaT-PFN: A Joint Embedding Predictive Architecture for In-context Time-series Forecastingcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Generalizable Physics-Enhanced State Space Model for Long-Term Dynamics Forecasting in Complex Environments
  2. 2026Orthogonal JEPA: Factorized Predictive States for Latent World Models
  3. 2026Branch-JEPA: Finite-Support Predictive Distributions for JEPA World Models
  4. 2026WorldTS: World Modeling for Multimodal Covariate-aware Time Series Forecasting
  5. 2026A Decomposition-based State Space Model for Multivariate Time-Series Forecasting
  6. 2023PreDiff: Precipitation Nowcasting with Latent Diffusion Models
  7. 2026UniMamba: A Unified Spatial-Temporal Modeling Framework with State-Space and Attention Integration
  8. 2026A Generalization Theory for JEPA-Based World Models