mlsanityData to 7 Oct 2026

PI-JEPA: Label-Free Surrogate Pretraining for Coupled Multiphysics Simulation via Operator-Split Latent Prediction

arXiv 2604.01349 ↗First posted 1 Apr 2026cs.LG cs.CE physics.comp-phcited by 3

Not on the map. Why?

Abstract (arXiv)

Reservoir simulation workflows face a fundamental data asymmetry: input parameter fields (geostatistical permeability realizations, porosity distributions) are free to generate in arbitrary quantities, yet existing neural operator surrogates require large corpora of expensive labeled simulation trajectories and cannot exploit this unlabeled structure. We introduce PI-JEPA (Physics-Informed Joint Embedding Predictive Architecture), a surrogate pretraining framework that trains without any completed PDE solves, using masked latent prediction on unlabeled parameter fields under per-sub-operator PDE residual regularization. The predictor bank is structurally aligned with the Lie--Trotter operator-splitting decomposition of the governing equations, dedicating a separate physics-constrained latent module to each sub-process (pressure, saturation transport, reaction), enabling fine-tuning with as few as 100 labeled simulation runs. On single-phase Darcy flow, PI-JEPA achieves 1.9× lower error than FNO and 2.4× lower error than DeepONet at Nℓ=100, with 24% improvement over supervised-only training at Nℓ=500, demonstrating that label-free surrogate pretraining substantially reduces the simulation budget required for multiphysics surrogate deployment.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 34 of its 55 references that are in the map. First posted on arXiv 1 Apr 2026.

Builds on

34 of 55 references.

References · 34

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  5. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  6. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  7. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  8. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  9. 2023Mastering Diverse Domains through World Modelscited by 1,193
  10. 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
  11. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  12. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
22 more
  1. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  2. 2017Spectrally-normalized margin bounds for neural networkscited by 681
  3. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
  4. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  5. 2019DeepXDE: A deep learning library for solving differential equationscited by 617
  6. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
  7. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
  8. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
  9. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
  10. 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
  11. 2021Choose a Transformer: Fourier or Galerkincited by 333
  12. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
  13. 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
  14. 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
  15. 2024Poseidon: Efficient Foundation Models for PDEscited by 186
  16. 2022MIONet: Learning multiple-input operators via tensor productcited by 180
  17. 2021Solving and Learning Nonlinear PDEs with Gaussian Processescited by 128
  18. 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 128
  19. 2023Multiple Physics Pretraining for Physical Surrogate Modelscited by 90
  20. 2022Improved Training of Physics-Informed Neural Networks with Model Ensemblescited by 19
  21. 2021A Deep Learning-Accelerated Data Assimilation and Forecasting Workflow for Commercial-Scale Geologic Carbon Storagecited by 14
  22. 2022On the inability of Gaussian process regression to optimally learn compositional functionscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.