PI-JEPA: Label-Free Surrogate Pretraining for Coupled Multiphysics Simulation via Operator-Split Latent Prediction
Not on the map. Why?
Abstract (arXiv)
Reservoir simulation workflows face a fundamental data asymmetry: input parameter fields (geostatistical permeability realizations, porosity distributions) are free to generate in arbitrary quantities, yet existing neural operator surrogates require large corpora of expensive labeled simulation trajectories and cannot exploit this unlabeled structure. We introduce PI-JEPA (Physics-Informed Joint Embedding Predictive Architecture), a surrogate pretraining framework that trains without any completed PDE solves, using masked latent prediction on unlabeled parameter fields under per-sub-operator PDE residual regularization. The predictor bank is structurally aligned with the Lie--Trotter operator-splitting decomposition of the governing equations, dedicating a separate physics-constrained latent module to each sub-process (pressure, saturation transport, reaction), enabling fine-tuning with as few as 100 labeled simulation runs. On single-phase Darcy flow, PI-JEPA achieves 1.9× lower error than FNO and 2.4× lower error than DeepONet at Nℓ=100, with 24% improvement over supervised-only training at Nℓ=500, demonstrating that label-free surrogate pretraining substantially reduces the simulation budget required for multiphysics surrogate deployment.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 34 of its 55 references that are in the map. First posted on arXiv 1 Apr 2026.
Builds on
34 of 55 references.
References · 34
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
22 more
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2017Spectrally-normalized margin bounds for neural networkscited by 681
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
- 2019DeepXDE: A deep learning library for solving differential equationscited by 617
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
- 2021Choose a Transformer: Fourier or Galerkincited by 333
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
- 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
- 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
- 2024Poseidon: Efficient Foundation Models for PDEscited by 186
- 2022MIONet: Learning multiple-input operators via tensor productcited by 180
- 2021Solving and Learning Nonlinear PDEs with Gaussian Processescited by 128
- 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 128
- 2023Multiple Physics Pretraining for Physical Surrogate Modelscited by 90
- 2022Improved Training of Physics-Informed Neural Networks with Model Ensemblescited by 19
- 2021A Deep Learning-Accelerated Data Assimilation and Forecasting Workflow for Commercial-Scale Geologic Carbon Storagecited by 14
- 2022On the inability of Gaussian process regression to optimally learn compositional functionscited by 7
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026AeroJEPA: Learning Semantic Latent Representations for Scalable 3D Aerodynamic Field Modelingcited by 2
- 2026Eradicating Negative Transfer in Multi-Physics Foundation Models via Sparse Mixture-of-Experts Routingcited by 0
- 2026RD-JEPA: Predictive latent pretraining for few-trajectory transfer across reaction--diffusion equationscited by 0
- 2026RD-JEPA: Predictive latent pretraining for few-trajectory transfer across reaction--diffusion equations24 Sep 2026
- 2026Eradicating Negative Transfer in Multi-Physics Foundation Models via Sparse Mixture-of-Experts Routing14 May 2026
- 2026AeroJEPA: Learning Semantic Latent Representations for Scalable 3D Aerodynamic Field Modeling7 May 2026