RD-JEPA: Predictive latent pretraining for few-trajectory transfer across reaction--diffusion equations
Not on the map. Why?
Abstract (arXiv)
Learning surrogates for time-dependent partial differential equations often requires a new simulation corpus when the governing operator changes. We introduce RD-JEPA, a joint-embedding predictive architecture for self-supervised pretraining on reaction-diffusion trajectories. A single model is pretrained on five parameterized systems and then adapted to three held-out systems whose reaction operators and trajectories are excluded from pretraining. Using one, five, or ten complete trajectories from a held-out system, RD-JEPA achieves lower mean relative discrete ℓ2 field error and mean absolute spatial first-difference error than five supervised surrogate baselines, an independently trained control that removes the trajectory-dependent predictive latent pathway, and an architecture-matched model trained from scratch. Within the evaluated equations, output resolution, forecast horizons, and choices of adaptation trajectories, the results indicate that prediction of future-state representations can support data-efficient adaptation across related reaction-diffusion systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 51 references that are in the map. First posted on arXiv 24 Sep 2026.
Builds on
25 of 51 references.
References · 25
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
- 2022Message Passing Neural PDE Solverscited by 368
- 2021Choose a Transformer: Fourier or Galerkincited by 333
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
13 more
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 205
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
- 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 134
- 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 128
- 2023In-Context Operator Learning with Data Prompts for Differential Equation Problemscited by 98
- 2024Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEscited by 58
- 2021Meta-learning PINN loss functionscited by 51
- 2024Towards a Foundation Model for Partial Differential Equations: Multi-Operator Learning and Extrapolationcited by 45
- 2024Data-Efficient Operator Learning via Unsupervised Pretraining and In-Context Learningcited by 32
- 2025PDE-Transformer: Efficient and Versatile Transformers for Physics Simulationscited by 29
- 2023Physics Informed Token Transformer for Solving Partial Differential Equationscited by 21
- 2026Representation Learning for Spatiotemporal Physical Systemscited by 8
- 2026PI-JEPA: Label-Free Surrogate Pretraining for Coupled Multiphysics Simulation via Operator-Split Latent Predictioncited by 3
Built on by
Not cited yet.