Learning Physics from an Imperfect Ancestor
Not on the map. Why?
Abstract (arXiv)
Neural operators evaluate parametric partial differential equations cheaply but degrade sharply outside their training distribution. Physics-informed neural networks avoid dependence on labeled data, yet their optimization can be basin-fragile: when the governing residual admits multiple solutions, a PINN trained from scratch may converge to a physically incorrect state despite achieving a small residual. We show that these failure modes can be addressed jointly: an imperfect NO provides the structural prior needed to place a PINN in the correct solution basin, while the PDE residual refines the solution beyond the operator's accuracy. We introduce a three-stage framework that freezes the spatial basis of a physics-informed NO, extrapolates its solution branch to an out-of-distribution parameter using a polynomial continuation prior, and distills the resulting field into a fresh PINN. The NO need not be accurate at the target; it transfers solution-branch information, while PDE residual minimization in the PINN governs convergence. We evaluate the framework on three nonlinear PDEs: 1D viscous Burgers, 2D steady Allen-Cahn near a pitchfork bifurcation, and 2D steady lid-driven cavity flow. For Allen-Cahn, where the trivial solution satisfies the PDE residual exactly, a standard PINN collapses to the trivial zero branch, whereas distillation from the crude extrapolated operator recovers the non-trivial branch that matches the finite-difference reference. For the lid-driven cavity, extrapolating to a Reynolds number of Re = 3200 accelerates convergence to the correct physical state, achieving competitive accuracy using fewer parameters and optimization steps than recent literature baselines. These results establish a simple principle: an NO need not accurately predict the solution to be useful; it only needs to identify the correct basin from which PINN optimization can recover it.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 40 references that are in the map. First posted on arXiv 21 Sep 2026.
Builds on
22 of 40 references.
References · 22
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
- 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 279
- 2021Physics-informed neural networks with hard constraints for inverse designcited by 277
- 2022A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networkscited by 233
10 more
- 2021Gradient-enhanced physics-informed neural networks for forward and inverse PDE problemscited by 220
- 2023An Expert's Guide to Training Physics-informed Neural Networkscited by 119
- 2019Transfer learning enhanced physics informed neural network for phase-field modeling of fracturecited by 116
- 2022Deep transfer operator learning for partial differential equations under conditional shiftcited by 83
- 2024PirateNets: Physics-informed Deep Learning with Residual Adaptive Networkscited by 70
- 2020Transfer learning based multi-fidelity physics informed deep neural networkcited by 68
- 2021One-Shot Transfer Learning of Physics-Informed Neural Networkscited by 49
- 2025NOWS: Neural Operator Warm Starts for Accelerating Iterative Solverscited by 9
- 2024Causality-Respecting Adaptive Refinement for PINNs: Enabling Precise Interface Evolution in Phase Field Modelingcited by 3
- 2024STONet: A neural operator for modeling solute transport in micro-cracked reservoirscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Transferability of Learned States in Neural PDE Solverscited by 0
- 2026Transferability of Learned States in Neural PDE Solvers7 Oct 2026