mlsanityData to 7 Oct 2026

Learning Physics from an Imperfect Ancestor

arXiv 2609.24947 ↗First posted 21 Sep 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Neural operators evaluate parametric partial differential equations cheaply but degrade sharply outside their training distribution. Physics-informed neural networks avoid dependence on labeled data, yet their optimization can be basin-fragile: when the governing residual admits multiple solutions, a PINN trained from scratch may converge to a physically incorrect state despite achieving a small residual. We show that these failure modes can be addressed jointly: an imperfect NO provides the structural prior needed to place a PINN in the correct solution basin, while the PDE residual refines the solution beyond the operator's accuracy. We introduce a three-stage framework that freezes the spatial basis of a physics-informed NO, extrapolates its solution branch to an out-of-distribution parameter using a polynomial continuation prior, and distills the resulting field into a fresh PINN. The NO need not be accurate at the target; it transfers solution-branch information, while PDE residual minimization in the PINN governs convergence. We evaluate the framework on three nonlinear PDEs: 1D viscous Burgers, 2D steady Allen-Cahn near a pitchfork bifurcation, and 2D steady lid-driven cavity flow. For Allen-Cahn, where the trivial solution satisfies the PDE residual exactly, a standard PINN collapses to the trivial zero branch, whereas distillation from the crude extrapolated operator recovers the non-trivial branch that matches the finite-difference reference. For the lid-driven cavity, extrapolating to a Reynolds number of Re = 3200 accelerates convergence to the correct physical state, achieving competitive accuracy using fewer parameters and optimization steps than recent literature baselines. These results establish a simple principle: an NO need not accurately predict the solution to be useful; it only needs to identify the correct basin from which PINN optimization can recover it.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 40 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

22 of 40 references.

References · 22

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  3. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  4. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  5. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  6. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
  7. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
  8. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  9. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
  10. 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 279
  11. 2021Physics-informed neural networks with hard constraints for inverse designcited by 277
  12. 2022A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networkscited by 233
10 more
  1. 2021Gradient-enhanced physics-informed neural networks for forward and inverse PDE problemscited by 220
  2. 2023An Expert's Guide to Training Physics-informed Neural Networkscited by 119
  3. 2019Transfer learning enhanced physics informed neural network for phase-field modeling of fracturecited by 116
  4. 2022Deep transfer operator learning for partial differential equations under conditional shiftcited by 83
  5. 2024PirateNets: Physics-informed Deep Learning with Residual Adaptive Networkscited by 70
  6. 2020Transfer learning based multi-fidelity physics informed deep neural networkcited by 68
  7. 2021One-Shot Transfer Learning of Physics-Informed Neural Networkscited by 49
  8. 2025NOWS: Neural Operator Warm Starts for Accelerating Iterative Solverscited by 9
  9. 2024Causality-Respecting Adaptive Refinement for PINNs: Enabling Precise Interface Evolution in Phase Field Modelingcited by 3
  10. 2024STONet: A neural operator for modeling solute transport in micro-cracked reservoirscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.