Coupling-Robust Accuracy in Multiphysics Physics Informed Neural Networks via Kronecker-Preconditioned Optimization
Not on the map. Why?
Abstract (arXiv)
Physics-informed neural networks (PINNs) offer a mesh-free route to solving coupled multiphysics systems, but their accuracy degrades systematically as inter-equation coupling strengthens, and inverse-gradient-norm loss balancing alone does not reliably prevent this failure. This study explains why coupling degrades PINN training and identifies an optimizer structure that removes the dependence, replacing case-by-case tuning with a principled remedy. Through a neural tangent kernel analysis, we prove that the standard kernel's spectral radius grows as Omega(γ2) with coupling strength γ, whereas block-diagonal Gauss-Newton (GN) preconditioning bounds it by the number of networks S, independent of γ; no diagonal preconditioner recovers this bound for any coupling type or loss weighting. We realize block-diagonal GN preconditioning through the Kronecker-preconditioned optimizer SOAP combined with inverse-gradient-norm loss balancing (SOAP+GradNorm) and evaluate it across 222 experiments on four benchmarks of increasing difficulty. Across all systems, SOAP+GradNorm is the only configuration whose degradation remains bounded in every regime tested: it preserves weak-coupling accuracy in linear problems and limits degradation to 2.3× in the nonlinear Nernst-Planck-Poisson system, whereas Adam-based training leaves the L2 error above the 0.1 failure threshold. The same effect applies to a six-residual, four-network, 2D electro-osmotic flow where the electric double layer is resolved down to a Debye length of varepsilon = 0.01 on an x-invariant reference solution. These results recast coupling-induced accuracy loss as a problem of the preconditioner's structure rather than loss weighting and identify Kronecker preconditioning as a structural lever for training PINNs on strongly coupled, stiff multiphysics systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 48 references that are in the map. First posted on arXiv 22 May 2026.
Builds on
22 of 48 references.
References · 22
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
- 2015Automatic differentiation in machine learning: a surveycited by 846
- 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
- 2019DeepXDE: A deep learning library for solving differential equationscited by 617
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
- 2018Shampoo: Preconditioned Stochastic Tensor Optimizationcited by 413
- 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 279
- 2022A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networkscited by 233
- 2024SOAP: Improving and Stabilizing Shampoo using Adamcited by 179
10 more
- 2022Respecting causality is all you need for training physics-informed neural networkscited by 154
- 2023An Expert's Guide to Training Physics-informed Neural Networkscited by 119
- 2023PINNacle: A Comprehensive Benchmark of Physics-Informed Neural Networks for Solving PDEscited by 84
- 2023Residual-based attention in physics-informed neural networkscited by 72
- 2019Physics-Informed Neural Networks for Multiphysics Data Assimilation with Application to Subsurface Transportcited by 60
- 2025Gradient Alignment in Physics-informed Neural Networks: A Second-Order Optimization Perspectivecited by 55
- 2024A New Perspective on Shampoo's Preconditionercited by 54
- 2021Physics-informed neural network simulation of multiphase poroelasticity using stress-split sequential trainingcited by 26
- 2023Mixed formulation of physics-informed neural networks for thermo-mechanically coupled systems and heterogeneous domainscited by 14
- 2024Enriched Physics-informed Neural Networks for Dynamic Poisson-Nernst-Planck Systemscited by 2
Built on by
Not cited yet.