mlsanityData to 7 Oct 2026

Coupling-Robust Accuracy in Multiphysics Physics Informed Neural Networks via Kronecker-Preconditioned Optimization

arXiv 2605.23391 ↗First posted 22 May 2026cs.LG cs.NA math.NAcited by 0

Not on the map. Why?

Abstract (arXiv)

Physics-informed neural networks (PINNs) offer a mesh-free route to solving coupled multiphysics systems, but their accuracy degrades systematically as inter-equation coupling strengthens, and inverse-gradient-norm loss balancing alone does not reliably prevent this failure. This study explains why coupling degrades PINN training and identifies an optimizer structure that removes the dependence, replacing case-by-case tuning with a principled remedy. Through a neural tangent kernel analysis, we prove that the standard kernel's spectral radius grows as Omega(γ2) with coupling strength γ, whereas block-diagonal Gauss-Newton (GN) preconditioning bounds it by the number of networks S, independent of γ; no diagonal preconditioner recovers this bound for any coupling type or loss weighting. We realize block-diagonal GN preconditioning through the Kronecker-preconditioned optimizer SOAP combined with inverse-gradient-norm loss balancing (SOAP+GradNorm) and evaluate it across 222 experiments on four benchmarks of increasing difficulty. Across all systems, SOAP+GradNorm is the only configuration whose degradation remains bounded in every regime tested: it preserves weak-coupling accuracy in linear problems and limits degradation to 2.3× in the nonlinear Nernst-Planck-Poisson system, whereas Adam-based training leaves the L2 error above the 0.1 failure threshold. The same effect applies to a six-residual, four-network, 2D electro-osmotic flow where the electric double layer is resolved down to a Debye length of varepsilon = 0.01 on an x-invariant reference solution. These results recast coupling-induced accuracy loss as a problem of the preconditioner's structure rather than loss weighting and identify Kronecker preconditioning as a structural lever for training PINNs on strongly coupled, stiff multiphysics systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 48 references that are in the map. First posted on arXiv 22 May 2026.

Builds on

22 of 48 references.

References · 22

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
  3. 2015Automatic differentiation in machine learning: a surveycited by 846
  4. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
  5. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
  6. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  7. 2019DeepXDE: A deep learning library for solving differential equationscited by 617
  8. 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
  9. 2018Shampoo: Preconditioned Stochastic Tensor Optimizationcited by 413
  10. 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 279
  11. 2022A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networkscited by 233
  12. 2024SOAP: Improving and Stabilizing Shampoo using Adamcited by 179
10 more
  1. 2022Respecting causality is all you need for training physics-informed neural networkscited by 154
  2. 2023An Expert's Guide to Training Physics-informed Neural Networkscited by 119
  3. 2023PINNacle: A Comprehensive Benchmark of Physics-Informed Neural Networks for Solving PDEscited by 84
  4. 2023Residual-based attention in physics-informed neural networkscited by 72
  5. 2019Physics-Informed Neural Networks for Multiphysics Data Assimilation with Application to Subsurface Transportcited by 60
  6. 2025Gradient Alignment in Physics-informed Neural Networks: A Second-Order Optimization Perspectivecited by 55
  7. 2024A New Perspective on Shampoo's Preconditionercited by 54
  8. 2021Physics-informed neural network simulation of multiphase poroelasticity using stress-split sequential trainingcited by 26
  9. 2023Mixed formulation of physics-informed neural networks for thermo-mechanically coupled systems and heterogeneous domainscited by 14
  10. 2024Enriched Physics-informed Neural Networks for Dynamic Poisson-Nernst-Planck Systemscited by 2

Built on by

Not cited yet.