mlsanityData to 7 Oct 2026

General-Kindred Physics-Informed Neural Network to the Solutions of Singularly Perturbed Differential Equations

arXiv 2408.14734 ↗First posted 27 Aug 2024cs.LG cs.NA math-phcited by 2

Not on the map. Why?

Abstract (arXiv)

Physics-Informed Neural Networks (PINNs) have become a promising research direction in the field of solving Partial Differential Equations (PDEs). Dealing with singular perturbation problems continues to be a difficult challenge in the field of PINN. The solution of singular perturbation problems often exhibits sharp boundary layers and steep gradients, and traditional PINN cannot achieve approximation of boundary layers. In this manuscript, we propose the General-Kindred Physics-Informed Neural Network (GKPINN) for solving Singular Perturbation Differential Equations (SPDEs). This approach utilizes asymptotic analysis to acquire prior knowledge of the boundary layer from the equation and establishes a novel network to assist PINN in approximating the boundary layer. It is compared with traditional PINN by solving examples of one-dimensional, two-dimensional, and time-varying SPDE equations. The research findings underscore the exceptional performance of our novel approach, GKPINN, which delivers a remarkable enhancement in reducing the L2 error by two to four orders of magnitude compared to the established PINN methodology. This significant improvement is accompanied by a substantial acceleration in convergence rates, without compromising the high precision that is critical for our applications. Furthermore, GKPINN still performs well in extreme cases with perturbation parameters of 1×10-38, demonstrating its excellent generalization ability.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 41 references that are in the map. First posted on arXiv 27 Aug 2024.

Builds on

23 of 41 references.

References · 23

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  2. 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
  3. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  4. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
  5. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  6. 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
  7. 2020Universal Differential Equations for Scientific Machine Learningcited by 345
  8. 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 279
  9. 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
  10. 2020hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decompositioncited by 236
  11. 2022A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networkscited by 233
  12. 2020Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanismcited by 231
11 more
  1. 2021Gradient-enhanced physics-informed neural networks for forward and inverse PDE problemscited by 220
  2. 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
  3. 2021Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equationscited by 142
  4. 2020Understanding and mitigating gradient pathologies in physics-informed neural networkscited by 134
  5. 2020Solving Allen-Cahn and Cahn-Hilliard Equations using the Adaptive Physics Informed Neural Networkscited by 122
  6. 2021Efficient training of physics-informed neural networks via importance samplingcited by 109
  7. 2023Residual-based attention in physics-informed neural networkscited by 72
  8. 2021The Old and the New: Can Physics-Informed Deep-Learning Replace Traditional Linear Solvers?cited by 61
  9. 2023Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustnesscited by 60
  10. 2022Enhanced Physics-Informed Neural Networks with Augmented Lagrangian Relaxation Method (AL-PINNs)cited by 35
  11. 2022PIXEL: Physics-Informed Cell Representations for Fast and Accurate PDE Solverscited by 22

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.