Error Analysis of Physics-Informed Neural Networks for Approximating Dynamic PDEs of Second Order in Time
Not on the map. Why?
Abstract (arXiv)
We consider the approximation of a class of dynamic partial differential equations (PDE) of second order in time by the physics-informed neural network (PINN) approach, and provide an error analysis of PINN for the wave equation, the Sine-Gordon equation and the linear elastodynamic equation. Our analyses show that, with feed-forward neural networks having two hidden layers and the tanh activation function, the PINN approximation errors for the solution field, its time derivative and its gradient field can be effectively bounded by the training loss and the number of training data points (quadrature points). Our analyses further suggest new forms for the training loss function, which contain certain residuals that are crucial to the error estimate but would be absent from the canonical PINN loss formulation. Adopting these new forms for the loss function leads to a variant PINN algorithm. We present ample numerical experiments with the new PINN algorithm for the wave equation, the Sine-Gordon equation and the linear elastodynamic equation, which show that the method can capture the solution well.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 63 references that are in the map. First posted on arXiv 22 Mar 2023.
Builds on
29 of 63 references.
References · 29
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
- 2019DeepXDE: A deep learning library for solving differential equationscited by 617
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
- 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
- 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
- 2018Deep Learning Methods for Reynolds-Averaged Navier-Stokes Simulations of Airfoil Flowscited by 147
- 2020Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating PDEscited by 115
- 2020Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating a class of inverse problems for PDEscited by 101
- 2019Deep Neural Network Approximation Theorycited by 92
17 more
- 2020A Method for Representing Periodic Functions and Enforcing Exactly Periodic Boundary Conditions with Deep Neural Networkscited by 86
- 2021On the approximation of functions by tanh neural networkscited by 81
- 2020Local Extreme Learning Machines and Domain Decomposition for Solving Linear and Nonlinear Partial Differential Equationscited by 78
- 2022Error estimates for physics informed neural networks approximating the Navier-Stokes equationscited by 63
- 2017Machine learning approximation algorithms for high-dimensional fully nonlinear partial differential equations and second-order backward stochastic differential equationscited by 62
- 2023A unified scalable framework for causal sweeping strategies for Physics-Informed Neural Networks (PINNs) and their temporal decompositionscited by 48
- 2018Analysis of the Generalization Error: Empirical Risk Minimization over Deep Artificial Neural Networks Overcomes the Curse of Dimensionality in the Numerical Approximation of Black-Scholes Partial Differential Equationscited by 44
- 2019Robust Training and Initialization of Deep Neural Networks: An Adaptive Basis Viewpointcited by 42
- 2019MgNet: A Unified Framework of Multigrid and Convolutional Neural Networkcited by 41
- 2020Physics Informed Neural Networks for Simulating Radiative Transfercited by 35
- 2019Deep least-squares methods: an unsupervised learning-based numerical method for solving elliptic PDEscited by 27
- 2021On Computing the Hyperparameter of Extreme Learning Machines: Algorithm and Application to Computational PDEs, and Comparison with Classical and High-Order Finite Elementscited by 25
- 2020Enhancing accuracy of deep learning algorithms by training with low-discrepancy sequencescited by 20
- 2022A Method for Computing Inverse Parametric PDE Problems with Random-Weight Neural Networkscited by 14
- 2021A Modified Batch Intrinsic Plasticity Method for Pre-training the Random Coefficients of Extreme Learning Machinescited by 13
- 2020VAE-KRnet and its applications to variational Bayescited by 11
- 2022Numerical Approximation of Partial Differential Equations by a Variable Projection Method with Artificial Neural Networkscited by 8
Built on by
Citing papers per year: 2024: 1.
1 paper.