Replacing Automatic Differentiation by Sobolev Cubatures fastens Physics Informed Neural Nets and strengthens their Approximation Power
Not on the map. Why?
Abstract (arXiv)
We present a novel class of approximations for variational losses, being applicable for the training of physics-informed neural nets (PINNs). The loss formulation reflects classic Sobolev space theory for partial differential equations and their weak formulations. The loss computation rests on an extension of Gauss-Legendre cubatures, we term Sobolev cubatures, replacing automatic differentiation (A.D.). We prove the runtime complexity of training the resulting Soblev-PINNs (SC-PINNs) to be less than required by PINNs relying on A.D. On top of one-to-two order of magnitude speed-up the SC-PINNs are demonstrated to achieve closer solution approximations for prominent forward and inverse PDE problems than established PINNs achieve.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 8 of its 39 references that are in the map. First posted on arXiv 23 Nov 2022.
Builds on
8 of 39 references.
References · 8
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015Automatic differentiation in machine learning: a surveycited by 855
- 2017DGM: A deep learning algorithm for solving partial differential equationscited by 678
- 2017PDE-Net: Learning PDEs from Datacited by 311
- 2020hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decompositioncited by 236
- 2019Variational Physics-Informed Neural Networks For Solving Partial Differential Equationscited by 148
- 2018Physics-Informed Generative Adversarial Networks for Stochastic Differential Equationscited by 135
- 2021Inverse-Dirichlet Weighting Enables Reliable Training of Physics Informed Neural Networkscited by 43
Built on by
Citing papers per year: 2023: 4.
4 papers.
- 2023Continuous Spatiotemporal Transformerscited by 7
- 2023Ensuring Topological Data-Structure Preservation under Autoencoder Compression due to Latent Space Regularization in Gauss--Legendre nodescited by 2
- 2023Learning Partial Differential Equations by Spectral Approximates of General Sobolev Spacescited by 1
- 2023Zero Coordinate Shift: Whetted Automatic Differentiation for Physics-informed Operator Learningcited by 0
- 2023Zero Coordinate Shift: Whetted Automatic Differentiation for Physics-informed Operator Learning1 Nov 2023
- 2023Ensuring Topological Data-Structure Preservation under Autoencoder Compression due to Latent Space Regularization in Gauss--Legendre nodes15 Sep 2023
- 2023Continuous Spatiotemporal Transformers31 Jan 2023
- 2023Learning Partial Differential Equations by Spectral Approximates of General Sobolev Spaces12 Jan 2023