VI-PINNs: Variance-involved Physics-informed Neural Networks for Fast and Accurate Prediction of Partial Differential Equations
Not on the map. Why?
Abstract (arXiv)
Although physics-informed neural networks(PINNs) have progressed a lot in many real applications recently, there remains problems to be further studied, such as achieving more accurate results, taking less training time, and quantifying the uncertainty of the predicted results. Recent advances in PINNs have indeed significantly improved the performance of PINNs in many aspects, but few have considered the effect of variance in the training process. In this work, we take into consideration the effect of variance and propose our VI-PINNs to give better predictions. We output two values in the final layer of the network to represent the predicted mean and variance respectively, and the latter is used to represent the uncertainty of the output. A modified negative log-likelihood loss and an auxiliary task are introduced for fast and accurate training. We perform several experiments on a wide range of different problems to highlight the advantages of our approach. The results convey that our method not only gives more accurate predictions but also converges faster.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 55 references that are in the map. First posted on arXiv 30 Nov 2022.
Builds on
31 of 55 references.
References · 31
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2015Automatic differentiation in machine learning: a surveycited by 846
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2019DeepXDE: A deep learning library for solving differential equationscited by 617
- 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 470
- 2016Reinforcement Learning with Unsupervised Auxiliary Taskscited by 400
- 2020B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Datacited by 329
- 2021Physics-informed neural networks with hard constraints for inverse designcited by 277
- 2022A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networkscited by 233
- 2020Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanismcited by 231
19 more
- 2022Uncertainty Quantification in Scientific Machine Learning: Methods, Metrics, and Comparisonscited by 169
- 2022Respecting causality is all you need for training physics-informed neural networkscited by 154
- 2018Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problemscited by 144
- 2021Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equationscited by 142
- 2020Solving Allen-Cahn and Cahn-Hilliard Equations using the Adaptive Physics Informed Neural Networkscited by 122
- 2018Adversarial Uncertainty Quantification in Physics-Informed Neural Networkscited by 120
- 2018Auxiliary Tasks in Multi-task Learningcited by 106
- 2020A Method for Representing Periodic Functions and Enforcing Exactly Periodic Boundary Conditions with Deep Neural Networkscited by 86
- 2021Multi-Objective Loss Balancing for Physics-Informed Deep Learningcited by 86
- 2020A fast and accurate physics-informed neural network reduced order model with shallow masked autoencodercited by 80
- 2021On The Effect of Auxiliary Tasks on Representation Dynamicscited by 56
- 2020Auxiliary Tasks Speed Up Learning PointGoal Navigationcited by 52
- 2019SoftAdapt: Techniques for Adaptive Loss Weighting of Neural Networks with Multi-Part Loss Functionscited by 38
- 2021A novel meta-learning initialization method for physics-informed neural networkscited by 35
- 2020Active learning of deep surrogates for PDEs: Application to metasurface designcited by 28
- 2020Accelerating Physics-Informed Neural Network Training with Prior Dictionariescited by 17
- 2021An extended physics informed neural network for preliminary analysis of parametric optimal control problemscited by 15
- 2022Multi-Output Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Uncertaintiescited by 14
- 2022RANG: A Residual-based Adaptive Node Generation Method for Physics-Informed Neural Networkscited by 14
Built on by
Citing papers per year: 2025: 1.
1 paper.