Bayesian neural networks for predicting uncertainty in full-field material response
Not on the map. Why?
Abstract (arXiv)
Stress and material deformation field predictions are among the most important tasks in computational mechanics. These predictions are typically made by solving the governing equations of continuum mechanics using finite element analysis, which can become computationally prohibitive considering complex microstructures and material behaviors. Machine learning (ML) methods offer potentially cost effective surrogates for these applications. However, existing ML surrogates are either limited to low-dimensional problems and/or do not provide uncertainty estimates in the predictions. This work proposes an ML surrogate framework for stress field prediction and uncertainty quantification for diverse materials microstructures. A modified Bayesian U-net architecture is employed to provide a data-driven image-to-image mapping from initial microstructure to stress field with prediction (epistemic) uncertainty estimates. The Bayesian posterior distributions for the U-net parameters are estimated using three state-of-the-art inference algorithms: the posterior sampling-based Hamiltonian Monte Carlo method and two variational approaches, the Monte-Carlo Dropout method and the Bayes by Backprop algorithm. A systematic comparison of the predictive accuracy and uncertainty estimates for these methods is performed for a fiber reinforced composite material and polycrystalline microstructure application. It is shown that the proposed methods yield predictions of high accuracy compared to the FEA solution, while uncertainty estimates depend on the inference approach. Generally, the Hamiltonian Monte Carlo and Bayes by Backprop methods provide consistent uncertainty estimates. Uncertainty estimates from Monte Carlo Dropout, on the other hand, are more difficult to interpret and depend strongly on the method's design.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 44 of its 104 references that are in the map. First posted on arXiv 21 Jun 2024.
Builds on
44 of 104 references.
References · 44
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2020Bayesian Deep Learning and a Probabilistic Perspective of Generalizationcited by 480
- 2020Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Userscited by 336
- 2020B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Datacited by 329
- 2013Black Box Variational Inferencecited by 317
32 more
- 2021What Are Bayesian Neural Network Posteriors Really Like?cited by 307
- 2018A Probabilistic U-Net for Segmentation of Ambiguous Imagescited by 281
- 2016Molecular Graph Convolutions: Moving Beyond Fingerprintscited by 238
- 2015Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understandingcited by 218
- 2017A Conceptual Introduction to Hamiltonian Monte Carlocited by 207
- 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
- 2022Uncertainty Quantification in Scientific Machine Learning: Methods, Metrics, and Comparisonscited by 169
- 2017Multiplicative Normalizing Flows for Variational Bayesian Neural Networkscited by 157
- 2020Stochastic Segmentation Networks: Modelling Spatially Correlated Aleatoric Uncertaintycited by 100
- 2018Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantificationcited by 81
- 2019A Hierarchical Probabilistic U-Net for Modeling Multi-Scale Ambiguitiescited by 65
- 2018Deep convolutional encoder-decoder networks for uncertainty quantification of dynamic multiphase flow in heterogeneous mediacited by 56
- 2020Scaling Hamiltonian Monte Carlo Inference for Bayesian Neural Networks with Symmetric Splittingcited by 54
- 2019A Comprehensive guide to Bayesian Convolutional Neural Network with Variational Inferencecited by 51
- 2022A new family of Constitutive Artificial Neural Networks towards automated model discoverycited by 48
- 2019Challenges in Markov chain Monte Carlo for Bayesian neural networkscited by 43
- 2020Whence the Expected Free Energy?cited by 40
- 2015Black-box α-divergence Minimizationcited by 37
- 2018A deep material network for multiscale topology learning and accelerated nonlinear modeling of heterogeneous materialscited by 31
- 2018Stress Field Prediction in Cantilevered Structures Using Convolutional Neural Networkscited by 25
- 2021Stress field prediction in fiber-reinforced composite materials using a deep learning approachcited by 22
- 2020Notes on the Behavior of MC Dropoutcited by 21
- 2020Unlabelled Data Improves Bayesian Uncertainty Calibration under Covariate Shiftcited by 19
- 2021Manifold learning-based polynomial chaos expansions for high-dimensional surrogate modelscited by 16
- 2019On the Validity of Bayesian Neural Networks for Uncertainty Estimationcited by 14
- 2021Bayesian multiscale deep generative model for the solution of high-dimensional inverse problemscited by 12
- 2019We Know Where We Don't Know: 3D Bayesian CNNs for Credible Geometric Uncertaintycited by 9
- 2023Uncertainty Quantification for Molecular Property Predictions with Graph Neural Architecture Searchcited by 8
- 2022Jensen-Shannon Divergence Based Novel Loss Functions for Bayesian Neural Networkscited by 6
- 2024Polynomial Chaos Expansions on Principal Geodesic Grassmannian Submanifolds for Surrogate Modeling and Uncertainty Quantificationcited by 6
- 2020Predicting Mechanical Properties from Microstructure Images in Fiber-reinforced Polymers using Convolutional Neural Networkscited by 5
- 2023Probabilistic Neural Data Fusion for Learning from an Arbitrary Number of Multi-fidelity Data Setscited by 5
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 1.
5 papers.
- 2024Learning signals defined on graphs with optimal transport and Gaussian process regressioncited by 1
- 2025Accelerating Hamiltonian Monte Carlo for Bayesian Inference in Neural Networks and Neural Operatorscited by 1
- 2025Microstructure-based Variational Neural Networks for Robust Uncertainty Quantification in Materials Digital Twinscited by 1
- 2026Physics-constrained Gaussian Processes for Predicting Shockwave Hugoniot Curvescited by 1
- 2025Real-Time Structural Health Monitoring with Bayesian Neural Networks: Distinguishing Aleatoric and Epistemic Uncertainty for Digital Twin Frameworkscited by 0
- 2026Physics-constrained Gaussian Processes for Predicting Shockwave Hugoniot Curves10 Jan 2026
- 2025Microstructure-based Variational Neural Networks for Robust Uncertainty Quantification in Materials Digital Twins19 Dec 2025
- 2025Real-Time Structural Health Monitoring with Bayesian Neural Networks: Distinguishing Aleatoric and Epistemic Uncertainty for Digital Twin Frameworks2 Dec 2025
- 2025Accelerating Hamiltonian Monte Carlo for Bayesian Inference in Neural Networks and Neural Operators19 Jul 2025
- 2024Learning signals defined on graphs with optimal transport and Gaussian process regression21 Oct 2024