mlsanityData to 14 Oct 2026

Gated Linear Model induced U-net for surrogate modeling and uncertainty quantification

arXiv 2111.05123 ↗First posted 8 Nov 2021stat.ML cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

We propose a novel deep learning based surrogate model for solving high-dimensional uncertainty quantification and uncertainty propagation problems. The proposed deep learning architecture is developed by integrating the well-known U-net architecture with the Gaussian Gated Linear Network (GGLN) and referred to as the Gated Linear Network induced U-net or GLU-net. The proposed GLU-net treats the uncertainty propagation problem as an image to image regression and hence, is extremely data efficient. Additionally, it also provides estimates of the predictive uncertainty. The network architecture of GLU-net is less complex with 44% fewer parameters than the contemporary works. We illustrate the performance of the proposed GLU-net in solving the Darcy flow problem under uncertainty under the sparse data scenario. We consider the stochastic input dimensionality to be up to 4225. Benchmark results are generated using the vanilla Monte Carlo simulation. We observe the proposed GLU-net to be accurate and extremely efficient even when no information about the structure of the inputs is provided to the network. Case studies are performed by varying the training sample size and stochastic input dimensionality to illustrate the robustness of the proposed approach.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 45 references that are in the map. First posted on arXiv 8 Nov 2021.

Builds on

23 of 45 references.

References · 23

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  4. 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 819
  5. 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 732
  6. 2021A Survey of Uncertainty in Deep Neural Networkscited by 680
  7. 2020BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learningcited by 371
  8. 2014Efficient Object Localization Using Convolutional Networkscited by 227
  9. 2020Time Series Data Augmentation for Deep Learning: A Surveycited by 226
  10. 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
  11. 2019An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applicationscited by 118
  12. 2020Transfer learning based multi-fidelity physics informed deep neural networkcited by 68
11 more
  1. 2020Scaling Hamiltonian Monte Carlo Inference for Bayesian Neural Networks with Symmetric Splittingcited by 54
  2. 2019Challenges in Markov chain Monte Carlo for Bayesian neural networkscited by 44
  3. 2019Deep Sub-Ensembles for Fast Uncertainty Estimation in Image Classificationcited by 36
  4. 2020Deeply Uncertain: Comparing Methods of Uncertainty Quantification in Deep Learning Algorithmscited by 34
  5. 2019Gated Linear Networkscited by 26
  6. 2018Normalization in Training U-Net for 2D Biomedical Semantic Segmentationcited by 15
  7. 2020Learnable Bernoulli Dropout for Bayesian Deep Learningcited by 14
  8. 2018Bayesian Policy Optimization for Model Uncertaintycited by 12
  9. 2020Simulation free reliability analysis: A physics-informed deep learning based approachcited by 8
  10. 2021GrADE: A graph based data-driven solver for time-dependent nonlinear partial differential equationscited by 7
  11. 2020Gaussian Gated Linear Networkscited by 6

Built on by

Cited by year

Citing papers per year: 2022: 1.

1 paper.