mlsanityData to 7 Oct 2026

Attention U-Net as a surrogate model for groundwater prediction

arXiv 2204.04518 ↗First posted 9 Apr 2022cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Numerical simulations of groundwater flow are used to analyze and predict the response of an aquifer system to its change in state by approximating the solution of the fundamental groundwater physical equations. The most used and classical methodologies, such as Finite Difference (FD) and Finite Element (FE) Methods, use iterative solvers which are associated with high computational cost. This study proposes a physics-based convolutional encoder-decoder neural network as a surrogate model to quickly calculate the response of the groundwater system. Holding strong promise in cross-domain mappings, encoder-decoder networks are applicable for learning complex input-output mappings of physical systems. This manuscript presents an Attention U-Net model that attempts to capture the fundamental input-output relations of the groundwater system and generates solutions of hydraulic head in the whole domain given a set of physical parameters and boundary conditions. The model accurately predicts the steady state response of a highly heterogeneous groundwater system given the locations and piezometric head of up to 3 wells as input. The network learns to pay attention only in the relevant parts of the domain and the generated hydraulic head field corresponds to the target samples in great detail. Even relative to coarse finite difference approximations the proposed model is shown to be significantly faster than a comparative state-of-the-art numerical solver, thus providing a base for further development of the presented networks as surrogate models for groundwater prediction.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 18 of its 47 references that are in the map. First posted on arXiv 9 Apr 2022.

Builds on

18 of 47 references.

References · 18

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  4. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  5. 2014Going Deeper with Convolutionscited by 4,231
  6. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  7. 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
  8. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  9. 2021Transformers in Vision: A Surveycited by 1,009
  10. 2016Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networkscited by 541
  11. 2018Attention Gated Networks: Learning to Leverage Salient Regions in Medical Imagescited by 271
  12. 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
6 more
  1. 2019Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networkscited by 127
  2. 2019An Attentive Survey of Attention Modelscited by 123
  3. 2019Attention in Natural Language Processingcited by 100
  4. 2018Deep convolutional encoder-decoder networks for uncertainty quantification of dynamic multiphase flow in heterogeneous mediacited by 56
  5. 2018Structured Bayesian Gaussian process latent variable model: applications to data-driven dimensionality reduction and high-dimensional inversioncited by 9
  6. 2018Discovering state-parameter mappings in subsurface models using generative adversarial networkscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 1.

3 papers.