mlsanityData to 14 Oct 2026

Use of Multifidelity Training Data and Transfer Learning for Efficient Construction of Subsurface Flow Surrogate Models

arXiv 2204.11138 ↗First posted 23 Apr 2022cs.LG physics.geo-phcited by 11

Not on the map. Why?

Abstract (arXiv)

Data assimilation presents computational challenges because many high-fidelity models must be simulated. Various deep-learning-based surrogate modeling techniques have been developed to reduce the simulation costs associated with these applications. However, to construct data-driven surrogate models, several thousand high-fidelity simulation runs may be required to provide training samples, and these computations can make training prohibitively expensive. To address this issue, in this work we present a framework where most of the training simulations are performed on coarsened geomodels. These models are constructed using a flow-based upscaling method. The framework entails the use of a transfer-learning procedure, incorporated within an existing recurrent residual U-Net architecture, in which network training is accomplished in three steps. In the first step. where the bulk of the training is performed, only low-fidelity simulation results are used. The second and third steps, in which the output layer is trained and the overall network is fine-tuned, require a relatively small number of high-fidelity simulations. Here we use 2500 low-fidelity runs and 200 high-fidelity runs, which leads to about a 90% reduction in training simulation costs. The method is applied for two-phase subsurface flow in 3D channelized systems, with flow driven by wells. The surrogate model trained with multifidelity data is shown to be nearly as accurate as a reference surrogate trained with only high-fidelity data in predicting dynamic pressure and saturation fields in new geomodels. Importantly, the network provides results that are significantly more accurate than the low-fidelity simulations used for most of the training. The multifidelity surrogate is also applied for history matching using an ensemble-based procedure, where accuracy relative to reference results is again demonstrated.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 14 of its 31 references that are in the map. First posted on arXiv 23 Apr 2022.

Builds on

14 of 31 references.

References · 14

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
  3. 2019Physics-Informed Neural Networks for Multiphysics Data Assimilation with Application to Subsurface Transportcited by 61
  4. 2019A deep-learning-based surrogate model for data assimilation in dynamic subsurface flow problemscited by 59
  5. 2018Deep convolutional encoder-decoder networks for uncertainty quantification of dynamic multiphase flow in heterogeneous mediacited by 56
  6. 2019Deep Learning of Subsurface Flow via Theory-guided Neural Networkcited by 32
  7. 2018Deep autoregressive neural networks for high-dimensional inverse problems in groundwater contaminant source identificationcited by 26
  8. 2020On transfer learning of neural networks using bi-fidelity data for uncertainty propagationcited by 26
  9. 2020Multi-fidelity Generative Deep Learning Turbulent Flowscited by 21
  10. 2021Transfer Learning on Multi-Fidelity Datacited by 18
  11. 2020Efficient Uncertainty Quantification for Dynamic Subsurface Flow with Surrogate by Theory-guided Neural Networkcited by 17
  12. 20203D CNN-PCA: A Deep-Learning-Based Parameterization for Complex Geomodelscited by 13
2 more
  1. 2020Theory-guided Auto-Encoder for Surrogate Construction and Inverse Modelingcited by 12
  2. 2019Integration of adversarial autoencoders with residual dense convolutional networks for estimation of non-Gaussian hydraulic conductivitiescited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 4; 2024: 5; 2025: 1; 2026: 1.

11 papers.