Progressive reduced order modeling: empowering data-driven modeling with selective knowledge transfer
Not on the map. Why?
Abstract (arXiv)
Data-driven modeling can suffer from a constant demand for data, leading to reduced accuracy and impractical for engineering applications due to the high cost and scarcity of information. To address this challenge, we propose a progressive reduced order modeling framework that minimizes data cravings and enhances data-driven modeling's practicality. Our approach selectively transfers knowledge from previously trained models through gates, similar to how humans selectively use valuable knowledge while ignoring unuseful information. By filtering relevant information from previous models, we can create a surrogate model with minimal turnaround time and a smaller training set that can still achieve high accuracy. We have tested our framework in several cases, including transport in porous media, gravity-driven flow, and finite deformation in hyperelastic materials. Our results illustrate that retaining information from previous models and utilizing a valuable portion of that knowledge can significantly improve the accuracy of the current model. We have demonstrated the importance of progressive knowledge transfer and its impact on model accuracy with reduced training samples. For instance, our framework with four parent models outperforms the no-parent counterpart trained on data nine times larger. Our research unlocks data-driven modeling's potential for practical engineering applications by mitigating the data scarcity issue. Our proposed framework is a significant step toward more efficient and cost-effective data-driven modeling, fostering advancements across various fields.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 47 references that are in the map. First posted on arXiv 4 Oct 2023.
Builds on
19 of 47 references.
References · 19
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2016Progressive Neural Networkscited by 1,361
- 2019A Comprehensive Survey on Transfer Learningcited by 1,160
- 2021A Neural Network Solves, Explains, and Generates University Math Problems by Program Synthesis and Few-Shot Learning at Human Levelcited by 96
- 2022Deep transfer operator learning for partial differential equations under conditional shiftcited by 83
- 2022Learning two-phase microstructure evolution using neural operators and autoencoder architecturescited by 72
- 2022Real-time high-resolution CO2 geological storage prediction using nested Fourier neural operatorscited by 47
- 2021A framework for data-driven solution and parameter estimation of PDEs using conditional generative adversarial networkscited by 30
- 2021Non-intrusive reduced order modeling of natural convection in porous media using convolutional autoencoders: comparison with linear subspace techniquescited by 23
7 more
- 2022Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learningcited by 12
- 2020MFNets: Data efficient all-at-once learning of multifidelity surrogates as directed networks of information sourcescited by 10
- 2022Physics-informed machine learning with differentiable programming for heterogeneous underground reservoir pressure managementcited by 7
- 2020A Locally Conservative Mixed Finite Element Framework for Coupled Hydro-Mechanical-Chemical Processes in Heterogeneous Porous Mediacited by 5
- 2021Data Assimilation Predictive GAN (DA-PredGAN): applied to determine the spread of COVID-19cited by 4
- 2021Gated Information Bottleneck for Generalization in Sequential Environmentscited by 3
- 2023Gate Recurrent Unit Network based on Hilbert-Schmidt Independence Criterion for State-of-Health Estimationcited by 1
Built on by
Not cited yet.