Transfer learning based multi-fidelity physics informed deep neural network
Not on the map. Why?
Abstract (arXiv)
For many systems in science and engineering, the governing differential equation is either not known or known in an approximate sense. Analyses and design of such systems are governed by data collected from the field and/or laboratory experiments. This challenging scenario is further worsened when data-collection is expensive and time-consuming. To address this issue, this paper presents a novel multi-fidelity physics informed deep neural network (MF-PIDNN). The framework proposed is particularly suitable when the physics of the problem is known in an approximate sense (low-fidelity physics) and only a few high-fidelity data are available. MF-PIDNN blends physics informed and data-driven deep learning techniques by using the concept of transfer learning. The approximate governing equation is first used to train a low-fidelity physics informed deep neural network. This is followed by transfer learning where the low-fidelity model is updated by using the available high-fidelity data. MF-PIDNN is able to encode useful information on the physics of the problem from the it approximate governing differential equation and hence, provides accurate prediction even in zones with no data. Additionally, no low-fidelity data is required for training this model. Applicability and utility of MF-PIDNN are illustrated in solving four benchmark reliability analysis problems. Case studies to illustrate interesting features of the proposed approach are also presented.
Key facts. Cited by 68 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 13; 2023: 16; 2024: 15; 2025: 9; 2026: 5.
68 papers.
Sort:
- 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 128
- 2023An Expert's Guide to Training Physics-informed Neural Networkscited by 119
- 2023In-Context Operator Learning with Data Prompts for Differential Equation Problemscited by 98
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2021Multi-Objective Loss Balancing for Physics-Informed Deep Learningcited by 86
- 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 77
- 2024PirateNets: Physics-informed Deep Learning with Residual Adaptive Networkscited by 70
- 2022Multifidelity Deep Operator Networks For Data-Driven and Physics-Informed Problemscited by 57
- 2021A novel meta-learning initialization method for physics-informed neural networkscited by 35
- 2024PDE Generalization of In-Context Operator Networks: A Study on 1D Scalar Nonlinear Conservation Lawscited by 30
- 2023Physics informed WNOcited by 26
- 2022Partial Differential Equations Meet Deep Neural Networks: A Surveycited by 25
38 more
- 2022Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flowcited by 20
- 2025Transfer Learning in Physics-Informed Neural Networks: Full Fine-Tuning, Lightweight Fine-Tuning, and Low-Rank Adaptationcited by 14
- 2023TransNet: Transferable Neural Networks for Partial Differential Equationscited by 13
- 2022Multi-fidelity wavelet neural operator with application to uncertainty quantificationcited by 12
- 2022Assessment of DeepONet for reliability analysis of stochastic nonlinear dynamical systemscited by 11
- 2023A Latent Variable Approach for Non-Hierarchical Multi-Fidelity Adaptive Samplingcited by 10
- 2023A foundational neural operator that continuously learns without forgettingcited by 10
- 2025Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunitiescited by 10
- 2024Physics-Informed Neural Networks for High-Frequency and Multi-Scale Problems using Transfer Learningcited by 9
- 2024Initialization-enhanced Physics-Informed Neural Network with Domain Decomposition (IDPINN)cited by 9
- 2024Multifidelity Kolmogorov-Arnold Networkscited by 9
- 2021Active Learning with Multifidelity Modeling for Efficient Rare Event Simulationcited by 8
- 2023Feature-adjacent multi-fidelity physics-informed machine learning for partial differential equationscited by 8
- 2021Physics-integrated hybrid framework for model form error identification in nonlinear dynamical systemscited by 7
- 2022Leveraging Industry 4.0 -- Deep Learning, Surrogate Model and Transfer Learning with Uncertainty Quantification Incorporated into Digital Twin for Nuclear Systemcited by 7
- 2023Multi-fidelity surrogate modeling for temperature field prediction using deep convolution neural networkcited by 7
- 2021GrADE: A graph based data-driven solver for time-dependent nonlinear partial differential equationscited by 6
- 2021A deep learning based surrogate model for stochastic simulatorscited by 6
- 2022A PINN Approach to Symbolic Differential Operator Discovery with Sparse Datacited by 6
- 2024Spatio-spectral graph neural operator for solving computational mechanics problems on irregular domain and unstructured gridcited by 6
- 2023Training Deep Surrogate Models with Large Scale Online Learningcited by 5
- 2024Sparse discovery of differential equations based on multi-fidelity Gaussian processcited by 5
- 2024Multi-Fidelity Methods for Optimization: A Surveycited by 5
- 2025Data-Efficient Deep Operator Network for Unsteady Flow: A Multi-Fidelity Approach with Physics-Guided Subsamplingcited by 5
- 2025Adaptive Physics-informed Neural Networks: A Surveycited by 5
- 2021Machine learning based digital twin for stochastic nonlinear multi-degree of freedom dynamical systemcited by 4
- 2021Surrogate assisted active subspace and active subspace assisted surrogate -- A new paradigm for high dimensional structural reliability analysiscited by 4
- 2024Practical multi-fidelity machine learning: fusion of deterministic and Bayesian modelscited by 4
- 2022Real-time Health Monitoring of Heat Exchangers using Hypernetworks and PINNscited by 3
- 2023Discovering interpretable Lagrangian of dynamical systems from datacited by 3
- 2023iPINNs: Incremental learning for Physics-informed neural networkscited by 3
- 2024Introducing a microstructure-embedded autoencoder approach for reconstructing high-resolution solution field data from a reduced parametric spacecited by 3
- 2024Solving Differential Equations with Constrained Learningcited by 3
- 2025Enforcing hidden physics in physics-informed neural networkscited by 3
- 2022Deep Capsule Encoder-Decoder Network for Surrogate Modeling and Uncertainty Quantificationcited by 2
- 2023DPA-WNO: A gray box model for a class of stochastic mechanics problemcited by 2
- 2024Multi-Fidelity Bayesian Neural Network for Uncertainty Quantification in Transonic Aerodynamic Loadscited by 2
- 2025Convolutional-neural-operator-based transfer learning for solving PDEscited by 2
50 most cited of 68 All 68 (JSON)
- 2026Learning Physics from an Imperfect Ancestor21 Sep 2026
- 2026Compositional Meta-Learning for Mitigating Task Heterogeneity in Physics-Informed Neural Networks29 Apr 2026
- 2026Non-intrusive Learning of Physics-Informed Spatio-temporal Surrogate for Accelerating Design15 Apr 2026
- 2026Sparsely-Supervised Data Assimilation via Physics-Informed Schr"odinger Bridge20 Mar 2026
- 2026Estimating Dense-Packed Zone Height in Liquid-Liquid Separation: A Physics-Informed Neural Network Approach26 Jan 2026
- 2025Convolutional-neural-operator-based transfer learning for solving PDEs19 Dec 2025
- 2025Bridging quantum and classical computing for partial differential equations through multifidelity machine learning4 Dec 2025
- 2025Enforcing hidden physics in physics-informed neural networks18 Nov 2025
- 2025Multi-level datasets training method in Physics-Informed Neural Networks30 Apr 2025
- 2025Adaptive Physics-informed Neural Networks: A Survey23 Mar 2025
- 2025Data-Efficient Deep Operator Network for Unsteady Flow: A Multi-Fidelity Approach with Physics-Guided Subsampling23 Mar 2025
- 2025Accelerated Gradient-based Design Optimization Via Differentiable Physics-Informed Neural Operator: A Composites Autoclave Processing Case Study17 Feb 2025
38 more
- 2025Transfer Learning in Physics-Informed Neural Networks: Full Fine-Tuning, Lightweight Fine-Tuning, and Low-Rank Adaptation2 Feb 2025
- 2025Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunities11 Jan 2025
- 2024Solving Differential Equations with Constrained Learning30 Oct 2024
- 2024Multifidelity Kolmogorov-Arnold Networks18 Oct 2024
- 2024Graph Laplacian-based Bayesian Multi-fidelity Modeling12 Sep 2024
- 2024Spatio-spectral graph neural operator for solving computational mechanics problems on irregular domain and unstructured grid1 Sep 2024
- 2024Practical multi-fidelity machine learning: fusion of deterministic and Bayesian models21 Jul 2024
- 2024Multi-Fidelity Bayesian Neural Network for Uncertainty Quantification in Transonic Aerodynamic Loads8 Jul 2024
- 2024Initialization-enhanced Physics-Informed Neural Network with Domain Decomposition (IDPINN)5 Jun 2024
- 2024Introducing a microstructure-embedded autoencoder approach for reconstructing high-resolution solution field data from a reduced parametric space3 May 2024
- 2024PhyPlan: Generalizable and Rapid Physical Task Planning with Physics Informed Skill Networks for Robot Manipulators22 Apr 2024
- 2024Multi-Fidelity Methods for Optimization: A Survey15 Feb 2024
- 2024PirateNets: Physics-informed Deep Learning with Residual Adaptive Networks1 Feb 2024
- 2024Sparse discovery of differential equations based on multi-fidelity Gaussian process22 Jan 2024
- 2024PDE Generalization of In-Context Operator Networks: A Study on 1D Scalar Nonlinear Conservation Laws14 Jan 2024
- 2024Uncertainty-aware multi-fidelity surrogate modeling with noisy data12 Jan 2024
- 2024Physics-Informed Neural Networks for High-Frequency and Multi-Scale Problems using Transfer Learning5 Jan 2024
- 2023A foundational neural operator that continuously learns without forgetting29 Oct 2023
- 2023A Latent Variable Approach for Non-Hierarchical Multi-Fidelity Adaptive Sampling5 Oct 2023
- 2023DPA-WNO: A gray box model for a class of stochastic mechanics problem24 Sep 2023
- 2023An Expert's Guide to Training Physics-informed Neural Networks16 Aug 2023
- 2023Training Deep Surrogate Models with Large Scale Online Learning28 Jun 2023
- 2023Differentiable Multi-Fidelity Fusion: Efficient Learning of Physics Simulations with Neural Architecture Search and Transfer Learning12 Jun 2023
- 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behavior1 Jun 2023
- 2023In-Context Operator Learning with Data Prompts for Differential Equation Problems17 Apr 2023
- 2023iPINNs: Incremental learning for Physics-informed neural networks10 Apr 2023
- 2023A few-shot graph Laplacian-based approach for improving the accuracy of low-fidelity data29 Mar 2023
- 2023Accelerated wind farm yaw and layout optimisation with multi-fidelity deep transfer learning wake models28 Mar 2023
- 2023Feature-adjacent multi-fidelity physics-informed machine learning for partial differential equations21 Mar 2023
- 2023Physics informed WNO12 Feb 2023
- 2023Discovering interpretable Lagrangian of dynamical systems from data9 Feb 2023
- 2023TransNet: Transferable Neural Networks for Partial Differential Equations27 Jan 2023
- 2023Multi-fidelity surrogate modeling for temperature field prediction using deep convolution neural network17 Jan 2023
- 2022Real-time Health Monitoring of Heat Exchangers using Hypernetworks and PINNs20 Dec 2022
- 2022A PINN Approach to Symbolic Differential Operator Discovery with Sparse Data9 Dec 2022
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applications15 Nov 2022
- 2022Partial Differential Equations Meet Deep Neural Networks: A Survey27 Oct 2022
- 2022Leveraging Industry 4.0 -- Deep Learning, Surrogate Model and Transfer Learning with Uncertainty Quantification Incorporated into Digital Twin for Nuclear System30 Sep 2022
50 newest of 68 All 68 (JSON)
- 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 128
- 2023An Expert's Guide to Training Physics-informed Neural Networkscited by 119
- 2023In-Context Operator Learning with Data Prompts for Differential Equation Problemscited by 98
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2021Multi-Objective Loss Balancing for Physics-Informed Deep Learningcited by 86
- 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 77
- 2024PirateNets: Physics-informed Deep Learning with Residual Adaptive Networkscited by 70
- 2022Multifidelity Deep Operator Networks For Data-Driven and Physics-Informed Problemscited by 57
- 2021A novel meta-learning initialization method for physics-informed neural networkscited by 35
- 2024PDE Generalization of In-Context Operator Networks: A Study on 1D Scalar Nonlinear Conservation Lawscited by 30
- 2023Physics informed WNOcited by 26
- 2022Partial Differential Equations Meet Deep Neural Networks: A Surveycited by 25
12 most cited of 68 All 68 (JSON)
- 2026Learning Physics from an Imperfect Ancestor21 Sep 2026
- 2026Compositional Meta-Learning for Mitigating Task Heterogeneity in Physics-Informed Neural Networks29 Apr 2026
- 2026Non-intrusive Learning of Physics-Informed Spatio-temporal Surrogate for Accelerating Design15 Apr 2026
- 2026Sparsely-Supervised Data Assimilation via Physics-Informed Schr"odinger Bridge20 Mar 2026
- 2026Estimating Dense-Packed Zone Height in Liquid-Liquid Separation: A Physics-Informed Neural Network Approach26 Jan 2026
- 2025Convolutional-neural-operator-based transfer learning for solving PDEs19 Dec 2025
- 2025Bridging quantum and classical computing for partial differential equations through multifidelity machine learning4 Dec 2025
- 2025Enforcing hidden physics in physics-informed neural networks18 Nov 2025
- 2025Multi-level datasets training method in Physics-Informed Neural Networks30 Apr 2025
- 2025Adaptive Physics-informed Neural Networks: A Survey23 Mar 2025
- 2025Data-Efficient Deep Operator Network for Unsteady Flow: A Multi-Fidelity Approach with Physics-Guided Subsampling23 Mar 2025
- 2025Accelerated Gradient-based Design Optimization Via Differentiable Physics-Informed Neural Operator: A Composites Autoclave Processing Case Study17 Feb 2025
12 newest of 68 All 68 (JSON)