Residual-based physics-informed transfer learning: A hybrid method for accelerating long-term CFD simulations via deep learning
Not on the map. Why?
Abstract (arXiv)
While a big wave of artificial intelligence (AI) has propagated to the field of computational fluid dynamics (CFD) acceleration studies, recent research has highlighted that the development of AI techniques that reconciles the following goals remains our primary task: (1) accurate prediction of unseen (future) time series in long-term CFD simulations (2) acceleration of simulations (3) an acceptable amount of training data and time (4) within a multiple PDEs condition. In this study, we propose a residual-based physics-informed transfer learning (RePIT) strategy to achieve these four objectives using ML-CFD hybrid computation. Our hypothesis is that long-term CFD simulation is feasible with the hybrid method where CFD and AI alternately calculate time series while monitoring the first principle's residuals. The feasibility of RePIT strategy was verified through a CFD case study on natural convection. In a single training approach, a residual scale change occurred around 100th timestep, resulting in predicted time series exhibiting non-physical patterns as well as a significant deviations from the ground truth. Conversely, RePIT strategy maintained the residuals within the defined range and demonstrated good accuracy throughout the entire simulation period. The maximum error from the ground truth was below 0.4 K for temperature and 0.024 m/s for x-axis velocity. Furthermore, the average time for 1 timestep by the ML-GPU and CFD-CPU calculations was 0.171 s and 0.015 s, respectively. Including the parameter-updating time, the simulation was accelerated by a factor of 1.9. In conclusion, our RePIT strategy is a promising technique to reduce the cost of CFD simulations in industry. However, more vigorous optimization and improvement studies are still necessary.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 10 of its 41 references that are in the map. First posted on arXiv 14 Jun 2022.
Builds on
10 of 41 references.
References · 10
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2019DeepXDE: A deep learning library for solving differential equationscited by 619
- 2021Enhancing Computational Fluid Dynamics with Machine Learningcited by 138
- 2019The role of artificial intelligence in achieving the Sustainable Development Goalscited by 100
- 2021Stiff Neural Ordinary Differential Equationscited by 78
- 2020Convolutional-network models to predict wall-bounded turbulence from wall quantitiescited by 47
- 2021Towards extraction of orthogonal and parsimonious non-linear modes from turbulent flowscited by 45
- 2020FiniteNet: A Fully Convolutional LSTM Network Architecture for Time-Dependent Partial Differential Equationscited by 15
- 2021Finite volume method network for acceleration of unsteady computational fluid dynamics: non-reacting and reacting flowscited by 12
Built on by
Citing papers per year: 2024: 10; 2025: 3; 2026: 1.
14 papers.
Sort:
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 91
- 2024Data-Driven Physics-Informed Neural Networks: A Digital Twin Perspectivecited by 12
- 2024Advanced deep-reinforcement-learning methods for flow control: group-invariant and positional-encoding networks improve learning speed and qualitycited by 5
- 2024Reduced-order modeling of unsteady fluid flow using neural network ensemblescited by 4
- 2024Enhancing Graph U-Nets for Mesh-Agnostic Spatio-Temporal Flow Predictioncited by 4
- 2024Model-Agnostic AI Framework with Explicit Time Integration for Long-Term Fluid Dynamics Predictioncited by 3
- 2025Comparison of CNN-based deep learning architectures for unsteady CFD acceleration on small datasetscited by 3
- 2024Learning Lagrangian Interaction Dynamics with Sampling-Based Model Order Reductioncited by 2
- 2025Node Assigned physics-informed neural networks for thermal-hydraulic system simulation: CVH/FL modulecited by 2
- 2024Reducing Spatial Discretization Error on Coarse CFD Simulations Using an OpenFOAM-Embedded Deep Learning Frameworkcited by 0
- 2024Coupling Machine Learning Local Predictions with a Computational Fluid Dynamics Solver to Accelerate Transient Buoyant Plume Simulationscited by 0
- 2024SEA: State-Exchange Attention for High-Fidelity Physics Based Transformerscited by 0
2 more
- 2025Physics-Informed Machine Learning Regulated by Finite Element Analysis for Simulation Acceleration of Melt Pool Dynamics in Laser Powder Bed Fusioncited by 0
- 2026A Numerical Method for Coupling Parameterized Physics-Informed Neural Networks and FDM for Advanced Thermal-Hydraulic System Simulationcited by 0
- 2026A Numerical Method for Coupling Parameterized Physics-Informed Neural Networks and FDM for Advanced Thermal-Hydraulic System Simulation3 Apr 2026
- 2025Physics-Informed Machine Learning Regulated by Finite Element Analysis for Simulation Acceleration of Melt Pool Dynamics in Laser Powder Bed Fusion25 Jun 2025
- 2025Node Assigned physics-informed neural networks for thermal-hydraulic system simulation: CVH/FL module23 Apr 2025
- 2025Comparison of CNN-based deep learning architectures for unsteady CFD acceleration on small datasets6 Feb 2025
- 2024Model-Agnostic AI Framework with Explicit Time Integration for Long-Term Fluid Dynamics Prediction7 Dec 2024
- 2024SEA: State-Exchange Attention for High-Fidelity Physics Based Transformers20 Oct 2024
- 2024Coupling Machine Learning Local Predictions with a Computational Fluid Dynamics Solver to Accelerate Transient Buoyant Plume Simulations11 Sep 2024
- 2024Advanced deep-reinforcement-learning methods for flow control: group-invariant and positional-encoding networks improve learning speed and quality25 Jul 2024
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations9 Jul 2024
- 2024Learning Lagrangian Interaction Dynamics with Sampling-Based Model Order Reduction4 Jul 2024
- 2024Enhancing Graph U-Nets for Mesh-Agnostic Spatio-Temporal Flow Prediction6 Jun 2024
- 2024Reducing Spatial Discretization Error on Coarse CFD Simulations Using an OpenFOAM-Embedded Deep Learning Framework13 May 2024
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 91
- 2024Data-Driven Physics-Informed Neural Networks: A Digital Twin Perspectivecited by 12
- 2024Advanced deep-reinforcement-learning methods for flow control: group-invariant and positional-encoding networks improve learning speed and qualitycited by 5
- 2024Reduced-order modeling of unsteady fluid flow using neural network ensemblescited by 4
- 2024Enhancing Graph U-Nets for Mesh-Agnostic Spatio-Temporal Flow Predictioncited by 4
- 2024Model-Agnostic AI Framework with Explicit Time Integration for Long-Term Fluid Dynamics Predictioncited by 3
- 2025Comparison of CNN-based deep learning architectures for unsteady CFD acceleration on small datasetscited by 3
- 2024Learning Lagrangian Interaction Dynamics with Sampling-Based Model Order Reductioncited by 2
- 2025Node Assigned physics-informed neural networks for thermal-hydraulic system simulation: CVH/FL modulecited by 2
- 2024Reducing Spatial Discretization Error on Coarse CFD Simulations Using an OpenFOAM-Embedded Deep Learning Frameworkcited by 0
- 2024Coupling Machine Learning Local Predictions with a Computational Fluid Dynamics Solver to Accelerate Transient Buoyant Plume Simulationscited by 0
- 2024SEA: State-Exchange Attention for High-Fidelity Physics Based Transformerscited by 0
12 most cited of 14 All 14 (JSON)
- 2026A Numerical Method for Coupling Parameterized Physics-Informed Neural Networks and FDM for Advanced Thermal-Hydraulic System Simulation3 Apr 2026
- 2025Physics-Informed Machine Learning Regulated by Finite Element Analysis for Simulation Acceleration of Melt Pool Dynamics in Laser Powder Bed Fusion25 Jun 2025
- 2025Node Assigned physics-informed neural networks for thermal-hydraulic system simulation: CVH/FL module23 Apr 2025
- 2025Comparison of CNN-based deep learning architectures for unsteady CFD acceleration on small datasets6 Feb 2025
- 2024Model-Agnostic AI Framework with Explicit Time Integration for Long-Term Fluid Dynamics Prediction7 Dec 2024
- 2024SEA: State-Exchange Attention for High-Fidelity Physics Based Transformers20 Oct 2024
- 2024Coupling Machine Learning Local Predictions with a Computational Fluid Dynamics Solver to Accelerate Transient Buoyant Plume Simulations11 Sep 2024
- 2024Advanced deep-reinforcement-learning methods for flow control: group-invariant and positional-encoding networks improve learning speed and quality25 Jul 2024
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations9 Jul 2024
- 2024Learning Lagrangian Interaction Dynamics with Sampling-Based Model Order Reduction4 Jul 2024
- 2024Enhancing Graph U-Nets for Mesh-Agnostic Spatio-Temporal Flow Prediction6 Jun 2024
- 2024Reducing Spatial Discretization Error on Coarse CFD Simulations Using an OpenFOAM-Embedded Deep Learning Framework13 May 2024
12 newest of 14 All 14 (JSON)