Transfer learning for improved generalizability in causal physics-informed neural networks for beam simulations
Not on the map. Why?
Abstract (arXiv)
This paper introduces a novel methodology for simulating the dynamics of beams on elastic foundations. Specifically, Euler-Bernoulli and Timoshenko beam models on the Winkler foundation are simulated using a transfer learning approach within a causality-respecting physics-informed neural network (PINN) framework. Conventional PINNs encounter challenges in handling large space-time domains, even for problems with closed-form analytical solutions. A causality-respecting PINN loss function is employed to overcome this limitation, effectively capturing the underlying physics. However, it is observed that the causality-respecting PINN lacks generalizability. We propose using solutions to similar problems instead of training from scratch by employing transfer learning while adhering to causality to accelerate convergence and ensure accurate results across diverse scenarios. Numerical experiments on the Euler-Bernoulli beam highlight the efficacy of the proposed approach for various initial conditions, including those with noise in the initial data. Furthermore, the potential of the proposed method is demonstrated for the Timoshenko beam in an extended spatial and temporal domain. Several comparisons suggest that the proposed method accurately captures the inherent dynamics, outperforming the state-of-the-art physics-informed methods under standard L2-norm metric and accelerating convergence.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 23 of its 75 references that are in the map. First posted on arXiv 1 Nov 2023.
Builds on
23 of 75 references.
References · 23
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 643
- 2020Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanismcited by 233
- 2021Gradient-enhanced physics-informed neural networks for forward and inverse PDE problemscited by 222
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 216
- 2016Theory-guided Data Science: A New Paradigm for Scientific Discovery from Datacited by 171
- 2022Respecting causality is all you need for training physics-informed neural networkscited by 156
- 2017Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modelingcited by 131
- 2019Transfer learning enhanced physics informed neural network for phase-field modeling of fracturecited by 116
- 2021Parallel Physics-Informed Neural Networks via Domain Decompositioncited by 112
- 2020A Physics-Informed Machine Learning Approach for Solving Heat Transfer Equation in Advanced Manufacturing and Engineering Applicationscited by 53
- 2023A unified scalable framework for causal sweeping strategies for Physics-Informed Neural Networks (PINNs) and their temporal decompositionscited by 48
11 more
- 2022Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarioscited by 46
- 2020DPM: A Novel Training Method for Physics-Informed Neural Networks in Extrapolationcited by 45
- 2023An operator preconditioning perspective on training in physics-informed machine learningcited by 27
- 2023Physics-informed neural networks for solving forward and inverse problems in complex beam systemscited by 24
- 2022Constitutive model characterization and discovery using physics-informed deep learningcited by 17
- 2023Neural oscillators for generalization of physics-informed machine learningcited by 9
- 2022Temperature Field Inversion of Heat-Source Systems via Physics-Informed Neural Networkscited by 8
- 2022Physics Informed Neural Network for Dynamic Stress Predictioncited by 6
- 2023Physics-informed machine learning for moving load problemscited by 4
- 2022Neural Network Complexity of Chaos and Turbulencecited by 3
- 2023iPINNs: Incremental learning for Physics-informed neural networkscited by 3
Built on by
Citing papers per year: 2024: 2; 2025: 4; 2026: 2.
8 papers.
- 2024Residual-based Attention Physics-informed Neural Networks for Spatio-Temporal Ageing Assessment of Transformers Operated in Renewable Power Plantscited by 11
- 2024Magnetic Hysteresis Modeling with Neural Operatorscited by 3
- 2025Domain decomposition architectures and Gauss-Newton training for physics-informed neural networkscited by 1
- 2025A-PINN: Auxiliary Physics-informed Neural Networks for Structural Vibration Analysis in Continuous Euler-Bernoulli Beamcited by 1
- 2026Physics-Informed Functional Link Constrained Framework with Domain Mapping for Solving Bending Analysis of an Exponentially Loaded Perforated Beamcited by 1
- 2025Improving physics-informed neural network extrapolation via transfer learning and adaptive activation functionscited by 0
- 2025Breaking the Precision Ceiling in Physics-Informed Neural Networks: A Hybrid Fourier-Neural Architecture for Ultra-High Accuracycited by 0
- 2026SpectONet: A Physics-Guided Spectral Deep Operator Network for Euler-Bernoulli Beam Dynamicscited by 0
- 2026SpectONet: A Physics-Guided Spectral Deep Operator Network for Euler-Bernoulli Beam Dynamics28 Jul 2026
- 2026Physics-Informed Functional Link Constrained Framework with Domain Mapping for Solving Bending Analysis of an Exponentially Loaded Perforated Beam8 Apr 2026
- 2025A-PINN: Auxiliary Physics-informed Neural Networks for Structural Vibration Analysis in Continuous Euler-Bernoulli Beam30 Dec 2025
- 2025Domain decomposition architectures and Gauss-Newton training for physics-informed neural networks30 Oct 2025
- 2025Breaking the Precision Ceiling in Physics-Informed Neural Networks: A Hybrid Fourier-Neural Architecture for Ultra-High Accuracy28 Jul 2025
- 2025Improving physics-informed neural network extrapolation via transfer learning and adaptive activation functions16 Jul 2025
- 2024Magnetic Hysteresis Modeling with Neural Operators3 Jul 2024
- 2024Residual-based Attention Physics-informed Neural Networks for Spatio-Temporal Ageing Assessment of Transformers Operated in Renewable Power Plants10 May 2024