Development and Validation of a Physics-Guided Machine Learning Extrapolation Framework Using a Classical Transient Diffusion Benchmark
Not on the map. Why?
Abstract (arXiv)
Machine learning models used in engineering are typically trained within limited operating ranges, yet reliable predictions are often required beyond these domains. Consequently, the primary challenge is extrapolation rather than interpolation. Rigorous validation is hindered by the scarcity of data outside the training range. To address this limitation, a novel extrapolation framework is integrated with established machine learning architectures to enable accurate and physically consistent predictions beyond the training domain. The framework is established by systematically evaluating two physics-guided architectures: a Bidirectional Long Short-Term Memory (BiLSTM) network and a Physics-Informed Neural Network (PINN). A classical one-dimensional transient diffusion problem is adopted as a benchmark because its exact analytical solution provides unlimited, reliable data across the spatio-temporal domain, enabling rigorous quantitative validation. The problem is particularly challenging because the solution evolves from an initial singularity through a strongly nonlinear transient regime before approaching a steady-state linear profile. When training data are confined to an intermediate portion of this evolution, backward extrapolation toward the singularity becomes especially demanding. To improve reliability, physics-guided coordinate transformations, boundary-aware learning strategies, and stability-enhancing temporal marching are incorporated. Extrapolation is evaluated using a train-predict-validate-extend strategy, in which validated predictions are recursively added to the training set to progressively extend the prediction horizon. The results demonstrate accurate and physically consistent predictions beyond the training domain, highlighting the framework's potential for engineering applications where data availability is limited.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 35 references that are in the map. First posted on arXiv 9 Sep 2026.
Builds on
12 of 35 references.
References · 12
- 2013Speech Recognition with Deep Recurrent Neural Networkscited by 669
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 643
- 2020How Neural Networks Extrapolate: From Feedforward to Graph Neural Networkscited by 222
- 2020Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systemscited by 164
- 2020Solving Allen-Cahn and Cahn-Hilliard Equations using the Adaptive Physics Informed Neural Networkscited by 123
- 2022Learning two-phase microstructure evolution using neural operators and autoencoder architecturescited by 72
- 2020A Probabilistic Graphical Model Foundation for Enabling Predictive Digital Twins at Scalecited by 58
- 2020A Physics-Informed Machine Learning Approach for Solving Heat Transfer Equation in Advanced Manufacturing and Engineering Applicationscited by 53
- 2020Physics-Informed Multi-LSTM Networks for Metamodeling of Nonlinear Structurescited by 52
- 2020DPM: A Novel Training Method for Physics-Informed Neural Networks in Extrapolationcited by 45
- 2023Deep encoder-decoder hierarchical convolutional neural networks for conjugate heat transfer surrogate modelingcited by 2
- 2022Deep Convolutional Architectures for Extrapolative Forecast in Time-dependent Flow Problemscited by 1
Built on by
Not cited yet.