Kinematically consistent recurrent neural networks for learning inverse problems in wave propagation
Not on the map. Why?
Abstract (arXiv)
Although machine learning (ML) is increasingly employed recently for mechanistic problems, the black-box nature of conventional ML architectures lacks the physical knowledge to infer unforeseen input conditions. This implies both severe overfitting during a dearth of training data and inadequate physical interpretability, which motivates us to propose a new kinematically consistent, physics-based ML model. In particular, we attempt to perform physically interpretable learning of inverse problems in wave propagation without suffering overfitting restrictions. Towards this goal, we employ long short-term memory (LSTM) networks endowed with a physical, hyperparameter-driven regularizer, performing penalty-based enforcement of the characteristic geometries. Since these characteristics are the kinematical invariances of wave propagation phenomena, maintaining their structure provides kinematical consistency to the network. Even with modest training data, the kinematically consistent network can reduce the L1 and L_∞ error norms of the plain LSTM predictions by about 45% and 55%, respectively. It can also increase the horizon of the plain LSTM's forecasting by almost two times. To achieve this, an optimal range of the physical hyperparameter, analogous to an artificial bulk modulus, has been established through numerical experiments. The efficacy of the proposed method in alleviating overfitting, and the physical interpretability of the learning mechanism, are also discussed. Such an application of kinematically consistent LSTM networks for wave propagation learning is presented here for the first time.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 37 references that are in the map. First posted on arXiv 8 Oct 2021.
Builds on
17 of 37 references.
References · 17
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
- 2019Hamiltonian Neural Networkscited by 712
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 548
- 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 204
- 2018Deep Neural Networks Motivated by Partial Differential Equationscited by 187
- 2017Linearly-Recurrent Autoencoder Networks for Learning Dynamicscited by 145
- 2019Hamiltonian Generative Networkscited by 137
- 2018Physics-Informed Generative Adversarial Networks for Stochastic Differential Equationscited by 135
- 2020Incorporating Symmetry into Deep Dynamics Models for Improved Generalizationcited by 126
- 2019AntisymmetricRNN: A Dynamical System View on Recurrent Neural Networkscited by 112
- 2017Time-lagged autoencoders: Deep learning of slow collective variables for molecular kineticscited by 65
- 2018Physics Guided RNNs for Modeling Dynamical Systems: A Case Study in Simulating Lake Temperature Profilescited by 55
5 more
- 2018Deep convolutional recurrent autoencoders for learning low-dimensional feature dynamics of fluid systemscited by 54
- 2019Physics-Guided Architecture (PGA) of Neural Networks for Quantifying Uncertainty in Lake Temperature Modelingcited by 26
- 2020Assessment of unsteady flow predictions using hybrid deep learning based reduced order modelscited by 20
- 2019Blending Diverse Physical Priors with Neural Networkscited by 11
- 2020Physics-aware registration based auto-encoder for convection dominated PDEscited by 4
Built on by
Not cited yet.