Path sampling of recurrent neural networks by incorporating known physics
Not on the map. Why?
Abstract (arXiv)
Recurrent neural networks have seen widespread use in modeling dynamical systems in varied domains such as weather prediction, text prediction and several others. Often one wishes to supplement the experimentally observed dynamics with prior knowledge or intuition about the system. While the recurrent nature of these networks allows them to model arbitrarily long memories in the time series used in training, it makes it harder to impose prior knowledge or intuition through generic constraints. In this work, we present a path sampling approach based on principle of Maximum Caliber that allows us to include generic thermodynamic or kinetic constraints into recurrent neural networks. We show the method here for a widely used type of recurrent neural network known as long short-term memory network in the context of supplementing time series collected from different application domains. These include classical Molecular Dynamics of a protein and Monte Carlo simulations of an open quantum system continuously losing photons to the environment and displaying Rabi oscillations. Our method can be easily generalized to other generative artificial intelligence models and to generic time series in different areas of physical and social sciences, where one wishes to supplement limited data with intuition or theory based corrections.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 10 of its 72 references that are in the map. First posted on arXiv 1 Mar 2022.
Builds on
10 of 72 references.
References · 10
- 2017Attention Is All You Needcited by 60,361
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2013Speech Recognition with Deep Recurrent Neural Networkscited by 669
- 2018Can recurrent neural networks warp time?cited by 55
- 2014Addressing the Rare Word Problem in Neural Machine Translationcited by 50
- 2020Theory of gating in recurrent neural networkscited by 19
- 2020Molecular Latent Space Simulatorscited by 14
- 2021A Note on Learning Rare Events in Molecular Dynamics using LSTM and Transformercited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 3.
4 papers.
- 2025Quantum Adaptive Self-Attention for Quantum Transformer Modelscited by 14
- 2023Density Matrix Emulation of Quantum Recurrent Neural Networks for Multivariate Time Series Predictioncited by 4
- 2025Unraveling Quantum Environments: Transformer-Assisted Learning in Lindblad Dynamicscited by 4
- 2025Beyond Ensembles: Simulating All-Atom Protein Dynamics in a Learned Latent Spacecited by 3
- 2025Beyond Ensembles: Simulating All-Atom Protein Dynamics in a Learned Latent Space2 Sep 2025
- 2025Unraveling Quantum Environments: Transformer-Assisted Learning in Lindblad Dynamics11 May 2025
- 2025Quantum Adaptive Self-Attention for Quantum Transformer Models5 Apr 2025
- 2023Density Matrix Emulation of Quantum Recurrent Neural Networks for Multivariate Time Series Prediction31 Oct 2023