# Solving differential equations with unknown constitutive relations as recurrent neural networks

arXiv: https://arxiv.org/abs/1710.02242 · HTML: https://mlsanity.com/paper/1710.02242/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 6 Oct 2017.

## Built on by (most cited first, 6 of 6)

- [Data-driven approaches for predicting spread of infectious diseases through DINNs: Disease Informed Neural Networks](https://mlsanity.com/paper/2110.05445/) (2021)
- [DEQGAN: Learning the Loss Function for PINNs with Generative Adversarial Networks](https://mlsanity.com/paper/2209.07081/) (2022)
- [Error-Aware B-PINNs: Improving Uncertainty Quantification in Bayesian Physics-Informed Neural Networks](https://mlsanity.com/paper/2212.06965/) (2022)
- [Some of the variables, some of the parameters, some of the times, with some physics known: Identification with partial information](https://mlsanity.com/paper/2304.14214/) (2023)
- [Uncertainty Quantification in Neural Differential Equations](https://mlsanity.com/paper/2111.04207/) (2021)
- [Accelerating Fractional PINNs using Operational Matrices of Derivative](https://mlsanity.com/paper/2401.14081/) (2024)

## Abstract (arXiv)

We solve a system of ordinary differential equations with an unknown functional form of a sink (reaction rate) term. We assume that the measurements (time series) of state variables are partially available, and we use recurrent neural network to "learn" the reaction rate from this data. This is achieved by including a discretized ordinary differential equations as part of a recurrent neural network training problem. We extend TensorFlow's recurrent neural network architecture to create a simple but scalable and effective solver for the unknown functions, and apply it to a fedbatch bioreactor simulation problem. Use of techniques from recent deep learning literature enables training of functions with behavior manifesting over thousands of time steps. Our networks are structurally similar to recurrent neural networks, but differences in design and function require modifications to the conventional wisdom about training such networks.