# Parameter Estimation with Dense and Convolutional Neural Networks Applied to the FitzHugh-Nagumo ODE

arXiv: https://arxiv.org/abs/2012.06691 · HTML: https://mlsanity.com/paper/2012.06691/

## Key facts

- Cited by 19 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 12 Dec 2020.

## Built on by (most cited first, 19 of 19)

- [Neural Methods for Amortized Inference](https://mlsanity.com/paper/2404.12484/) (2024)
- [Likelihood-Free Parameter Estimation with Neural Bayes Estimators](https://mlsanity.com/paper/2208.12942/) (2022)
- [Neural Networks for Parameter Estimation in Intractable Models](https://mlsanity.com/paper/2107.14346/) (2021)
- [Statistical Deep Learning for Spatial and Spatio-Temporal Data](https://mlsanity.com/paper/2206.02218/) (2022)
- [When are dynamical systems learned from time series data statistically accurate?](https://mlsanity.com/paper/2411.06311/) (2024)
- [Neural Bayes Estimators for Irregular Spatial Data using Graph Neural Networks](https://mlsanity.com/paper/2310.02600/) (2023)
- [Learning to Estimate Without Bias](https://mlsanity.com/paper/2110.12403/) (2021)
- [PINNverse: Accurate parameter estimation in differential equations from noisy data with constrained physics-informed neural networks](https://mlsanity.com/paper/2504.05248/) (2025)
- [A Likelihood-Free Approach to Goal-Oriented Bayesian Optimal Experimental Design](https://mlsanity.com/paper/2408.09582/) (2024)
- [NOBLE -- Neural Operator with Biologically-informed Latent Embeddings to Capture Experimental Variability in Biological Neuron Models](https://mlsanity.com/paper/2506.04536/) (2025)
- [Theoretical guarantees for neural estimators in parametric statistics](https://mlsanity.com/paper/2506.18508/) (2025)
- [Interpretable neural network system identification method for two families of second-order systems based on characteristic curves](https://mlsanity.com/paper/2509.10632/) (2025)
- [Statistical treatment of convolutional neural network super-resolution of inland surface wind for subgrid-scale variability quantification](https://mlsanity.com/paper/2211.16708/) (2022)
- [Dimension-reduced Reconstruction Map Learning for Parameter Estimation in Likelihood-Free Inference Problems](https://mlsanity.com/paper/2407.13971/) (2024)
- [SWAT Watershed Model Calibration using Deep Learning](https://mlsanity.com/paper/2110.03097/) (2021)
- [Latent Variable Sequence Identification for Cognitive Models with Neural Network Estimators](https://mlsanity.com/paper/2406.14742/) (2024)
- [Estimating unknown parameters in differential equations with a reinforcement learning based PSO method](https://mlsanity.com/paper/2411.08651/) (2024)
- [Fast Likelihood-Free Parameter Estimation for L'evy Processes](https://mlsanity.com/paper/2505.01639/) (2025)
- [Machine learning approach to single-shot multiparameter estimation for the non-linear Schr"odinger equation](https://mlsanity.com/paper/2509.18479/) (2025)

## Abstract (arXiv)

Machine learning algorithms have been successfully used to approximate nonlinear maps under weak assumptions on the structure and properties of the maps. We present deep neural networks using dense and convolutional layers to solve an inverse problem, where we seek to estimate parameters of a FitzHugh-Nagumo model, which consists of a nonlinear system of ordinary differential equations (ODEs). We employ the neural networks to approximate reconstruction maps for model parameter estimation from observational data, where the data comes from the solution of the ODE and takes the form of a time series representing dynamically spiking membrane potential of a biological neuron. We target this dynamical model because of the computational challenges it poses in an inference setting, namely, having a highly nonlinear and nonconvex data misfit term and permitting only weakly informative priors on parameters. These challenges cause traditional optimization to fail and alternative algorithms to exhibit large computational costs. We quantify the prediction errors of model parameters obtained from the neural networks and investigate the effects of network architectures with and without the presence of noise in observational data. We generalize our framework for neural network-based reconstruction maps to simultaneously estimate ODE parameters and parameters of autocorrelated observational noise. Our results demonstrate that deep neural networks have the potential to estimate parameters in dynamical models and stochastic processes, and they are capable of predicting parameters accurately for the FitzHugh-Nagumo model.