# A Gentle Tutorial of Recurrent Neural Network with Error Backpropagation

arXiv: https://arxiv.org/abs/1610.02583 · HTML: https://mlsanity.com/paper/1610.02583/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 8 Oct 2016.

## Built on by (most cited first, 12 of 12)

- [Transformers in Time-series Analysis: A Tutorial](https://mlsanity.com/paper/2205.01138/) (2022)
- [A Systematic Review for Transformer-based Long-term Series Forecasting](https://mlsanity.com/paper/2310.20218/) (2023)
- [Deep Learning-Based Robust Multi-Object Tracking via Fusion of mmWave Radar and Camera Sensors](https://mlsanity.com/paper/2407.08049/) (2024)
- [Classification and Feature Transformation with Fuzzy Cognitive Maps](https://mlsanity.com/paper/2103.05124/) (2021)
- [Efficient Non-Compression Auto-Encoder for Driving Noise-based Road Surface Anomaly Detection](https://mlsanity.com/paper/2111.10985/) (2021)
- [Multi-Objective Evolutionary Neural Architecture Search for Recurrent Neural Networks](https://mlsanity.com/paper/2403.11173/) (2024)
- [DeepBayes -- an estimator for parameter estimation in stochastic nonlinear dynamical models](https://mlsanity.com/paper/2205.02264/) (2022)
- [AMDNet23: A combined deep Contour-based Convolutional Neural Network and Long Short Term Memory system to diagnose Age-related Macular Degeneration](https://mlsanity.com/paper/2308.15822/) (2023)
- [How Facial Features Convey Attention in Stationary Environments](https://mlsanity.com/paper/2111.14931/) (2021)
- [Sequence-to-Sequence Forecasting-aided State Estimation for Power Systems](https://mlsanity.com/paper/2305.13215/) (2023)
- [Enhancing Binary Code Comment Quality Classification: Integrating Generative AI for Improved Accuracy](https://mlsanity.com/paper/2310.11467/) (2023)
- [An AI-Based Supervisory Measurement Integrity Validation Layer for Cyber-Resilient AC/DC Protection in Inverter-Based Microgrids](https://mlsanity.com/paper/2604.23666/) (2026)

## Abstract (arXiv)

We describe recurrent neural networks (RNNs), which have attracted great attention on sequential tasks, such as handwriting recognition, speech recognition and image to text. However, compared to general feedforward neural networks, RNNs have feedback loops, which makes it a little hard to understand the backpropagation step. Thus, we focus on basics, especially the error backpropagation to compute gradients with respect to model parameters. Further, we go into detail on how error backpropagation algorithm is applied on long short-term memory (LSTM) by unfolding the memory unit.