# Simplified Minimal Gated Unit Variations for Recurrent Neural Networks

arXiv: https://arxiv.org/abs/1701.03452 · HTML: https://mlsanity.com/paper/1701.03452/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 12 Jan 2017.

## Built on by (most cited first, 13 of 13)

- [Evolution Strategies at the Hyperscale](https://mlsanity.com/paper/2511.16652/) (2025)
- [Rapid training of quantum recurrent neural networks](https://mlsanity.com/paper/2207.00378/) (2022)
- [Recurrent Neural Networks and Long Short-Term Memory Networks: Tutorial and Survey](https://mlsanity.com/paper/2304.11461/) (2023)
- [Efficient Neural Networks for Tiny Machine Learning: A Comprehensive Review](https://mlsanity.com/paper/2311.11883/) (2023)
- [ViT-ReT: Vision and Recurrent Transformer Neural Networks for Human Activity Recognition in Videos](https://mlsanity.com/paper/2208.07929/) (2022)
- [Topos and Stacks of Deep Neural Networks](https://mlsanity.com/paper/2106.14587/) (2021)
- [What is the best RNN-cell structure to forecast each time series behavior?](https://mlsanity.com/paper/2203.07844/) (2022)
- [Fusing Structure from Motion and Simulation-Augmented Pose Regression from Optical Flow for Challenging Indoor Environments](https://mlsanity.com/paper/2304.07250/) (2023)
- [Gates Are Not What You Need in RNNs](https://mlsanity.com/paper/2108.00527/) (2021)
- [Minion Gated Recurrent Unit for Continual Learning](https://mlsanity.com/paper/2503.06175/) (2025)
- [Advances in Electron Microscopy with Deep Learning](https://mlsanity.com/paper/2101.01178/) (2021)
- [A More Efficient Chinese Named Entity Recognition base on BERT and Syntactic Analysis](https://mlsanity.com/paper/2101.11423/) (2021)
- [Low-Resource Neural Machine Translation Using Recurrent Neural Networks and Transfer Learning: A Case Study on English-to-Igbo](https://mlsanity.com/paper/2504.17252/) (2025)

## Abstract (arXiv)

Recurrent neural networks with various types of hidden units have been used to solve a diverse range of problems involving sequence data. Two of the most recent proposals, gated recurrent units (GRU) and minimal gated units (MGU), have shown comparable promising results on example public datasets. In this paper, we introduce three model variants of the minimal gated unit (MGU) which further simplify that design by reducing the number of parameters in the forget-gate dynamic equation. These three model variants, referred to simply as MGU1, MGU2, and MGU3, were tested on sequences generated from the MNIST dataset and from the Reuters Newswire Topics (RNT) dataset. The new models have shown similar accuracy to the MGU model while using fewer parameters and thus lowering training expense. One model variant, namely MGU2, performed better than MGU on the datasets considered, and thus may be used as an alternate to MGU or GRU in recurrent neural networks.