# DeepGRU: Deep Gesture Recognition Utility

arXiv: https://arxiv.org/abs/1810.12514 · HTML: https://mlsanity.com/paper/1810.12514/

## Key facts

- Cited by 14 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 30 Oct 2018.

## Built on by (most cited first, 14 of 14)

- [Interaction Transformer for Human Reaction Generation](https://mlsanity.com/paper/2207.01685/) (2022)
- [Learning Connectivity with Graph Convolutional Networks for Skeleton-based Action Recognition](https://mlsanity.com/paper/2112.03328/) (2021)
- [TrouSPI-Net: Spatio-temporal attention on parallel atrous convolutions and U-GRUs for skeletal pedestrian crossing prediction](https://mlsanity.com/paper/2109.00953/) (2021)
- [OO-dMVMT: A Deep Multi-view Multi-task Classification Framework for Real-time 3D Hand Gesture Classification and Segmentation](https://mlsanity.com/paper/2304.05956/) (2023)
- [Real-Time Hand Gesture Recognition: Integrating Skeleton-Based Data Fusion and Multi-Stream CNN](https://mlsanity.com/paper/2406.15003/) (2024)
- [Adversarial Interaction Attack: Fooling AI to Misinterpret Human Intentions](https://mlsanity.com/paper/2101.06704/) (2021)
- [Learning Chebyshev Basis in Graph Convolutional Networks for Skeleton-based Action Recognition](https://mlsanity.com/paper/2104.05482/) (2021)
- [Neural Network Based Lidar Gesture Recognition for Realtime Robot Teleoperation](https://mlsanity.com/paper/2109.08263/) (2021)
- [Budget-Aware Graph Convolutional Network Design using Probabilistic Magnitude Pruning](https://mlsanity.com/paper/2305.19343/) (2023)
- [Miniaturized Graph Convolutional Networks with Topologically Consistent Pruning](https://mlsanity.com/paper/2306.17590/) (2023)
- [One-Shot Multi-Rate Pruning of Graph Convolutional Networks](https://mlsanity.com/paper/2312.17615/) (2023)
- [Designing Semi-Structured Pruning of Graph Convolutional Networks for Skeleton-based Recognition](https://mlsanity.com/paper/2412.11813/) (2024)
- [Label-Efficient Skeleton-based Recognition with Stable-Invertible Graph Convolutional Networks](https://mlsanity.com/paper/2511.17345/) (2025)
- [Active Learning for GCN-based Action Recognition](https://mlsanity.com/paper/2511.21625/) (2025)

## Abstract (arXiv)

We propose DeepGRU, a novel end-to-end deep network model informed by recent developments in deep learning for gesture and action recognition, that is streamlined and device-agnostic. DeepGRU, which uses only raw skeleton, pose or vector data is quickly understood, implemented, and trained, and yet achieves state-of-the-art results on challenging datasets. At the heart of our method lies a set of stacked gated recurrent units (GRU), two fully-connected layers and a novel global attention model. We evaluate our method on seven publicly available datasets, containing various number of samples and spanning over a broad range of interactions (full-body, multi-actor, hand gestures, etc.). In all but one case we outperform the state-of-the-art pose-based methods. For instance, we achieve a recognition accuracy of 84.9% and 92.3% on cross-subject and cross-view tests of the NTU RGB+D dataset respectively, and also 100% recognition accuracy on the UT-Kinect dataset. While DeepGRU works well on large datasets with many training samples, we show that even in the absence of a large number of training data, and with as little as four samples per class, DeepGRU can beat traditional methods specifically designed for small training sets. Lastly, we demonstrate that even without powerful hardware, and using only the CPU, our method can still be trained in under 10 minutes on small-scale datasets, making it an enticing choice for rapid application prototyping and development.