# HGR-Net: A Fusion Network for Hand Gesture Segmentation and Recognition

arXiv: https://arxiv.org/abs/1806.05653 · HTML: https://mlsanity.com/paper/1806.05653/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Jun 2018.

## Built on by (most cited first, 4 of 4)

- [A Comprehensive Review of Sign Language Recognition: Different Types, Modalities, and Datasets](https://mlsanity.com/paper/2204.03328/) (2022)
- [Parallel Multi-Scale Networks with Deep Supervision for Hand Keypoint Detection](https://mlsanity.com/paper/2112.10275/) (2021)
- [One for All: An End-to-End Compact Solution for Hand Gesture Recognition](https://mlsanity.com/paper/2105.07143/) (2021)
- [Hand Gesture Recognition with Two Stage Approach Using Transfer Learning and Deep Ensemble Learning](https://mlsanity.com/paper/2309.11610/) (2023)

## Abstract (arXiv)

We propose a two-stage convolutional neural network (CNN) architecture for robust recognition of hand gestures, called HGR-Net, where the first stage performs accurate semantic segmentation to determine hand regions, and the second stage identifies the gesture. The segmentation stage architecture is based on the combination of fully convolutional residual network and atrous spatial pyramid pooling. Although the segmentation sub-network is trained without depth information, it is particularly robust against challenges such as illumination variations and complex backgrounds. The recognition stage deploys a two-stream CNN, which fuses the information from the red-green-blue and segmented images by combining their deep representations in a fully connected layer before classification. Extensive experiments on public datasets show that our architecture achieves almost as good as state-of-the-art performance in segmentation and recognition of static hand gestures, at a fraction of training time, run time, and model size. Our method can operate at an average of 23 ms per frame.