Fine-grained Hand Gesture Recognition in Multi-viewpoint Hand Hygiene
Not on the map. Why?
Abstract (arXiv)
This paper contributes a new high-quality dataset for hand gesture recognition in hand hygiene systems, named "MFH". Generally, current datasets are not focused on: (i) fine-grained actions; and (ii) data mismatch between different viewpoints, which are available under realistic settings. To address the aforementioned issues, the MFH dataset is proposed to contain a total of 731147 samples obtained by different camera views in 6 non-overlapping locations. Additionally, each sample belongs to one of seven steps introduced by the World Health Organization (WHO). As a minor contribution, inspired by advances in fine-grained image recognition and distribution adaptation, this paper recommends using the self-supervised learning method to handle these preceding problems. The extensive experiments on the benchmarking MFH dataset show that the introduced method yields competitive performance in both the Accuracy and the Macro F1-score. The code and the MFH dataset are available at https://github.com/willogy-team/hand-gesture-recognition-smc2021.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 30 of its 46 references that are in the map. First posted on arXiv 7 Sep 2021.
Builds on
30 of 46 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,380
- 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 808
- 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 734
- 2019S4L: Self-Supervised Semi-Supervised Learningcited by 335
- 2019Revisiting Self-Supervised Visual Representation Learningcited by 251
- 2020Self-supervised Co-training for Video Representation Learningcited by 232
- 2019Scaling and Benchmarking Self-Supervised Visual Representation Learningcited by 201
- 2018Boosting Self-Supervised Learning via Knowledge Transfercited by 92
- 2020MS2L: Multi-Task Self-Supervised Learning for Skeleton Based Action Recognitioncited by 92
18 more
- 2019A neural network based on SPD manifold learning for skeleton-based hand gesture recognitioncited by 46
- 2019Self-Supervised Learning For Few-Shot Image Classificationcited by 44
- 2020Adversarial Self-Supervised Learning for Semi-Supervised 3D Action Recognitioncited by 34
- 2017Improvements to context based self-supervised learningcited by 32
- 2018Self-Supervised Adversarial Hashing Networks for Cross-Modal Retrievalcited by 29
- 2019Construct Dynamic Graphs for Hand Gesture Recognition via Spatial-Temporal Attentioncited by 22
- 2019Make Skeleton-based Action Recognition Model Smaller, Faster and Bettercited by 22
- 2020Extending and Analyzing Self-Supervised Learning Across Domainscited by 20
- 2020FS-HGR: Few-shot Learning for Hand Gesture Recognition via ElectroMyographycited by 17
- 2020CNN+RNN Depth and Skeleton based Dynamic Hand Gesture Recognitioncited by 16
- 2017Motion Feature Augmented Recurrent Neural Network for Skeleton-based Dynamic Hand Gesture Recognitioncited by 10
- 2020Automated Quality Assessment of Hand Washing Using Deep Learningcited by 6
- 2020An Ensemble of Knowledge Sharing Models for Dynamic Hand Gesture Recognitioncited by 4
- 2020A Prototype-Based Generalized Zero-Shot Learning Framework for Hand Gesture Recognitioncited by 4
- 2019Synthetic Video Generation for Robust Hand Gesture Recognition in Augmented Reality Applicationscited by 2
- 2020LE-HGR: A Lightweight and Efficient RGB-based Online Gesture Recognition Network for Embedded AR Devicescited by 2
- 20203D dynamic hand gestures recognition using the Leap Motion sensor and convolutional neural networkscited by 2
- 2017Hand Gesture Recognition with Leap Motioncited by 1
Built on by
Citing papers per year: 2022: 1.
1 paper.