On-device Real-time Hand Gesture Recognition
Not on the map. Why?
Abstract (arXiv)
We present an on-device real-time hand gesture recognition (HGR) system, which detects a set of predefined static gestures from a single RGB camera. The system consists of two parts: a hand skeleton tracker and a gesture classifier. We use MediaPipe Hands as the basis of the hand skeleton tracker, improve the keypoint accuracy, and add the estimation of 3D keypoints in a world metric space. We create two different gesture classifiers, one based on heuristics and the other using neural networks (NN).
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 5 of its 13 references that are in the map. First posted on arXiv 29 Oct 2021.
Builds on
5 of 13 references.
References · 5
- 2017Focal Loss for Dense Object Detectioncited by 752
- 2019MediaPipe: A Framework for Building Perception Pipelinescited by 583
- 2020MediaPipe Hands: On-device Real-time Hand Trackingcited by 161
- 2020BlazePose: On-device Real-time Body Pose trackingcited by 113
- 2020Weakly Supervised 3D Human Pose and Shape Reconstruction with Normalizing Flowscited by 94
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 1; 2025: 0; 2026: 1.
6 papers.
- 2022BlazePose GHUM Holistic: Real-time 3D Human Landmarks and Pose Estimationcited by 13
- 2023On-device Real-time Custom Hand Gesture Recognitioncited by 0
- 2023Proving the Potential of Skeleton Based Action Recognition to Automate the Analysis of Manual Processescited by 0
- 2023GRLib: An Open-Source Hand Gesture Detection and Recognition Python Librarycited by 0
- 2024Automated Patient Positioning with Learned 3D Hand Gesturescited by 0
- 2026Beyond Landmark Extraction: A Framework for Robust Geometric Feature Construction in Structured Image Classificationcited by 0
- 2026Beyond Landmark Extraction: A Framework for Robust Geometric Feature Construction in Structured Image Classification1 Sep 2026
- 2024Automated Patient Positioning with Learned 3D Hand Gestures20 Jul 2024
- 2023GRLib: An Open-Source Hand Gesture Detection and Recognition Python Library23 Oct 2023
- 2023Proving the Potential of Skeleton Based Action Recognition to Automate the Analysis of Manual Processes12 Oct 2023
- 2023On-device Real-time Custom Hand Gesture Recognition19 Sep 2023
- 2022BlazePose GHUM Holistic: Real-time 3D Human Landmarks and Pose Estimation23 Jun 2022