# Nonparametric Structure Regularization Machine for 2D Hand Pose Estimation

arXiv: https://arxiv.org/abs/2001.08869 · HTML: https://mlsanity.com/paper/2001.08869/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Jan 2020.

## Built on by (most cited first, 12 of 12)

- [TransFusion: Cross-view Fusion with Transformer for 3D Human Pose Estimation](https://mlsanity.com/paper/2110.09554/) (2021)
- [Hand Image Understanding via Deep Multi-Task Learning](https://mlsanity.com/paper/2107.11646/) (2021)
- [PPT: token-Pruned Pose Transformer for monocular and multi-view human pose estimation](https://mlsanity.com/paper/2209.08194/) (2022)
- [ZoomNAS: Searching for Whole-body Human Pose Estimation in the Wild](https://mlsanity.com/paper/2208.11547/) (2022)
- [Identity-Aware Hand Mesh Estimation and Personalization from RGB Images](https://mlsanity.com/paper/2209.10840/) (2022)
- [ARShoe: Real-Time Augmented Reality Shoe Try-on System on Smartphones](https://mlsanity.com/paper/2108.10515/) (2021)
- [Robustness Evaluation in Hand Pose Estimation Models using Metamorphic Testing](https://mlsanity.com/paper/2303.04566/) (2023)
- [Fast Monocular Hand Pose Estimation on Embedded Systems](https://mlsanity.com/paper/2102.07067/) (2021)
- [A Review on Human Pose Estimation](https://mlsanity.com/paper/2110.06877/) (2021)
- [Long-Distance Gesture Recognition using Dynamic Neural Networks](https://mlsanity.com/paper/2308.04643/) (2023)
- [SGE net: Video object detection with squeezed GRU and information entropy map](https://mlsanity.com/paper/2106.07224/) (2021)
- [Distilling Token-Pruned Pose Transformer for 2D Human Pose Estimation](https://mlsanity.com/paper/2304.05548/) (2023)

## Abstract (arXiv)

Hand pose estimation is more challenging than body pose estimation due to severe articulation, self-occlusion and high dexterity of the hand. Current approaches often rely on a popular body pose algorithm, such as the Convolutional Pose Machine (CPM), to learn 2D keypoint features. These algorithms cannot adequately address the unique challenges of hand pose estimation, because they are trained solely based on keypoint positions without seeking to explicitly model structural relationship between them. We propose a novel Nonparametric Structure Regularization Machine (NSRM) for 2D hand pose estimation, adopting a cascade multi-task architecture to learn hand structure and keypoint representations jointly. The structure learning is guided by synthetic hand mask representations, which are directly computed from keypoint positions, and is further strengthened by a novel probabilistic representation of hand limbs and an anatomically inspired composition strategy of mask synthesis. We conduct extensive studies on two public datasets - OneHand 10k and CMU Panoptic Hand. Experimental results demonstrate that explicitly enforcing structure learning consistently improves pose estimation accuracy of CPM baseline models, by 1.17% on the first dataset and 4.01% on the second one. The implementation and experiment code is freely available online. Our proposal of incorporating structural learning to hand pose estimation requires no additional training information, and can be a generic add-on module to other pose estimation models.