Training a Feedback Loop for Hand Pose Estimation
Not on the map. Why?
Abstract (arXiv)
We propose an entirely data-driven approach to estimating the 3D pose of a hand given a depth image. We show that we can correct the mistakes made by a Convolutional Neural Network trained to predict an estimate of the 3D pose by using a feedback loop. The components of this feedback loop are also Deep Networks, optimized using training data. They remove the need for fitting a 3D model to the input data, which requires both a carefully designed fitting function and algorithm. We show that our approach outperforms state-of-the-art methods, and is efficient as our implementation runs at over 400 fps on a single GPU.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Sep 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 5; 2023: 5; 2024: 1.
21 papers.
Sort:
By area:
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 198
- 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 179
- 2021Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimationcited by 122
- 2023FoundPose: Unseen Object Pose Estimation with Foundation Featurescited by 109
- 2021Real-time Pose and Shape Reconstruction of Two Interacting Hands With a Single Depth Cameracited by 70
- 2023ReFit: Recurrent Fitting Network for 3D Human Recoverycited by 47
- 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mambacited by 45
- 2021Single-view robot pose and joint angle estimation via render & comparecited by 33
- 2021RGB2Hands: Real-Time Tracking of 3D Hand Interactions from Monocular RGB Videocited by 23
- 2021BodyPressure -- Inferring Body Pose and Contact Pressure from a Depth Imagecited by 20
- 2022Efficient Annotation and Learning for 3D Hand Pose Estimation: A Surveycited by 17
9 more
- 2021Deep Feedback Inverse Problem Solvercited by 11
- 2023Diff-DOPE: Differentiable Deep Object Pose Estimationcited by 11
- 2021RealisticHands: A Hybrid Model for 3D Hand Reconstructioncited by 5
- 2021Learning Local Recurrent Models for Human Mesh Recoverycited by 3
- 2021Multi-view Image-based Hand Geometry Refinement using Differentiable Monte Carlo Ray Tracingcited by 2
- 2023Pyramid Deep Fusion Network for Two-Hand Reconstruction from RGB-D Imagescited by 2
- 2022End-to-End 3D Hand Pose Estimation from Stereo Camerascited by 1
- 2023AnthroNet: Conditional Generation of Humans via Anthropometricscited by 1
- 2022A Training Method For VideoPose3D With Ideology of Action Recognitioncited by 0
- 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mamba12 Jul 2024
- 2023FoundPose: Unseen Object Pose Estimation with Foundation Features30 Nov 2023
- 2023Diff-DOPE: Differentiable Deep Object Pose Estimation30 Sep 2023
- 2023AnthroNet: Conditional Generation of Humans via Anthropometrics7 Sep 2023
- 2023ReFit: Recurrent Fitting Network for 3D Human Recovery22 Aug 2023
- 2023Pyramid Deep Fusion Network for Two-Hand Reconstruction from RGB-D Images12 Jul 2023
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Compare13 Dec 2022
- 2022A Training Method For VideoPose3D With Ideology of Action Recognition13 Jun 2022
- 2022Efficient Annotation and Learning for 3D Hand Pose Estimation: A Survey5 Jun 2022
- 2022End-to-End 3D Hand Pose Estimation from Stereo Cameras3 Jun 2022
- 2022Embodied Hands: Modeling and Capturing Hands and Bodies Together7 Jan 2022
- 2021RealisticHands: A Hybrid Model for 3D Hand Reconstruction31 Aug 2021
9 more
- 2021Learning Local Recurrent Models for Human Mesh Recovery27 Jul 2021
- 2021Multi-view Image-based Hand Geometry Refinement using Differentiable Monte Carlo Ray Tracing12 Jul 2021
- 2021RGB2Hands: Real-Time Tracking of 3D Hand Interactions from Monocular RGB Video22 Jun 2021
- 2021Real-time Pose and Shape Reconstruction of Two Interacting Hands With a Single Depth Camera15 Jun 2021
- 2021BodyPressure -- Inferring Body Pose and Contact Pressure from a Depth Image20 May 2021
- 2021Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimation29 Apr 2021
- 2021Single-view robot pose and joint angle estimation via render & compare19 Apr 2021
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop30 Mar 2021
- 2021Deep Feedback Inverse Problem Solver19 Jan 2021
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 198
- 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 179
- 2021Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimationcited by 122
- 2023FoundPose: Unseen Object Pose Estimation with Foundation Featurescited by 109
- 2021Real-time Pose and Shape Reconstruction of Two Interacting Hands With a Single Depth Cameracited by 70
- 2023ReFit: Recurrent Fitting Network for 3D Human Recoverycited by 47
- 2021Single-view robot pose and joint angle estimation via render & comparecited by 33
- 2021RGB2Hands: Real-Time Tracking of 3D Hand Interactions from Monocular RGB Videocited by 23
- 2021BodyPressure -- Inferring Body Pose and Contact Pressure from a Depth Imagecited by 20
- 2022Efficient Annotation and Learning for 3D Hand Pose Estimation: A Surveycited by 17
- 2021Deep Feedback Inverse Problem Solvercited by 11
12 most cited of 20 All 20 (JSON)
- 2023FoundPose: Unseen Object Pose Estimation with Foundation Features30 Nov 2023
- 2023Diff-DOPE: Differentiable Deep Object Pose Estimation30 Sep 2023
- 2023AnthroNet: Conditional Generation of Humans via Anthropometrics7 Sep 2023
- 2023ReFit: Recurrent Fitting Network for 3D Human Recovery22 Aug 2023
- 2023Pyramid Deep Fusion Network for Two-Hand Reconstruction from RGB-D Images12 Jul 2023
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Compare13 Dec 2022
- 2022A Training Method For VideoPose3D With Ideology of Action Recognition13 Jun 2022
- 2022Efficient Annotation and Learning for 3D Hand Pose Estimation: A Survey5 Jun 2022
- 2022End-to-End 3D Hand Pose Estimation from Stereo Cameras3 Jun 2022
- 2022Embodied Hands: Modeling and Capturing Hands and Bodies Together7 Jan 2022
- 2021RealisticHands: A Hybrid Model for 3D Hand Reconstruction31 Aug 2021
- 2021Learning Local Recurrent Models for Human Mesh Recovery27 Jul 2021
12 newest of 20 All 20 (JSON)