mlsanityData to 14 Oct 2026

Disentangling Latent Hands for Image Synthesis and Pose Estimation

arXiv 1812.01002 ↗First posted 3 Dec 2018cs.CVcited by 44

Not on the map. Why?

Abstract (arXiv)

Hand image synthesis and pose estimation from RGB images are both highly challenging tasks due to the large discrepancy between factors of variation ranging from image background content to camera viewpoint. To better analyze these factors of variation, we propose the use of disentangled representations and a disentangled variational autoencoder (dVAE) that allows for specific sampling and inference of these factors. The derived objective from the variational lower bound as well as the proposed training strategy are highly flexible, allowing us to handle cross-modal encoders and decoders as well as semi-supervised learning scenarios. Experiments show that our dVAE can synthesize highly realistic images of the hand specifiable by both pose and image background content and also estimate 3D hand poses from RGB images with accuracy competitive with state-of-the-art on two public benchmarks.

Key facts. Cited by 44 papers in the map (data through 14 Oct 2026). First posted on arXiv 3 Dec 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 17; 2022: 9; 2023: 9; 2024: 5; 2025: 3; 2026: 1.

44 papers.

Sort:

By area:

  1. 2022Fine-Grained Egocentric Hand-Object Segmentation: Dataset, Model, and Applicationscited by 78
  2. 2021ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and Synthesiscited by 76
  3. 2021StyleMeUp: Towards Style-Agnostic Sketch-Based Image Retrievalcited by 50
  4. 2021A Skeleton-Driven Neural Occupancy Representation for Articulated Handscited by 50
  5. 2021Towards Accurate Alignment in Real-time 3D Hand-Mesh Reconstructioncited by 44
  6. 2021Learning to Disambiguate Strongly Interacting Hands via Probabilistic Per-pixel Part Segmentationcited by 40
  7. 2022Learning to Imitate Object Interactions from Internet Videoscited by 34
  8. 2021Hand Image Understanding via Deep Multi-Task Learningcited by 31
  9. 2023Directional Connectivity-based Segmentation of Medical Imagescited by 30
  10. 2022Consistent 3D Hand Reconstruction in Video via self-supervised Learningcited by 28
  11. 2022HARP: Personalized Hand Reconstruction from a Monocular RGB Videocited by 28
  12. 2021Monocular 3D Reconstruction of Interacting Hands via Collision-Aware Factorized Refinementscited by 27
32 more
  1. 2023HMP: Hand Motion Priors for Pose and Shape Estimation from Videocited by 23
  2. 2023Deformer: Dynamic Fusion Transformer for Robust Hand Pose Estimationcited by 21
  3. 2025Modeling Fine-Grained Hand-Object Dynamics for Egocentric Video Representation Learningcited by 20
  4. 2023Reconstructing Interacting Hands with Interaction Prior from Monocular Imagescited by 18
  5. 2021HandTailor: Towards High-Precision Monocular 3D Hand Recoverycited by 15
  6. 2023A2J-Transformer: Anchor-to-Joint Transformer Network for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 15
  7. 2024HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Modelscited by 14
  8. 2022UV-Based 3D Hand-Object Reconstruction with Grasp Optimizationcited by 8
  9. 2021Adversarial Motion Modelling helps Semi-supervised Hand Pose Estimationcited by 7
  10. 2023HaMuCo: Hand Pose Estimation via Multiview Collaborative Self-Supervised Learningcited by 7
  11. 2021Local and Global Point Cloud Reconstruction for 3D Hand Pose Estimationcited by 6
  12. 2022End-to-end Weakly-supervised Single-stage Multiple 3D Hand Mesh Reconstruction from a Single RGB Imagecited by 6
  13. 2021Im2Mesh GAN: Accurate 3D Hand Mesh Recovery from a Single RGB Imagecited by 5
  14. 2021RealisticHands: A Hybrid Model for 3D Hand Reconstructioncited by 5
  15. 20213D Hand Pose and Shape Estimation from RGB Images for Keypoint-Based Hand Gesture Recognitioncited by 5
  16. 2022HMD-EgoPose: Head-Mounted Display-Based Egocentric Marker-Less Tool and Hand Pose Estimation for Augmented Surgical Guidancecited by 5
  17. 2024Weakly-Supervised 3D Hand Reconstruction with Knowledge Prior and Uncertainty Guidancecited by 5
  18. 2022Generalized Product-of-Experts for Learning Multimodal Representations in Noisy Environmentscited by 4
  19. 2024ThermoHands: A Benchmark for 3D Hand Pose Estimation from Egocentric Thermal Imagescited by 4
  20. 2023Bias-Compensated Integral Regression for Human Pose Estimationcited by 3
  21. 2023HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priorscited by 3
  22. 2021A hybrid classification-regression approach for 3D hand pose estimation using graph convolutional networkscited by 2
  23. 2021PeCLR: Self-Supervised 3D Hand Pose Estimation from monocular RGB via Equivariant Contrastive Learningcited by 2
  24. 2023Denoising Diffusion for 3D Hand Pose Estimation from Imagescited by 2
  25. 2024Freeview Sketching: View-Aware Fine-Grained Sketch-Based Image Retrievalcited by 2
  26. 2026GeoHand: Unlocking Prior Geometry Knowledge for Monocular 3D Hand Reconstructioncited by 2
  27. 2021Semi-Supervised 3D Hand Shape and Pose Estimation with Label Propagationcited by 1
  28. 2022Learning Sequential Contexts using Transformer for 3D Hand Pose Estimationcited by 1
  29. 2024Two Hands Are Better Than One: Resolving Hand to Hand Intersections via Occupancy Networkscited by 1
  30. 2021Parallel mesh reconstruction streams for pose estimation of interacting handscited by 0
  31. 2025TIGeR: Text-Instructed Generation and Refinement for Template-Free Hand-Object Interactioncited by 0
  32. 2025DF-Mamba: Deformable State Space Modeling for 3D Hand Pose Estimation in Interactionscited by 0