mlsanityData to 13 Oct 2026

Hand Avatar: Free-Pose Hand Animation and Rendering from Monocular Video

arXiv 2211.12782 ↗First posted 23 Nov 2022cs.CV cs.GRcited by 37

Not on the map. Why?

Abstract (arXiv)

We present HandAvatar, a novel representation for hand animation and rendering, which can generate smoothly compositional geometry and self-occlusion-aware texture. Specifically, we first develop a MANO-HD model as a high-resolution mesh topology to fit personalized hand shapes. Sequentially, we decompose hand geometry into per-bone rigid parts, and then re-compose paired geometry encodings to derive an across-part consistent occupancy field. As for texture modeling, we propose a self-occlusion-aware shading field (SelF). In SelF, drivable anchors are paved on the MANO-HD surface to record albedo information under a wide variety of hand poses. Moreover, directed soft occupancy is designed to describe the ray-to-surface relation, which is leveraged to generate an illumination field for the disentanglement of pose-independent albedo and pose-dependent illumination. Trained from monocular video data, our HandAvatar can perform free-pose hand animation and rendering while at the same time achieving superior appearance fidelity. We also demonstrate that HandAvatar provides a route for hand appearance editing. Project website: https://seanchenxy.github.io/HandAvatarWeb.

Key facts. Cited by 37 papers in the map (data through 13 Oct 2026). Builds on 61 of its 80 references that are in the map. First posted on arXiv 23 Nov 2022.

Builds on

61 of 80 references.

References · 61

  1. 2017Attention Is All You Needcited by 60,106
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,231
  4. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,603
  5. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,195
  6. 2021Volume Rendering of Neural Implicit Surfacescited by 992
  7. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  8. 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 747
  9. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  10. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 495
  11. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  12. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
38 more
  1. 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 447
  2. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  3. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  4. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  5. 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 245
  6. 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
  7. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  8. 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
  9. 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
  10. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  11. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
  12. 2021Neural Head Avatars from Monocular RGB Videoscited by 213
  13. 2021Neural Articulated Radiance Fieldcited by 196
  14. 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
  15. 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 180
  16. 2020Grasping Field: Learning Implicit Representations for Human Graspscited by 178
  17. 2017MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstructioncited by 163
  18. 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
  19. 2019NASA: Neural Articulated Shape Approximationcited by 149
  20. 2021Editable Free-viewpoint Video Using a Layered Neural Representationcited by 148
  21. 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
  22. 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 141
  23. 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
  24. 2021NeRF for Outdoor Scene Relightingcited by 114
  25. 2021HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputscited by 112
  26. 2020i3DMM: Deep Implicit 3D Morphable Model of Human Headscited by 109
  27. 2020LoopReg: Self-supervised Learning of Implicit Surface Correspondences, Pose and Shape for 3D Human Mesh Registrationcited by 108
  28. 2021LEAP: Learning Articulated Occupancy of Peoplecited by 107
  29. 2021Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Controlcited by 106
  30. 2021imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Posecited by 103
  31. 2019Structured Prediction Helps 3D Human Motion Modellingcited by 96
  32. 2018FML: Face Model Learning from Videoscited by 78
  33. 2020Hierarchical Kinematic Human Mesh Recoverycited by 71
  34. 2021Model-based 3D Hand Reconstruction via Self-Supervised Learningcited by 65
  35. 2022ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 64
  36. 2022LISA: Learning Implicit Shape and Appearance of Handscited by 63
  37. 2022COAP: Compositional Articulated Occupancy of Peoplecited by 59
  38. 2021DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Reconstruction and Renderingcited by 52

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2022: 1; 2023: 4; 2024: 15; 2025: 8; 2026: 9.

37 papers.

Sort:

By area:

  1. 2023HOLD: Category-agnostic 3D Reconstruction of Interacting Hands and Objects from Videocited by 76
  2. 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mambacited by 45
  3. 2024Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objectscited by 35
  4. 2022HARP: Personalized Hand Reconstruction from a Monocular RGB Videocited by 28
  5. 2024OHTA: One-shot Hand Avatar via Data-driven Implicit Priorscited by 18
  6. 2024URHand: Universal Relightable Handscited by 17
  7. 2025MagicHOI: Leveraging 3D Priors for Accurate Hand-object Reconstruction from Short Monocular Video Clipscited by 15
  8. 2024Authentic Hand Avatar from a Phone Scan via Universal Hand Modelcited by 13
  9. 20233D Points Splatting for Real-Time Dynamic Hand Reconstructioncited by 10
  10. 2025BIGS: Bimanual Category-agnostic Interaction Reconstruction from Monocular Videos via 3D Gaussian Splattingcited by 10
  11. 2024BiTT: Bi-directional Texture Reconstruction of Interacting Two Hands from a Single Imagecited by 8
  12. 2024HandDGP: Camera-Space Hand Mesh Prediction with Differentiable Global Positioningcited by 7
25 more
  1. 2024MaskHand: Generative Masked Modeling for Robust Hand Mesh Reconstruction in the Wildcited by 5
  2. 20243D Visibility-aware Generalizable Neural Radiance Fields for Interacting Handscited by 4
  3. 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Fieldcited by 4
  4. 2026PAD-Hand: Physics-Aware Diffusion for Hand Motion Recoverycited by 4
  5. 2024Generalizable Neural Human Renderercited by 3
  6. 2024MLPHand: Real Time Multi-View 3D Hand Mesh Reconstruction via MLP Modelingcited by 3
  7. 2024Fine-Grained Multi-View Hand Reconstruction Using Inverse Renderingcited by 3
  8. 2024Learning Interaction-aware 3D Gaussian Splatting for One-shot Hand Avatarscited by 3
  9. 2025JGHand: Joint-Driven Animatable Hand Avater via 3D Gaussian Splattingcited by 3
  10. 2025SRHand: Super-Resolving Hand Images and 3D Shapes via View/Pose-aware Neural Image Representations and Explicit 3D Meshescited by 3
  11. 2025PALM: A Dataset and Baseline for Learning Multi-subject Hand Priorcited by 3
  12. 2026GHOST: Fast Category-agnostic Hand-Object Interaction Reconstruction from RGB Videos using Gaussian Splattingcited by 3
  13. 2026Glove2Hand: Synthesizing Natural Hand-Object Interaction from Multi-Modal Sensing Glovescited by 3
  14. 2023HiFiHR: Enhancing 3D Hand Reconstruction from a Single Image via High-Fidelity Texturecited by 2
  15. 2024XHand: Real-time Expressive Hand Avatarcited by 2
  16. 2025HandOcc: NeRF-based Hand Rendering with Occupancy Networkscited by 2
  17. 2026AVI-HT: Adaptive Vision-IMU Fusion for 3D Hand Trackingcited by 2
  18. 2024NCRF: Neural Contact Radiance Fields for Free-Viewpoint Rendering of Hand-Object Interactioncited by 1
  19. 2025HandSCS: Structural Coordinate Space for Animatable Hand Gaussian Splattingcited by 1
  20. 2026NBAvatar: Neural Billboards Avatars with Realistic Hand-Face Interactioncited by 1
  21. 2023Monocular 3D Hand Mesh Recovery via Dual Noise Estimationcited by 0
  22. 2026WildGHand: Learning Anti-Perturbation Gaussian Hand Avatars from Monocular In-the-Wild Videoscited by 0
  23. 2026High-Fidelity 4D Hand-Object Capture via Multi-View Spatiotemporal Tracking and Physics-Aware Gaussianscited by 0
  24. 2026Hand-4DGS: Feed-Forward 3D Gaussian Splatting for 4D Hand Reconstruction from Egocentric Videoscited by 0
  25. 2026OASIS: Occlusion-aware Single-image Hand Avatar Reconstruction via 3D Gaussian Splattingcited by 0