OHTA: One-shot Hand Avatar via Data-driven Implicit Priors
Not on the map. Why?
Abstract (arXiv)
In this paper, we delve into the creation of one-shot hand avatars, attaining high-fidelity and drivable hand representations swiftly from a single image. With the burgeoning domains of the digital human, the need for quick and personalized hand avatar creation has become increasingly critical. Existing techniques typically require extensive input data and may prove cumbersome or even impractical in certain scenarios. To enhance accessibility, we present a novel method OHTA (One-shot Hand avaTAr) that enables the creation of detailed hand avatars from merely one image. OHTA tackles the inherent difficulties of this data-limited problem by learning and utilizing data-driven hand priors. Specifically, we design a hand prior model initially employed for 1) learning various hand priors with available data and subsequently for 2) the inversion and fitting of the target identity with prior knowledge. OHTA demonstrates the capability to create high-fidelity hand avatars with consistent animatable quality, solely relying on a single image. Furthermore, we illustrate the versatility of OHTA through diverse applications, encompassing text-to-avatar conversion, hand editing, and identity latent space manipulation.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 69 of its 86 references that are in the map. First posted on arXiv 29 Feb 2024.
Builds on
69 of 86 references.
References · 69
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Segment Anythingcited by 8,158
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
38 more
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
- 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2021Neural Head Avatars from Monocular RGB Videoscited by 212
- 2020STAR: Sparse Trained Articulated Human Body Regressorcited by 194
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2020Whole-Body Human Pose Estimation in the Wildcited by 178
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
- 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
- 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
- 2019NASA: Neural Articulated Shape Approximationcited by 149
- 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
- 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 141
- 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
- 2020Geo-PIFu: Geometry and Pixel Aligned Implicit Functions for Single-view Human Reconstructioncited by 112
- 2021HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputscited by 112
- 2021LEAP: Learning Articulated Occupancy of Peoplecited by 107
- 2021Neural-GIF: Neural Generalized Implicit Functions for Animating People in Clothingcited by 102
- 2021imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Posecited by 102
- 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
- 2019360-Degree Textures of People in Clothing from a Single Imagecited by 75
- 2019Detailed Human Shape Estimation from a Single Image by Hierarchical Mesh Deformationcited by 71
- 2021Model-based 3D Hand Reconstruction via Self-Supervised Learningcited by 65
- 2023Consistent123: One Image to Highly Consistent 3D Asset Using Case-Aware Diffusion Priorscited by 64
50 most cited of 69 All 69 (JSON)
Built on by
Citing papers per year: 2024: 4; 2025: 9; 2026: 5.
18 papers.
Sort:
- 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
- 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
- 2025SEGA: Drivable 3D Gaussian Head Avatar from a Single Imagecited by 11
- 2025RePerformer: Immersive Human-centric Volumetric Videos from Playback to Photoreal Reperformancecited by 8
- 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Fieldcited by 4
- 2024Learning Interaction-aware 3D Gaussian Splatting for One-shot Hand Avatarscited by 3
- 2025JGHand: Joint-Driven Animatable Hand Avater via 3D Gaussian Splattingcited by 3
- 2025Parametric Gaussian Human Model: Generalizable Prior for Efficient and Realistic Human Avatar Modelingcited by 3
- 2025SRHand: Super-Resolving Hand Images and 3D Shapes via View/Pose-aware Neural Image Representations and Explicit 3D Meshescited by 3
- 2025PALM: A Dataset and Baseline for Learning Multi-subject Hand Priorcited by 3
- 2026Glove2Hand: Synthesizing Natural Hand-Object Interaction from Multi-Modal Sensing Glovescited by 3
- 2024XHand: Real-time Expressive Hand Avatarcited by 2
6 more
- 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformationcited by 2
- 2025HandSCS: Structural Coordinate Space for Animatable Hand Gaussian Splattingcited by 1
- 2026WildGHand: Learning Anti-Perturbation Gaussian Hand Avatars from Monocular In-the-Wild Videoscited by 0
- 2026HandDreamer: Zero-Shot Text to 3D Hand Model Generation using Corrective Hand Shape Guidancecited by 0
- 2026MASS: Mesh-inellipse Aligned Deformable Surfel Splatting for Hand Reconstruction and Rendering from Egocentric Monocular Videocited by 0
- 2026Hand-4DGS: Feed-Forward 3D Gaussian Splatting for 4D Hand Reconstruction from Egocentric Videoscited by 0
- 2026Hand-4DGS: Feed-Forward 3D Gaussian Splatting for 4D Hand Reconstruction from Egocentric Videos17 Jun 2026
- 2026MASS: Mesh-inellipse Aligned Deformable Surfel Splatting for Hand Reconstruction and Rendering from Egocentric Monocular Video10 Apr 2026
- 2026HandDreamer: Zero-Shot Text to 3D Hand Model Generation using Corrective Hand Shape Guidance6 Apr 2026
- 2026Glove2Hand: Synthesizing Natural Hand-Object Interaction from Multi-Modal Sensing Gloves21 Mar 2026
- 2026WildGHand: Learning Anti-Perturbation Gaussian Hand Avatars from Monocular In-the-Wild Videos24 Feb 2026
- 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformation19 Dec 2025
- 2025PALM: A Dataset and Baseline for Learning Multi-subject Hand Prior7 Nov 2025
- 2025SRHand: Super-Resolving Hand Images and 3D Shapes via View/Pose-aware Neural Image Representations and Explicit 3D Meshes26 Sep 2025
- 2025Parametric Gaussian Human Model: Generalizable Prior for Efficient and Realistic Human Avatar Modeling7 Jun 2025
- 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Field15 May 2025
- 2025SEGA: Drivable 3D Gaussian Head Avatar from a Single Image19 Apr 2025
- 2025HandSCS: Structural Coordinate Space for Animatable Hand Gaussian Splatting18 Mar 2025
6 more
- 2025RePerformer: Immersive Human-centric Volumetric Videos from Playback to Photoreal Reperformance15 Mar 2025
- 2025JGHand: Joint-Driven Animatable Hand Avater via 3D Gaussian Splatting31 Jan 2025
- 2024Learning Interaction-aware 3D Gaussian Splatting for One-shot Hand Avatars11 Oct 2024
- 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priors12 Aug 2024
- 2024XHand: Real-time Expressive Hand Avatar30 Jul 2024
- 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priors18 Jun 2024
- 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
- 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
- 2025SEGA: Drivable 3D Gaussian Head Avatar from a Single Imagecited by 11
- 2025RePerformer: Immersive Human-centric Volumetric Videos from Playback to Photoreal Reperformancecited by 8
- 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Fieldcited by 4
- 2024Learning Interaction-aware 3D Gaussian Splatting for One-shot Hand Avatarscited by 3
- 2025JGHand: Joint-Driven Animatable Hand Avater via 3D Gaussian Splattingcited by 3
- 2025Parametric Gaussian Human Model: Generalizable Prior for Efficient and Realistic Human Avatar Modelingcited by 3
- 2025SRHand: Super-Resolving Hand Images and 3D Shapes via View/Pose-aware Neural Image Representations and Explicit 3D Meshescited by 3
- 2025PALM: A Dataset and Baseline for Learning Multi-subject Hand Priorcited by 3
- 2026Glove2Hand: Synthesizing Natural Hand-Object Interaction from Multi-Modal Sensing Glovescited by 3
- 2024XHand: Real-time Expressive Hand Avatarcited by 2
12 most cited of 18 All 18 (JSON)
- 2026Hand-4DGS: Feed-Forward 3D Gaussian Splatting for 4D Hand Reconstruction from Egocentric Videos17 Jun 2026
- 2026MASS: Mesh-inellipse Aligned Deformable Surfel Splatting for Hand Reconstruction and Rendering from Egocentric Monocular Video10 Apr 2026
- 2026HandDreamer: Zero-Shot Text to 3D Hand Model Generation using Corrective Hand Shape Guidance6 Apr 2026
- 2026Glove2Hand: Synthesizing Natural Hand-Object Interaction from Multi-Modal Sensing Gloves21 Mar 2026
- 2026WildGHand: Learning Anti-Perturbation Gaussian Hand Avatars from Monocular In-the-Wild Videos24 Feb 2026
- 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformation19 Dec 2025
- 2025PALM: A Dataset and Baseline for Learning Multi-subject Hand Prior7 Nov 2025
- 2025SRHand: Super-Resolving Hand Images and 3D Shapes via View/Pose-aware Neural Image Representations and Explicit 3D Meshes26 Sep 2025
- 2025Parametric Gaussian Human Model: Generalizable Prior for Efficient and Realistic Human Avatar Modeling7 Jun 2025
- 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Field15 May 2025
- 2025SEGA: Drivable 3D Gaussian Head Avatar from a Single Image19 Apr 2025
- 2025HandSCS: Structural Coordinate Space for Animatable Hand Gaussian Splatting18 Mar 2025
12 newest of 18 All 18 (JSON)