OASIS: Occlusion-aware Single-image Hand Avatar Reconstruction via 3D Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
Single-image 3D hand avatar reconstruction is fundamentally ill-posed and particularly challenging due to limited visual evidence under severe self-occlusion and the complex pose-dependent deformation of highly articulated hands. Existing methods predominantly rely on implicit NeRF-style representations, whose volumetric fitting is computationally expensive and often struggles to preserve fine-grained hand details. In this work, we present OASIS, a tailored 3D Gaussian Splatting framework for single-image hand avatar reconstruction. To faithfully encode sparse image-specific appearance cues in single-view reconstruction, we construct geometry-aligned visual evidence tokens by explicitly aligning input image observations with 3D hand geometry and context-adaptively tokenizing the resulting visual evidence. Since severe self-occlusion makes the reliability of image evidence inherently visibility-dependent, we introduce a visibility-conditioned point-image attention to reliably transfer visual evidence to geometric tokens, yielding occlusion-aware Gaussian features for faithful and robust reconstruction. To further capture non-rigid deformation of articulated hands, we introduce a Feature-on-Mesh representation to enable Gaussian deformation to be guided by local surface stretching. Under this framework, we adopt a one-shot adaptation scheme that learns a shared hand prior from multi-identity training data and then fits it to a target image for target-specific reconstruction. Extensive experiments show that OASIS outperforms existing baselines in both visual fidelity and efficiency across challenging poses and in-the-wild scenarios, and further demonstrates strong versatility in downstream applications such as text-to-avatar generation and texture editing.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 42 references that are in the map. First posted on arXiv 31 Jul 2026.
Builds on
22 of 42 references.
References · 22
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
- 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 171
- 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 117
- 2022LISA: Learning Implicit Shape and Appearance of Handscited by 63
- 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mambacited by 45
- 2025LAM: Large Avatar Model for One-shot Animatable Gaussian Headcited by 43
- 2022Hand Avatar: Free-Pose Hand Animation and Rendering from Monocular Videocited by 37
10 more
- 2024AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstructioncited by 36
- 2021Contrastive Representation Learning for Hand Shape Estimationcited by 34
- 2022HARP: Personalized Hand Reconstruction from a Monocular RGB Videocited by 28
- 2023LiveHand: Real-time and Photorealistic Neural Hand Renderingcited by 26
- 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatarcited by 22
- 2019Contextual Attention for Hand Detection in the Wildcited by 16
- 2024Authentic Hand Avatar from a Phone Scan via Universal Hand Modelcited by 13
- 2024GST: Precise 3D Human Body from a Single Image with Gaussian Splatting Transformerscited by 11
- 2024BiTT: Bi-directional Texture Reconstruction of Interacting Two Hands from a Single Imagecited by 8
- 2025SyncHuman: Synchronizing 2D and 3D Generative Models for Single-view Human Reconstructioncited by 8
Built on by
Not cited yet.