HandSCS: Structural Coordinate Space for Animatable Hand Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
Photorealistic and animatable hand avatars are essential for applications such as AR/VR, gaming, and telepresence. Recent 3D Gaussian Splatting (3DGS) based avatar methods enable real-time rendering of articulated humans, but modeling hands remains challenging due to their compact structure, frequent self-occlusions, and complex finger interactions. Existing approaches primarily rely on pose-driven transformations while representing Gaussians in Euclidean space, lacking an explicit structural association with the underlying skeleton, which makes preserving fine-grained hand structures under complex articulations difficult. In this work, we introduce the Structural Coordinate Space (SCS), a skeleton-relative representation that assigns each Gaussian primitive an explicit structural coordinate with respect to the articulated hand skeleton. SCS is constructed using a hybrid static-virtual bone basis together with a distance-rotation structural descriptor that encodes the geometric relationship between Gaussians and bones. Based on SCS, we enforce both intra-pose and cross-pose structural consistency by combining per-Gaussian residual embeddings for local appearance modeling with structural correspondence across poses. Experiments demonstrate that our approach significantly improves structural consistency and preserves fine geometric details under challenging hand articulations compared with existing 3DGS-based avatar methods.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 37 of its 48 references that are in the map. First posted on arXiv 18 Mar 2025.
Builds on
37 of 48 references.
References · 37
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 245
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 172
- 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2023HUGS: Human Gaussian Splatscited by 154
- 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
- 2023Drivable 3D Gaussian Avatarscited by 120
- 2021LEAP: Learning Articulated Occupancy of Peoplecited by 107
25 more
- 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatarscited by 105
- 2023ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Renderingcited by 104
- 2024Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splattingcited by 104
- 2023HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splattingcited by 70
- 2021Model-based 3D Hand Reconstruction via Self-Supervised Learningcited by 65
- 2022LISA: Learning Implicit Shape and Appearance of Handscited by 63
- 2024GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Meshcited by 51
- 2020DeepHandMesh: A Weakly-supervised Deep Encoder-Decoder Framework for High-fidelity Hand Mesh Modelingcited by 49
- 2024Generalizable Human Gaussians for Sparse View Synthesiscited by 40
- 2022Hand Avatar: Free-Pose Hand Animation and Rendering from Monocular Videocited by 37
- 2024GaussianBody: Clothed Human Reconstruction via 3d Gaussian Splattingcited by 36
- 2023A Probabilistic Attention Model with Occlusion-aware Texture Regression for 3D Hand Reconstruction from a Single RGB Imagecited by 32
- 2022HARP: Personalized Hand Reconstruction from a Monocular RGB Videocited by 28
- 2023HandNeRF: Neural Radiance Fields for Animatable Interacting Handscited by 27
- 2023LiveHand: Real-time and Photorealistic Neural Hand Renderingcited by 26
- 2023MANUS: Markerless Grasp Capture using Articulated 3D Gaussianscited by 26
- 2024OHTA: One-shot Hand Avatar via Data-driven Implicit Priorscited by 18
- 2024Authentic Hand Avatar from a Phone Scan via Universal Hand Modelcited by 13
- 20233D Points Splatting for Real-Time Dynamic Hand Reconstructioncited by 10
- 2024BiTT: Bi-directional Texture Reconstruction of Interacting Two Hands from a Single Imagecited by 8
- 2023PHRIT: Parametric Hand Representation with Implicit Templatecited by 5
- 2024Fine-Grained Multi-View Hand Reconstruction Using Inverse Renderingcited by 3
- 2024Learning Interaction-aware 3D Gaussian Splatting for One-shot Hand Avatarscited by 3
- 2025JGHand: Joint-Driven Animatable Hand Avater via 3D Gaussian Splattingcited by 3
- 2024XHand: Real-time Expressive Hand Avatarcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.