Gaussian Control with Hierarchical Semantic Graphs in 3D Human Recovery
Not on the map. Why?
Abstract (arXiv)
Although 3D Gaussian Splatting (3DGS) has recently made progress in 3D human reconstruction, it primarily relies on 2D pixel-level supervision, overlooking the geometric complexity and topological relationships of different body parts. To address this gap, we introduce the Hierarchical Graph Human Gaussian Control (HUGS) framework for achieving high-fidelity 3D human reconstruction. Our approach involves leveraging explicitly semantic priors of body parts to ensure the consistency of geometric topology, thereby enabling the capture of the complex geometrical and topological associations among body parts. Additionally, we disentangle high-frequency features from global human features to refine surface details in body parts. Extensive experiments demonstrate that our method exhibits superior performance in human body reconstruction, particularly in enhancing surface details and accurately reconstructing body part junctions. Codes are available at https://wanghongsheng01.github.io/HUGS/.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 48 of its 62 references that are in the map. First posted on arXiv 21 May 2024.
Builds on
48 of 62 references.
References · 48
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2014DeepWalk: Online Learning of Social Representationscited by 1,543
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
36 more
- 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 401
- 2020Local Implicit Grid Representations for 3D Scenescited by 372
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2017Learning from Synthetic Humanscited by 358
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2017struc2vec: Learning Node Representations from Structural Identitycited by 214
- 2017Unite the People: Closing the Loop Between 3D and 2D Human Representationscited by 205
- 2016Learning a Predictable and Generative Vector Representation for Objectscited by 173
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2020DeepCap: Monocular Human Performance Capture Using Weak Supervisioncited by 162
- 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
- 2023HUGS: Human Gaussian Splatscited by 154
- 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
- 2018BodyNet: Volumetric Inference of 3D Human Body Shapescited by 141
- 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
- 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
- 2021Real-time Deep Dynamic Characterscited by 133
- 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatarscited by 105
- 2017Self-supervised Learning of Motion Capturecited by 97
- 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
- 2023Learning Neural Volumetric Representations of Dynamic Humans in Minutescited by 70
- 2022Control-NeRF: Editable Feature Volumes for Scene Rendering and Manipulationcited by 57
- 2020Human Mesh Recovery from Multiple Shotscited by 52
- 2019Learning 3D Human Shape and Pose from Dense Body Partscited by 48
- 2022PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video Sequencecited by 46
- 2022Surface-Aligned Neural Radiance Fields for Controllable 3D Human Synthesiscited by 41
- 2024GaussianBody: Clothed Human Reconstruction via 3d Gaussian Splattingcited by 36
- 2023Human101: Training 100+FPS Human Gaussians in 100s from 1 Viewcited by 32
- 2023Animatable 3D Gaussian: Fast and High-Quality Reconstruction of Multiple Human Avatarscited by 30
- 2022OSSO: Obtaining Skeletal Shape from Outsidecited by 25
- 2023ActorsNeRF: Animatable Few-shot Human Rendering with Generalizable NeRFscited by 21
- 2023Re-ReND: Real-time Rendering of NeRFs across Devicescited by 17
- 2024UV Gaussians: Joint Learning of Mesh Deformation and Gaussian Textures for Human Avatar Modelingcited by 17
- 2022H4D: Human 4D Modeling by Learning Neural Compositional Representationcited by 15
- 2022Learning Motion-Dependent Appearance for High-Fidelity Rendering of Dynamic Humans from a Single Cameracited by 12
Built on by
Citing papers per year: 2024: 3.
3 papers.