mlsanityData to 7 Oct 2026

Gaussian Control with Hierarchical Semantic Graphs in 3D Human Recovery

arXiv 2405.12477 ↗First posted 21 May 2024cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Although 3D Gaussian Splatting (3DGS) has recently made progress in 3D human reconstruction, it primarily relies on 2D pixel-level supervision, overlooking the geometric complexity and topological relationships of different body parts. To address this gap, we introduce the Hierarchical Graph Human Gaussian Control (HUGS) framework for achieving high-fidelity 3D human reconstruction. Our approach involves leveraging explicitly semantic priors of body parts to ensure the consistency of geometric topology, thereby enabling the capture of the complex geometrical and topological associations among body parts. Additionally, we disentangle high-frequency features from global human features to refine surface details in body parts. Extensive experiments demonstrate that our method exhibits superior performance in human body reconstruction, particularly in enhancing surface details and accurately reconstructing body part junctions. Codes are available at https://wanghongsheng01.github.io/HUGS/.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 48 of its 62 references that are in the map. First posted on arXiv 21 May 2024.

Builds on

48 of 62 references.

References · 48

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  3. 2014DeepWalk: Online Learning of Social Representationscited by 1,543
  4. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  5. 2017End-to-end Recovery of Human Shape and Posecited by 883
  6. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  7. 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
  8. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  9. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  10. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  11. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  12. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
36 more
  1. 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 401
  2. 2020Local Implicit Grid Representations for 3D Scenescited by 372
  3. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  4. 2017Learning from Synthetic Humanscited by 358
  5. 2021Neural RGB-D Surface Reconstructioncited by 312
  6. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  7. 2017struc2vec: Learning Node Representations from Structural Identitycited by 214
  8. 2017Unite the People: Closing the Loop Between 3D and 2D Human Representationscited by 205
  9. 2016Learning a Predictable and Generative Vector Representation for Objectscited by 173
  10. 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
  11. 2020DeepCap: Monocular Human Performance Capture Using Weak Supervisioncited by 162
  12. 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
  13. 2023HUGS: Human Gaussian Splatscited by 154
  14. 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
  15. 2018BodyNet: Volumetric Inference of 3D Human Body Shapescited by 141
  16. 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
  17. 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
  18. 2021Real-time Deep Dynamic Characterscited by 133
  19. 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatarscited by 105
  20. 2017Self-supervised Learning of Motion Capturecited by 97
  21. 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
  22. 2023Learning Neural Volumetric Representations of Dynamic Humans in Minutescited by 70
  23. 2022Control-NeRF: Editable Feature Volumes for Scene Rendering and Manipulationcited by 57
  24. 2020Human Mesh Recovery from Multiple Shotscited by 52
  25. 2019Learning 3D Human Shape and Pose from Dense Body Partscited by 48
  26. 2022PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video Sequencecited by 46
  27. 2022Surface-Aligned Neural Radiance Fields for Controllable 3D Human Synthesiscited by 41
  28. 2024GaussianBody: Clothed Human Reconstruction via 3d Gaussian Splattingcited by 36
  29. 2023Human101: Training 100+FPS Human Gaussians in 100s from 1 Viewcited by 32
  30. 2023Animatable 3D Gaussian: Fast and High-Quality Reconstruction of Multiple Human Avatarscited by 30
  31. 2022OSSO: Obtaining Skeletal Shape from Outsidecited by 25
  32. 2023ActorsNeRF: Animatable Few-shot Human Rendering with Generalizable NeRFscited by 21
  33. 2023Re-ReND: Real-time Rendering of NeRFs across Devicescited by 17
  34. 2024UV Gaussians: Joint Learning of Mesh Deformation and Gaussian Textures for Human Avatar Modelingcited by 17
  35. 2022H4D: Human 4D Modeling by Learning Neural Compositional Representationcited by 15
  36. 2022Learning Motion-Dependent Appearance for High-Fidelity Rendering of Dynamic Humans from a Single Cameracited by 12

Built on by

Cited by year

Citing papers per year: 2024: 3.

3 papers.