mlsanityData to 7 Oct 2026

Efficient Neural Implicit Representation for 3D Human Reconstruction

arXiv 2410.17741 ↗First posted 23 Oct 2024cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

High-fidelity digital human representations are increasingly in demand in the digital world, particularly for interactive telepresence, AR/VR, 3D graphics, and the rapidly evolving metaverse. Even though they work well in small spaces, conventional methods for reconstructing 3D human motion frequently require the use of expensive hardware and have high processing costs. This study presents HumanAvatar, an innovative approach that efficiently reconstructs precise human avatars from monocular video sources. At the core of our methodology, we integrate the pre-trained HuMoR, a model celebrated for its proficiency in human motion estimation. This is adeptly fused with the cutting-edge neural radiance field technology, Instant-NGP, and the state-of-the-art articulated model, Fast-SNARF, to enhance the reconstruction fidelity and speed. By combining these two technologies, a system is created that can render quickly and effectively while also providing estimation of human pose parameters that are unmatched in accuracy. We have enhanced our system with an advanced posture-sensitive space reduction technique, which optimally balances rendering quality with computational efficiency. In our detailed experimental analysis using both artificial and real-world monocular videos, we establish the advanced performance of our approach. HumanAvatar consistently equals or surpasses contemporary leading-edge reconstruction techniques in quality. Furthermore, it achieves these complex reconstructions in minutes, a fraction of the time typically required by existing methods. Our models achieve a training speed that is 110X faster than that of State-of-The-Art (SoTA) NeRF-based models. Our technique performs noticeably better than SoTA dynamic human NeRF methods if given an identical runtime limit. HumanAvatar can provide effective visuals after only 30 seconds of training.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 49 of its 61 references that are in the map. First posted on arXiv 23 Oct 2024.

Builds on

49 of 61 references.

References · 49

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2023Segment Anythingcited by 8,158
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  6. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  7. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  8. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  9. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  10. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  11. 2022Human Motion Diffusion Modelcited by 1,062
  12. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
37 more
  1. 2020Neural Sparse Voxel Fieldscited by 959
  2. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  3. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  4. 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
  5. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  6. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  7. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  8. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  9. 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
  10. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
  11. 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
  12. 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
  13. 2018Video Based Reconstruction of 3D People Modelscited by 237
  14. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  15. 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
  16. 2020Monocular, One-stage, Regression of Multiple 3D Peoplecited by 216
  17. 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
  18. 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
  19. 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 179
  20. 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
  21. 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
  22. 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
  23. 2023Relightable Gaussian Codec Avatarscited by 126
  24. 2023Drivable 3D Gaussian Avatarscited by 120
  25. 2018Detailed Human Avatars from Monocular Videocited by 109
  26. 2021Animatable Neural Radiance Fields from Monocular RGB Videoscited by 109
  27. 2022Generative Neural Articulated Radiance Fieldscited by 101
  28. 2023MonoHuman: Animatable Human Neural Field from Monocular Videocited by 85
  29. 2021LOLNeRF: Learn from One Lookcited by 84
  30. 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
  31. 2019Textured Neural Avatarscited by 65
  32. 2017MonoPerfCap: Human Performance Capture from Monocular Videocited by 63
  33. 2023GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learningcited by 63
  34. 2022Fast-SNARF: A Fast Deformer for Articulated Neural Fieldscited by 55
  35. 2020Robust 3D Self-portraits in Secondscited by 30
  36. 2021Human Performance Capture from Monocular Video in the Wildcited by 26
  37. 2023Animatable 3D Gaussians for High-fidelity Synthesis of Human Motionscited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 1.

6 papers.