Efficient Neural Implicit Representation for 3D Human Reconstruction
Not on the map. Why?
Abstract (arXiv)
High-fidelity digital human representations are increasingly in demand in the digital world, particularly for interactive telepresence, AR/VR, 3D graphics, and the rapidly evolving metaverse. Even though they work well in small spaces, conventional methods for reconstructing 3D human motion frequently require the use of expensive hardware and have high processing costs. This study presents HumanAvatar, an innovative approach that efficiently reconstructs precise human avatars from monocular video sources. At the core of our methodology, we integrate the pre-trained HuMoR, a model celebrated for its proficiency in human motion estimation. This is adeptly fused with the cutting-edge neural radiance field technology, Instant-NGP, and the state-of-the-art articulated model, Fast-SNARF, to enhance the reconstruction fidelity and speed. By combining these two technologies, a system is created that can render quickly and effectively while also providing estimation of human pose parameters that are unmatched in accuracy. We have enhanced our system with an advanced posture-sensitive space reduction technique, which optimally balances rendering quality with computational efficiency. In our detailed experimental analysis using both artificial and real-world monocular videos, we establish the advanced performance of our approach. HumanAvatar consistently equals or surpasses contemporary leading-edge reconstruction techniques in quality. Furthermore, it achieves these complex reconstructions in minutes, a fraction of the time typically required by existing methods. Our models achieve a training speed that is 110X faster than that of State-of-The-Art (SoTA) NeRF-based models. Our technique performs noticeably better than SoTA dynamic human NeRF methods if given an identical runtime limit. HumanAvatar can provide effective visuals after only 30 seconds of training.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 49 of its 61 references that are in the map. First posted on arXiv 23 Oct 2024.
Builds on
49 of 61 references.
References · 49
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Segment Anythingcited by 8,158
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2022Human Motion Diffusion Modelcited by 1,062
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
37 more
- 2020Neural Sparse Voxel Fieldscited by 959
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
- 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
- 2018Video Based Reconstruction of 3D People Modelscited by 237
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2020Monocular, One-stage, Regression of Multiple 3D Peoplecited by 216
- 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 179
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
- 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
- 2023Relightable Gaussian Codec Avatarscited by 126
- 2023Drivable 3D Gaussian Avatarscited by 120
- 2018Detailed Human Avatars from Monocular Videocited by 109
- 2021Animatable Neural Radiance Fields from Monocular RGB Videoscited by 109
- 2022Generative Neural Articulated Radiance Fieldscited by 101
- 2023MonoHuman: Animatable Human Neural Field from Monocular Videocited by 85
- 2021LOLNeRF: Learn from One Lookcited by 84
- 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
- 2019Textured Neural Avatarscited by 65
- 2017MonoPerfCap: Human Performance Capture from Monocular Videocited by 63
- 2023GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learningcited by 63
- 2022Fast-SNARF: A Fast Deformer for Articulated Neural Fieldscited by 55
- 2020Robust 3D Self-portraits in Secondscited by 30
- 2021Human Performance Capture from Monocular Video in the Wildcited by 26
- 2023Animatable 3D Gaussians for High-fidelity Synthesis of Human Motionscited by 15
Built on by
Citing papers per year: 2025: 5; 2026: 1.
6 papers.
- 2025StructGS: Adaptive Spherical Harmonics and Rendering Enhancements for Superior 3D Gaussian Splattingcited by 5
- 2025DET-GS: Depth- and Edge-Aware Regularization for High-Fidelity 3D Gaussian Splattingcited by 2
- 2025Relightable and Dynamic Gaussian Avatar Reconstruction from Monocular Videocited by 2
- 2025GaussianFocus: Constrained Attention Focus for 3D Gaussian Splattingcited by 1
- 2025FMGS-Avatar: Mesh-Guided 2D Gaussian Splatting with Foundation Model Priors for 3D Monocular Avatar Reconstructioncited by 0
- 2026MuNet: A Mutualistic Network for Joint 3D Human Mesh Recovery and 3D Clothed Human Reconstruction from Single Imagescited by 0
- 2026MuNet: A Mutualistic Network for Joint 3D Human Mesh Recovery and 3D Clothed Human Reconstruction from Single Images25 May 2026
- 2025Relightable and Dynamic Gaussian Avatar Reconstruction from Monocular Video10 Dec 2025
- 2025FMGS-Avatar: Mesh-Guided 2D Gaussian Splatting with Foundation Model Priors for 3D Monocular Avatar Reconstruction18 Sep 2025
- 2025DET-GS: Depth- and Edge-Aware Regularization for High-Fidelity 3D Gaussian Splatting6 Aug 2025
- 2025GaussianFocus: Constrained Attention Focus for 3D Gaussian Splatting22 Mar 2025
- 2025StructGS: Adaptive Spherical Harmonics and Rendering Enhancements for Superior 3D Gaussian Splatting9 Mar 2025