MonoPartNeRF:Human Reconstruction from Monocular Video via Part-Based Neural Radiance Fields
Not on the map. Why?
Abstract (arXiv)
In recent years, Neural Radiance Fields (NeRF) have achieved remarkable progress in dynamic human reconstruction and rendering. Part-based rendering paradigms, guided by human segmentation, allow for flexible parameter allocation based on structural complexity, thereby enhancing representational efficiency. However, existing methods still struggle with complex pose variations, often producing unnatural transitions at part boundaries and failing to reconstruct occluded regions accurately in monocular settings. We propose MonoPartNeRF, a novel framework for monocular dynamic human rendering that ensures smooth transitions and robust occlusion recovery. First, we build a bidirectional deformation model that combines rigid and non-rigid transformations to establish a continuous, reversible mapping between observation and canonical spaces. Sampling points are projected into a parameterized surface-time space (u, v, t) to better capture non-rigid motion. A consistency loss further suppresses deformation-induced artifacts and discontinuities. We introduce a part-based pose embedding mechanism that decomposes global pose vectors into local joint embeddings based on body regions. This is combined with keyframe pose retrieval and interpolation, along three orthogonal directions, to guide pose-aware feature sampling. A learnable appearance code is integrated via attention to model dynamic texture changes effectively. Experiments on the ZJU-MoCap and MonoCap datasets demonstrate that our method significantly outperforms prior approaches under complex pose and occlusion conditions, achieving superior joint alignment, texture fidelity, and structural continuity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 50 references that are in the map. First posted on arXiv 12 Aug 2025.
Builds on
37 of 50 references.
References · 37
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
25 more
- 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 415
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 196
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 180
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2020DeepCap: Monocular Human Performance Capture Using Weak Supervisioncited by 162
- 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
- 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
- 2019NASA: Neural Articulated Shape Approximationcited by 149
- 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
- 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
- 2021Real-time Deep Dynamic Characterscited by 133
- 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
- 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
- 2023MonoHuman: Animatable Human Neural Field from Monocular Videocited by 85
- 2023Learning Neural Volumetric Representations of Dynamic Humans in Minutescited by 70
- 2022Drivable Volumetric Avatars using Texel-Aligned Featurescited by 62
- 2022COAP: Compositional Articulated Occupancy of Peoplecited by 59
- 2023PoseVocab: Learning Joint-structured Pose Embeddings for Human Avatar Modelingcited by 50
- 2021HVTR: Hybrid Volumetric-Textural Rendering for Human Avatarscited by 33
- 2022Animatable Implicit Neural Representations for Creating Realistic Avatars from Videoscited by 33
Built on by
Not cited yet.