mlsanityData to 14 Oct 2026

MonoPartNeRF:Human Reconstruction from Monocular Video via Part-Based Neural Radiance Fields

arXiv 2508.08798 ↗First posted 12 Aug 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

In recent years, Neural Radiance Fields (NeRF) have achieved remarkable progress in dynamic human reconstruction and rendering. Part-based rendering paradigms, guided by human segmentation, allow for flexible parameter allocation based on structural complexity, thereby enhancing representational efficiency. However, existing methods still struggle with complex pose variations, often producing unnatural transitions at part boundaries and failing to reconstruct occluded regions accurately in monocular settings. We propose MonoPartNeRF, a novel framework for monocular dynamic human rendering that ensures smooth transitions and robust occlusion recovery. First, we build a bidirectional deformation model that combines rigid and non-rigid transformations to establish a continuous, reversible mapping between observation and canonical spaces. Sampling points are projected into a parameterized surface-time space (u, v, t) to better capture non-rigid motion. A consistency loss further suppresses deformation-induced artifacts and discontinuities. We introduce a part-based pose embedding mechanism that decomposes global pose vectors into local joint embeddings based on body regions. This is combined with keyframe pose retrieval and interpolation, along three orthogonal directions, to guide pose-aware feature sampling. A learnable appearance code is integrated via attention to model dynamic texture changes effectively. Experiments on the ZJU-MoCap and MonoCap datasets demonstrate that our method significantly outperforms prior approaches under complex pose and occlusion conditions, achieving superior joint alignment, texture fidelity, and structural continuity.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 50 references that are in the map. First posted on arXiv 12 Aug 2025.

Builds on

37 of 50 references.

References · 37

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  3. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  4. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  5. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  6. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  7. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  8. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
  9. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
  10. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  11. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  12. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
25 more
  1. 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 415
  2. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  3. 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
  4. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  5. 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
  6. 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 196
  7. 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
  8. 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 180
  9. 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
  10. 2020DeepCap: Monocular Human Performance Capture Using Weak Supervisioncited by 162
  11. 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
  12. 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
  13. 2019NASA: Neural Articulated Shape Approximationcited by 149
  14. 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
  15. 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
  16. 2021Real-time Deep Dynamic Characterscited by 133
  17. 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
  18. 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
  19. 2023MonoHuman: Animatable Human Neural Field from Monocular Videocited by 85
  20. 2023Learning Neural Volumetric Representations of Dynamic Humans in Minutescited by 70
  21. 2022Drivable Volumetric Avatars using Texel-Aligned Featurescited by 62
  22. 2022COAP: Compositional Articulated Occupancy of Peoplecited by 59
  23. 2023PoseVocab: Learning Joint-structured Pose Embeddings for Human Avatar Modelingcited by 50
  24. 2021HVTR: Hybrid Volumetric-Textural Rendering for Human Avatarscited by 33
  25. 2022Animatable Implicit Neural Representations for Creating Realistic Avatars from Videoscited by 33

Built on by

Not cited yet.