mlsanityData to 7 Oct 2026

UVA: Towards Unified Volumetric Avatar for View Synthesis, Pose rendering, Geometry and Texture Editing

arXiv 2304.06969 ↗First posted 14 Apr 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural radiance field (NeRF) has become a popular 3D representation method for human avatar reconstruction due to its high-quality rendering capabilities, e.g., regarding novel views and poses. However, previous methods for editing the geometry and appearance of the avatar only allow for global editing through body shape parameters and 2D texture maps. In this paper, we propose a new approach named Unified Volumetric Avatar (UVA) that enables local and independent editing of both geometry and texture, while retaining the ability to render novel views and poses. UVA transforms each observation point to a canonical space using a skinning motion field and represents geometry and texture in separate neural fields. Each field is composed of a set of structured latent codes that are attached to anchor nodes on a deformable mesh in canonical space and diffused into the entire space via interpolation, allowing for local editing. To address spatial ambiguity in code interpolation, we use a local signed height indicator. We also replace the view-dependent radiance color with a pose-dependent shading factor to better represent surface illumination in different poses. Experiments on multiple human avatars demonstrate that our UVA achieves competitive results in novel view synthesis and novel pose rendering while enabling local and independent editing of geometry and appearance. The source code will be released.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 46 of its 62 references that are in the map. First posted on arXiv 14 Apr 2023.

Builds on

46 of 62 references.

References · 46

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  4. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  5. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  6. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  7. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  8. 2020Neural Sparse Voxel Fieldscited by 959
  9. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
  10. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  11. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  12. 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 396
34 more
  1. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  2. 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
  3. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  4. 2021Editing Conditional Radiance Fieldscited by 222
  5. 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
  6. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
  7. 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
  8. 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
  9. 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
  10. 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
  11. 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 141
  12. 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
  13. 2021Layered Neural Atlases for Consistent Video Editingcited by 137
  14. 2019Neural Rerendering in the Wildcited by 121
  15. 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
  16. 2021NeuTex: Neural Texture Mapping for Volumetric Neural Renderingcited by 98
  17. 2022Neural 3D Reconstruction in the Wildcited by 79
  18. 2022Deforming Radiance Fields with Cagescited by 78
  19. 2019Textured Neural Avatarscited by 65
  20. 2021StylePeople: A Generative Model of Fullbody Human Avatarscited by 62
  21. 2022Drivable Volumetric Avatars using Texel-Aligned Featurescited by 62
  22. 2022Control-NeRF: Editable Feature Volumes for Scene Rendering and Manipulationcited by 57
  23. 2020ANR: Articulated Neural Rendering for Virtual Avatarscited by 55
  24. 2022Fast-SNARF: A Fast Deformer for Articulated Neural Fieldscited by 55
  25. 2022NeuPhysics: Editable Neural Geometry and Physics from Monocular Videoscited by 50
  26. 2021Geometry-Guided Progressive NeRF for Generalizable and Efficient Neural Human Renderingcited by 46
  27. 2022PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video Sequencecited by 46
  28. 2022UV Volumes for Real-time Rendering of Editable Free-view Human Performancecited by 43
  29. 2022EditableNeRF: Editing Topologically Varying Neural Radiance Fields by Key Pointscited by 30
  30. 2020TexMesh: Reconstructing Detailed Human Texture and Geometry from RGB-D Videocited by 27
  31. 2022Neural Parameterization for Dynamic Human Head Editingcited by 16
  32. 2022NDF: Neural Deformable Fields for Dynamic Human Modellingcited by 14
  33. 2022NeuVV: Neural Volumetric Videos with Immersive Rendering and Editingcited by 12
  34. 2022SelfNeRF: Fast Training NeRF for Human from Monocular Self-rotating Videocited by 9

Built on by

Not cited yet.