mlsanityData to 7 Oct 2026

Surface-Aligned Neural Radiance Fields for Controllable 3D Human Synthesis

arXiv 2201.01683 ↗First posted 5 Jan 2022cs.CVcited by 41

Not on the map. Why?

Abstract (arXiv)

We propose a new method for reconstructing controllable implicit 3D human models from sparse multi-view RGB videos. Our method defines the neural scene representation on the mesh surface points and signed distances from the surface of a human body mesh. We identify an indistinguishability issue that arises when a point in 3D space is mapped to its nearest surface point on a mesh for learning surface-aligned neural scene representation. To address this issue, we propose projecting a point onto a mesh surface using a barycentric interpolation with modified vertex normals. Experiments with the ZJU-MoCap and Human3.6M datasets show that our approach achieves a higher quality in a novel-view and novel-pose synthesis than existing methods. We also demonstrate that our method easily supports the control of body shape and clothes. Project page: https://pfnet-research.github.io/surface-aligned-nerf/.

Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). Builds on 32 of its 51 references that are in the map. First posted on arXiv 5 Jan 2022.

Builds on

32 of 51 references.

References · 32

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  4. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  5. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  6. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  7. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  8. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  9. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  10. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  11. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
  12. 2017Neural 3D Mesh Renderercited by 437
20 more
  1. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  2. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  3. 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
  4. 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
  5. 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
  6. 2018Video Based Reconstruction of 3D People Modelscited by 237
  7. 2019Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderercited by 221
  8. 2021Neural Articulated Radiance Fieldcited by 196
  9. 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
  10. 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
  11. 2019NASA: Neural Articulated Shape Approximationcited by 149
  12. 2018Instance-level Human Parsing via Part Grouping Networkcited by 134
  13. 2020Combining Implicit Function Learning and Parametric Models for 3D Human Reconstructioncited by 133
  14. 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 115
  15. 2018SiCloPe: Silhouette-Based Clothed Peoplecited by 68
  16. 2021Unsupervised Learning of 3D Object Categories from Videos in the Wildcited by 67
  17. 2021S3: Neural Shape, Skeleton, and Skinning Fields for 3D Human Modelingcited by 59
  18. 2020Online Adaptation for Consistent Mesh Reconstruction in the Wildcited by 51
  19. 2018Learning View Priors for Single-view 3D Reconstructioncited by 35
  20. 2017Learning 3D Object Categories by Looking Around Themcited by 26

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 12; 2023: 14; 2024: 9; 2025: 5; 2026: 1.

41 papers.

Sort:

  1. 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
  2. 2022Instant Volumetric Head Avatarscited by 157
  3. 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
  4. 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
  5. 2022Generative Neural Articulated Radiance Fieldscited by 101
  6. 2022Deforming Radiance Fields with Cagescited by 78
  7. 2022Unsupervised Learning of Efficient Geometry-Aware Neural Articulated Representationscited by 65
  8. 20243D Gaussian Blendshapes for Head Avatar Animationcited by 58
  9. 2023Deformable 3D Gaussian Splatting for Animatable Human Avatarscited by 44
  10. 2022Hand Avatar: Free-Pose Hand Animation and Rendering from Monocular Videocited by 37
  11. 2023SplatArmor: Articulated Gaussian splatting for animatable humans from monocular RGB videoscited by 35
  12. 2025Vid2Avatar-Pro: Authentic Avatar from Videos in the Wild via Universal Priorcited by 31
29 more
  1. 2022Neural Novel Actor: Learning a Generalized Animatable Neural Representation for Human Actorscited by 28
  2. 2023Template-free Articulated Neural Point Clouds for Reposable View Synthesiscited by 15
  3. 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generationcited by 13
  4. 2024Template-free Articulated Gaussian Splatting for Real-time Reposable Dynamic View Synthesiscited by 13
  5. 2023UniHuman: A Unified Model for Editing Human Images in the Wildcited by 12
  6. 2025RoGSplat: Learning Robust Generalizable Human Gaussian Splatting from Sparse Multi-View Imagescited by 12
  7. 2023Drone-NeRF: Efficient NeRF Based 3D Scene Reconstruction for Large-Scale Drone Surveycited by 11
  8. 2022SelfNeRF: Fast Training NeRF for Human from Monocular Self-rotating Videocited by 9
  9. 2025HumanRAM: Feed-forward Human Reconstruction and Animation Model using Transformerscited by 9
  10. 2022HDhuman: High-quality Human Novel-view Rendering from Sparse Viewscited by 8
  11. 2023VeRi3D: Generative Vertex-based Radiance Fields for 3D Controllable Human Image Synthesiscited by 8
  12. 2023IntrinsicNGP: Intrinsic Coordinate based Hash Encoding for Human NeRFcited by 7
  13. 2022Collecting The Puzzle Pieces: Disentangled Self-Driven Human Pose Transfer by Permuting Texturescited by 6
  14. 2023Explicifying Neural Implicit Fields for Efficient Dynamic Human Avatar Modeling via a Neural Explicit Surfacecited by 6
  15. 2022Neural Rendering of Humans in Novel View and Pose from Monocular Videocited by 4
  16. 2023Animatable Virtual Humans: Learning pose-dependent human representations in UV space for interactive performance synthesiscited by 3
  17. 2024NECA: Neural Customizable Human Avatarcited by 3
  18. 2024Gaussian Control with Hierarchical Semantic Graphs in 3D Human Recoverycited by 3
  19. 2025Parametric Gaussian Human Model: Generalizable Prior for Efficient and Realistic Human Avatar Modelingcited by 3
  20. 2022FLNeRF: 3D Facial Landmarks Estimation in Neural Radiance Fieldscited by 2
  21. 2023Efficient Meshy Neural Fields for Animatable Human Avatarscited by 2
  22. 2023HiFiHR: Enhancing 3D Hand Reconstruction from a Single Image via High-Fidelity Texturecited by 2
  23. 2023Animating NeRFs from Texture Space: A Framework for Pose-Dependent Rendering of Human Performancescited by 2
  24. 2024Garment Animation NeRF with Color Editingcited by 0
  25. 2024A transition towards virtual representations of visual scenescited by 0
  26. 2024InstantGeoAvatar: Effective Geometry and Appearance Modeling of Animatable Avatars from Monocular Videocited by 0
  27. 2024ProGraph: Temporally-alignable Probability Guided Graph Topological Modeling for 3D Human Reconstructioncited by 0
  28. 2025Fast and Physically-based Neural Explicit Surface for Relightable Human Avatarscited by 0
  29. 2026LUNA: Learning Universal 3D Human Animation Beyond Skinningcited by 0