PixelHuman: Animatable Neural Radiance Fields from Few Images
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose PixelHuman, a novel human rendering model that generates animatable human scenes from a few images of a person with unseen identity, views, and poses. Previous work have demonstrated reasonable performance in novel view and pose synthesis, but they rely on a large number of images to train and are trained per scene from videos, which requires significant amount of time to produce animatable scenes from unseen human images. Our method differs from existing methods in that it can generalize to any input image for animatable human synthesis. Given a random pose sequence, our method synthesizes each target scene using a neural radiance field that is conditioned on a canonical representation and pose-aware pixel-aligned features, both of which can be obtained through deformation fields learned in a data-driven manner. Our experiments show that our method achieves state-of-the-art performance in multiview and novel pose synthesis from few-shot images.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 37 references that are in the map. First posted on arXiv 18 Jul 2023.
Builds on
31 of 37 references.
References · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
19 more
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
- 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
- 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
- 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
- 2020Geo-PIFu: Geometry and Pixel Aligned Implicit Functions for Single-view Human Reconstructioncited by 112
- 2017Towards Accurate Markerless Human Shape and Pose Estimation over Timecited by 92
- 2022KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypointscited by 77
- 2021DeepMultiCap: Performance Capture of Multiple Characters Using Sparse Multiview Camerascited by 67
- 2022One-shot Implicit Animatable Avatars with Model-based Priorscited by 38
- 2020Vid2Actor: Free-viewpoint Animatable Person Synthesis from Video in the Wildcited by 35
- 2022ReFu: Refine and Fuse the Unobserved View for Detail-Preserving Single-Image 3D Human Reconstructioncited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.