PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization
Not on the map. Why?
Cited by 55 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We introduce Pixel-aligned Implicit Function (PIFu), a highly effective implicit representation that locally aligns pixels of 2D images with the global context of their corresponding 3D object. Using PIFu, we propose an end-to-end deep learning method for digitizing highly detailed clothed humans that can infer both 3D surface and texture from a single image, and optionally, multiple input images. Highly intricate shapes, such as hairstyles, clothing, as well as their variations and deformations can be digitized in a unified way. Compared to existing representations used for 3D deep learning, PIFu can produce high-resolution surfaces including largely unseen regions such as the back of a person. In particular, it is memory efficient unlike the voxel representation, can handle arbitrary topology, and the resulting surface is spatially aligned with the input image. Furthermore, while previous techniques are designed to process either a single image or multiple views, PIFu extends naturally to arbitrary number of views. We demonstrate high-resolution and robust reconstructions on real world images from the DeepFashion dataset, which contains a variety of challenging clothing types. Our method achieves state-of-the-art performance on a public benchmark and outperforms the prior work for clothed human digitization from a single image.
Key facts. Cited by 818 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 180; 2022: 192; 2023: 197; 2024: 132; 2025: 73; 2026: 44.
818 papers.
Sort:
By area:
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2021Neural Fields in Visual Computing and Beyondcited by 539
38 more
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2021Implicit Behavioral Cloningcited by 442
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2021Advances in Neural Renderingcited by 365
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 273
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
- 2023Implicit Diffusion Models for Continuous Super-Resolutioncited by 216
- 2021Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulationcited by 204
- 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 203
- 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2021Neural Articulated Radiance Fieldcited by 196
- 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
- 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
- 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 190
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
50 most cited of 818 All 818 (JSON)
- 2026Generalist Open-World Temporal Perception6 Sep 2026
- 2026GarmentWeaver: Schema-Aware Structured Synthesis for Multimodal Sewing Patterns31 Aug 2026
- 2026DiGS-Avatar: Single-Image Animatable 3D Human Reconstruction via UV-Space Diffusion21 Aug 2026
- 2026AvatarDynamizer: From Static to Dynamic Human Avatars via Generative Dynamic Textures20 Aug 2026
- 2026TGRHuman: Text-Guided Realistic 3D Human Generation via Diffusion Renderer12 Aug 2026
- 2026DSAR: Dual-Stream Autoregressive Modeling of Temporal Cloth Dynamics for Photorealistic Animatable Avatars11 Aug 2026
- 2026OmniMech: All-in-one Multimodal Mechanical Benchmark for 3D Reconstruction6 Aug 2026
- 2026Online Neural Space Time Memory for Dynamic Novel View Synthesis16 Jul 2026
- 2026LUNA: Learning Universal 3D Human Animation Beyond Skinning30 Jun 2026
- 2026CoGS: Compositional Dynamic Human-Object Scenes Gaussian Splatting from Monocular Video27 Jun 2026
- 2026PatternGSL: A Structured Specification Language for Template-Free and Simulation-Ready 3D Garments23 Jun 2026
- 2026MotionMAR: Multi-scale Auto-Regressive Human Motion Reconstruction from Sparse Observations22 Jun 2026
38 more
- 2026PIAvatar: Physically Interactive Avatars via Deformation Gradient Decoupling19 Jun 2026
- 2026World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible11 Jun 2026
- 2026MuNet: A Mutualistic Network for Joint 3D Human Mesh Recovery and 3D Clothed Human Reconstruction from Single Images25 May 2026
- 2026H-Flow: Self-supervised Human Scene Flow via Physics-inspired Joint Multi-modal Learning21 May 2026
- 2026DAMA: Disentangled Body-Anchored Gaussians for Controllable Multi-Layered Avatars20 May 2026
- 2026SGSoft: Learning Fused Semantic-Geometric Features for 3D Shape Correspondence via Template-Guided Soft Signals18 May 2026
- 2026LagrangianSplats: Divergence-Free Transport of Gaussian Primitives for Fluid Reconstruction10 May 2026
- 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimation5 May 2026
- 2026Real-Time Human Reconstruction and Animation using Feed-Forward Gaussian Splatting11 Apr 2026
- 2026Visually-grounded Humanoid Agents9 Apr 2026
- 2026Human Interaction-Aware 3D Reconstruction from a Single Image7 Apr 2026
- 2026HOIGS: Human-Object Interaction Gaussian Splatting5 Apr 2026
- 2026GenFusion: Feed-forward Human Performance Capture via Progressive Canonical Space Updates30 Mar 2026
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priors18 Mar 2026
- 2026CrowdGaussian: Reconstructing High-Fidelity 3D Gaussians for Human Crowd from a Single Image18 Mar 2026
- 2026Volumetrically Consistent Implicit Atlas Learning via Neural Diffeomorphic Flow for Placenta MRI17 Mar 2026
- 2026Real-Time Human Frontal View Synthesis from a Single Image16 Mar 2026
- 2026OAHuman: Occlusion-Aware 3D Human Reconstruction from Monocular Images15 Mar 2026
- 2026EI-Part: Explode for Completion and Implode for Refinement14 Mar 2026
- 2026Towards Motion Turing Test: Evaluating Human-Likeness in Humanoid Robots6 Mar 2026
- 2026MultiGO++: Monocular 3D Clothed Human Reconstruction via Geometry-Texture Collaboration5 Mar 2026
- 2026Gaussian Wardrobe: Compositional 3D Gaussian Avatars for Free-Form Virtual Try-On4 Mar 2026
- 2026Direct Reward Fine-Tuning on Poses for Single Image to 3D Human in the Wild3 Mar 2026
- 2026HumanOrbit: 3D Human Reconstruction as 360deg Orbit Generation27 Feb 2026
- 2026Electrostatics-Inspired Surface Reconstruction (EISR): Recovering 3D Shapes as a Superposition of Poisson's PDE Solutions12 Feb 2026
- 2026PoseGaussian: Pose-Driven Novel View Synthesis for Robust 3D Human Reconstruction5 Feb 2026
- 2026PEAR: Pixel-aligned Expressive humAn mesh Recovery30 Jan 2026
- 2026TempDiffReg: Temporal Diffusion Model for Non-Rigid 2D-3D Vascular Registration26 Jan 2026
- 2026Image2Garment: Simulation-ready Garment Generation from a Single Image14 Jan 2026
- 2026LayerGS: Decomposition and Inpainting of Layered 3D Human Avatars via 2D Gaussian Splatting9 Jan 2026
- 2026InfiniDepth: Arbitrary-Resolution and Fine-Grained Depth Estimation with Neural Implicit Fields6 Jan 2026
- 2026Joint Geometry-Appearance Human Reconstruction in a Unified Latent Space via Bridge Diffusion1 Jan 2026
- 2025Pro-Pose: Unpaired Full-Body Portrait Synthesis via Canonical UV Maps19 Dec 2025
- 2025Frequency-Decomposed Avatar Representation for Varying Camera Distances3 Dec 2025
- 2025SRAM: Shape-Realism Alignment Metric for No Reference 3D Shape Evaluation1 Dec 2025
- 2025Bringing Your Portrait to 3D Presence27 Nov 2025
- 2025MobileOcc: A Human-Aware Semantic Occupancy Dataset for Mobile Robots21 Nov 2025
- 2025PFAvatar: Pose-Fusion 3D Personalized Avatar Reconstruction from Real-World Outfit-of-the-Day Photos17 Nov 2025
50 newest of 818 All 818 (JSON)
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 273
- 2023Implicit Diffusion Models for Continuous Super-Resolutioncited by 216
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
- 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2023SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusioncited by 72
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44
- 2023AvatarBooth: High-Quality and Customizable 3D Human Avatar Generationcited by 37
- 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generationcited by 37
- 2023PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generationcited by 33
12 most cited of 55 All 55 (JSON)
- 2026World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible11 Jun 2026
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priors18 Mar 2026
- 2026Direct Reward Fine-Tuning on Poses for Single Image to 3D Human in the Wild3 Mar 2026
- 2026HumanOrbit: 3D Human Reconstruction as 360deg Orbit Generation27 Feb 2026
- 2026TempDiffReg: Temporal Diffusion Model for Non-Rigid 2D-3D Vascular Registration26 Jan 2026
- 2025Stable Diffusion-Based Approach for Human De-Occlusion18 Aug 2025
- 2025MoGA: 3D Generative Avatar Prior for Monocular Gaussian Avatar Reconstruction31 Jul 2025
- 2025Dream, Lift, Animate: From Single Images to Animatable Gaussian Avatars21 Jul 2025
- 2025EgoAnimate: Generating Human Animations from Egocentric top-down Views12 Jul 2025
- 2025AvatarMakeup: Realistic Makeup Transfer for 3D Animatable Head Avatars3 Jul 2025
- 2025GeoMan: Temporally Consistent Human Geometry Estimation using Image-to-Video Diffusion29 May 2025
- 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation8 May 2025
12 newest of 55 All 55 (JSON)
- 2021NEAT: Neural Attention Fields for End-to-End Autonomous Drivingcited by 174
- 20233D Concept Learning and Reasoning from Multi-View Imagescited by 60
- 20233D Concept Learning and Reasoning from Multi-View Images20 Mar 2023
- 2021Implicit Behavioral Cloningcited by 442
- 2021Implicit Behavioral Cloning1 Sep 2021
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
12 most cited of 755 All 755 (JSON)
- 2026Generalist Open-World Temporal Perception6 Sep 2026
- 2026GarmentWeaver: Schema-Aware Structured Synthesis for Multimodal Sewing Patterns31 Aug 2026
- 2026DiGS-Avatar: Single-Image Animatable 3D Human Reconstruction via UV-Space Diffusion21 Aug 2026
- 2026AvatarDynamizer: From Static to Dynamic Human Avatars via Generative Dynamic Textures20 Aug 2026
- 2026TGRHuman: Text-Guided Realistic 3D Human Generation via Diffusion Renderer12 Aug 2026
- 2026DSAR: Dual-Stream Autoregressive Modeling of Temporal Cloth Dynamics for Photorealistic Animatable Avatars11 Aug 2026
- 2026Online Neural Space Time Memory for Dynamic Novel View Synthesis16 Jul 2026
- 2026LUNA: Learning Universal 3D Human Animation Beyond Skinning30 Jun 2026
- 2026CoGS: Compositional Dynamic Human-Object Scenes Gaussian Splatting from Monocular Video27 Jun 2026
- 2026PatternGSL: A Structured Specification Language for Template-Free and Simulation-Ready 3D Garments23 Jun 2026
- 2026MotionMAR: Multi-scale Auto-Regressive Human Motion Reconstruction from Sparse Observations22 Jun 2026
- 2026PIAvatar: Physically Interactive Avatars via Deformation Gradient Decoupling19 Jun 2026
12 newest of 755 All 755 (JSON)