PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitization
Not on the map. Why?
Cited by 37 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Recent advances in image-based 3D human shape estimation have been driven by the significant improvement in representation power afforded by deep neural networks. Although current approaches have demonstrated the potential in real world settings, they still fail to produce reconstructions with the level of detail often present in the input images. We argue that this limitation stems primarily form two conflicting requirements; accurate predictions require large context, but precise predictions require high resolution. Due to memory limitations in current hardware, previous approaches tend to take low resolution images as input to cover large spatial context, and produce less precise (or low resolution) 3D estimates as a result. We address this limitation by formulating a multi-level architecture that is end-to-end trainable. A coarse level observes the whole image at lower resolution and focuses on holistic reasoning. This provides context to an fine level which estimates highly detailed geometry by observing higher-resolution images. We demonstrate that our approach significantly outperforms existing state-of-the-art techniques on single image human shape reconstruction by fully leveraging 1k-resolution input images.
Key facts. Cited by 521 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 103; 2022: 108; 2023: 126; 2024: 86; 2025: 68; 2026: 30.
521 papers.
Sort:
By area:
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2021GAN Inversion: A Surveycited by 366
- 2021Advances in Neural Renderingcited by 365
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
38 more
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2021Editing Conditional Radiance Fieldscited by 222
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2021Neural Articulated Radiance Fieldcited by 196
- 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
- 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 190
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
- 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
- 2023HUGS: Human Gaussian Splatscited by 154
- 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
- 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
- 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 134
- 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
- 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
- 2023GART: Gaussian Articulated Template Modelscited by 121
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
- 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 115
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2021HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputscited by 112
- 2021Animatable Neural Radiance Fields from Monocular RGB Videoscited by 109
- 2023TADA! Text to Animatable Digital Avatarscited by 109
- 2021LEAP: Learning Articulated Occupancy of Peoplecited by 107
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2023DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Renderingcited by 103
50 most cited of 521 All 521 (JSON)
- 2026OmniFabric: Coherent UV Space Texture Synthesis for 3D Garment Reconstruction24 Sep 2026
- 2026GarmentWeaver: Schema-Aware Structured Synthesis for Multimodal Sewing Patterns31 Aug 2026
- 2026DiGS-Avatar: Single-Image Animatable 3D Human Reconstruction via UV-Space Diffusion21 Aug 2026
- 2026DSAR: Dual-Stream Autoregressive Modeling of Temporal Cloth Dynamics for Photorealistic Animatable Avatars11 Aug 2026
- 2026Forwardrobe: Garment-Aware Gaussian Avatars from a Single Image31 Jul 2026
- 2026Online Neural Space Time Memory for Dynamic Novel View Synthesis16 Jul 2026
- 2026LUNA: Learning Universal 3D Human Animation Beyond Skinning30 Jun 2026
- 2026RAGA: Real Time Ray Traced Gaussian Shadow Casting for 3DGS Avatar-Scene Interaction28 Jun 2026
- 2026CoGS: Compositional Dynamic Human-Object Scenes Gaussian Splatting from Monocular Video27 Jun 2026
- 2026PatternGSL: A Structured Specification Language for Template-Free and Simulation-Ready 3D Garments23 Jun 2026
- 2026PIAvatar: Physically Interactive Avatars via Deformation Gradient Decoupling19 Jun 2026
- 2026World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible11 Jun 2026
38 more
- 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimation5 May 2026
- 2026Visually-grounded Humanoid Agents9 Apr 2026
- 2026Human Interaction-Aware 3D Reconstruction from a Single Image7 Apr 2026
- 2026HOIGS: Human-Object Interaction Gaussian Splatting5 Apr 2026
- 2026GenFusion: Feed-forward Human Performance Capture via Progressive Canonical Space Updates30 Mar 2026
- 2026THFM: A Unified Video Foundation Model for 4D Human Perception and Beyond26 Mar 2026
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priors18 Mar 2026
- 2026CrowdGaussian: Reconstructing High-Fidelity 3D Gaussians for Human Crowd from a Single Image18 Mar 2026
- 2026Real-Time Human Frontal View Synthesis from a Single Image16 Mar 2026
- 2026OAHuman: Occlusion-Aware 3D Human Reconstruction from Monocular Images15 Mar 2026
- 2026Towards Motion Turing Test: Evaluating Human-Likeness in Humanoid Robots6 Mar 2026
- 2026Direct Reward Fine-Tuning on Poses for Single Image to 3D Human in the Wild3 Mar 2026
- 2026HumanOrbit: 3D Human Reconstruction as 360deg Orbit Generation27 Feb 2026
- 2026TeHOR: Text-Guided 3D Human and Object Reconstruction with Textures23 Feb 2026
- 2026From Frames to Sequences: Temporally Consistent Human-Centric Dense Prediction2 Feb 2026
- 2026ICo3D: An Interactive Conversational 3D Virtual Human19 Jan 2026
- 2026Animated 3DGS Avatars in Diverse Scenes with Consistent Lighting and Shadows4 Jan 2026
- 2026Joint Geometry-Appearance Human Reconstruction in a Unified Latent Space via Bridge Diffusion1 Jan 2026
- 2025Pro-Pose: Unpaired Full-Body Portrait Synthesis via Canonical UV Maps19 Dec 2025
- 2025Textured Geometry Evaluation: Perceptual 3D Textured Shape Metric via 3D Latent-Geometry Network1 Dec 2025
- 2025SRAM: Shape-Realism Alignment Metric for No Reference 3D Shape Evaluation1 Dec 2025
- 2025MHR: Momentum Human Rig19 Nov 2025
- 2025AHA! Animating Human Avatars in Diverse Scenes with Gaussian Splatting13 Nov 2025
- 2025SyncHuman: Synchronizing 2D and 3D Generative Models for Single-view Human Reconstruction9 Oct 2025
- 2025GLVD: Guided Learned Vertex Descent7 Oct 2025
- 2025HART: Human Aligned Reconstruction Transformer30 Sep 2025
- 2025UP2You: Fast Reconstruction of Yourself from Unconstrained Photo Collections29 Sep 2025
- 2025Dream3DAvatar: Text-Controlled 3D Avatar Reconstruction from a Single Image16 Sep 2025
- 2025On the Skinning of Gaussian Avatars14 Sep 2025
- 2025NGD: Neural Gradient Based Deformation for Monocular Garment Reconstruction25 Aug 2025
- 2025ATLAS: Decoupling Skeletal and Shape Parameters for Expressive Parametric Human Modeling21 Aug 2025
- 2025MExECON: Multi-view Extended Explicit Clothed humans Optimized via Normal integration21 Aug 2025
- 2025Snap-Snap: Taking Two Images to Reconstruct 3D Human Gaussians in Milliseconds20 Aug 2025
- 2025PERSONA: Personalized Whole-Body 3D Avatar with Pose-Driven Deformations from a Single Image13 Aug 2025
- 2025MonoPartNeRF:Human Reconstruction from Monocular Video via Part-Based Neural Radiance Fields12 Aug 2025
- 2025ReMu: Reconstructing Multi-layer 3D Clothed Human from Image Layers2 Aug 2025
- 2025MoGA: 3D Generative Avatar Prior for Monocular Gaussian Avatar Reconstruction31 Jul 2025
- 2025Learning Efficient and Generalizable Human Representation with Human Gaussian Model24 Jul 2025
50 newest of 521 All 521 (JSON)
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2023SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusioncited by 72
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44
- 2023Single-Image 3D Human Digitization with Shape-Guided Diffusioncited by 42
- 2023AvatarBooth: High-Quality and Customizable 3D Human Avatar Generationcited by 37
- 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generationcited by 37
- 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatarscited by 28
- 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Modelcited by 23
- 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusioncited by 23
- 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creationcited by 23
- 2024Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRMcited by 23
- 2023Chupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Modelscited by 20
12 most cited of 37 All 37 (JSON)
- 2026World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible11 Jun 2026
- 2026THFM: A Unified Video Foundation Model for 4D Human Perception and Beyond26 Mar 2026
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priors18 Mar 2026
- 2026Direct Reward Fine-Tuning on Poses for Single Image to 3D Human in the Wild3 Mar 2026
- 2026HumanOrbit: 3D Human Reconstruction as 360deg Orbit Generation27 Feb 2026
- 2025MoGA: 3D Generative Avatar Prior for Monocular Gaussian Avatar Reconstruction31 Jul 2025
- 2025Dream, Lift, Animate: From Single Images to Animatable Gaussian Avatars21 Jul 2025
- 2025AvatarMakeup: Realistic Makeup Transfer for 3D Animatable Head Avatars3 Jul 2025
- 2025GeoMan: Temporally Consistent Human Geometry Estimation using Image-to-Video Diffusion29 May 2025
- 2025Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data27 Mar 2025
- 2025DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Image25 Mar 2025
- 2025GaussianIP: Identity-Preserving Realistic 3D Human Generation via Human-Centric Diffusion Prior14 Mar 2025
12 newest of 37 All 37 (JSON)
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2021GAN Inversion: A Surveycited by 366
- 2021Advances in Neural Renderingcited by 365
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
12 most cited of 483 All 483 (JSON)
- 2026OmniFabric: Coherent UV Space Texture Synthesis for 3D Garment Reconstruction24 Sep 2026
- 2026GarmentWeaver: Schema-Aware Structured Synthesis for Multimodal Sewing Patterns31 Aug 2026
- 2026DiGS-Avatar: Single-Image Animatable 3D Human Reconstruction via UV-Space Diffusion21 Aug 2026
- 2026DSAR: Dual-Stream Autoregressive Modeling of Temporal Cloth Dynamics for Photorealistic Animatable Avatars11 Aug 2026
- 2026Forwardrobe: Garment-Aware Gaussian Avatars from a Single Image31 Jul 2026
- 2026Online Neural Space Time Memory for Dynamic Novel View Synthesis16 Jul 2026
- 2026LUNA: Learning Universal 3D Human Animation Beyond Skinning30 Jun 2026
- 2026RAGA: Real Time Ray Traced Gaussian Shadow Casting for 3DGS Avatar-Scene Interaction28 Jun 2026
- 2026CoGS: Compositional Dynamic Human-Object Scenes Gaussian Splatting from Monocular Video27 Jun 2026
- 2026PatternGSL: A Structured Specification Language for Template-Free and Simulation-Ready 3D Garments23 Jun 2026
- 2026PIAvatar: Physically Interactive Avatars via Deformation Gradient Decoupling19 Jun 2026
- 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimation5 May 2026
12 newest of 483 All 483 (JSON)