Bringing Your Portrait to 3D Presence
Not on the map. Why?
Abstract (arXiv)
We present a unified framework for reconstructing animatable 3D human avatars from a single portrait across head, half-body, and full-body inputs. Our method tackles three bottlenecks: pose- and framing-sensitive feature representations, limited scalable data, and unreliable proxy-mesh estimation. We introduce a Dual-UV representation that maps image features to a canonical UV space via Core-UV and Shell-UV branches, eliminating pose- and framing-induced token shifts. We also build a factorized synthetic data manifold combining 2D generative diversity with geometry-consistent 3D renderings, supported by a training scheme that improves realism and identity consistency. A robust proxy-mesh tracker maintains stability under partial visibility. Together, these components enable strong in-the-wild generalization. Trained only on half-body synthetic data, our model achieves state-of-the-art head and upper-body reconstruction and competitive full-body results. Extensive experiments and analyses further validate the effectiveness of our approach.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 96 of its 121 references that are in the map. First posted on arXiv 27 Nov 2025.
Builds on
96 of 121 references.
References · 96
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
38 more
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
- 2023Reconstructing Hands in 3D with Transformerscited by 298
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2017A General and Adaptive Robust Loss Functioncited by 236
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
- 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 183
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 174
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
- 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 128
- 2023Relightable Gaussian Codec Avatarscited by 126
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 115
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 107
- 2023DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Renderingcited by 103
- 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
- 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 98
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 95
- 2023PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360circcited by 93
- 2024Expressive Whole-Body 3D Gaussian Avatarcited by 89
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
- 2024OpenHumanVid: A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generationcited by 77
- 2023High-fidelity 3D Human Digitization from Single 2K Resolution Imagescited by 70
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
- 2023Gaussian Shell Maps for Efficient 3D Human Generationcited by 61
50 most cited of 96 All 96 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.