FFAvatar: Few-Shot, Feed-Forward, and Generalizable Avatar Reconstruction
Not on the map. Why?
Abstract (arXiv)
Avatar reconstruction has traditionally relied on per-subject optimization that requires hours of computation or on expensive preprocessing that limits scalability. We introduce FFAvatar, a generalizable feed-forward framework that reconstructs high-quality, animatable 3D Gaussian head avatars from few-shot unposed portrait images in seconds. FFAvatar fuses information from multiple source images into a unified canonical Gaussian representation through Multi-View Query-Former, which is animated via FLAME parameters predicted end-to-end directly from pixels, eliminating the overhead of offline FLAME extraction. We further propose a three-stage training curriculum that achieves both broad generalization and high-fidelity reconstruction: (i) scalable pretraining on extensive monocular video data with over 1M identities to learn strong generalizable priors; (ii) multi-view fine-tuning on a small but high-quality dataset of 360-degree captures to enhance geometric fidelity and extreme-view awareness; and (iii) optional personalization that adapts to specific identities for maximum fidelity within 500 optimization steps. Extensive experiments demonstrate that FFAvatar sets a new standard for identity preservation, geometric consistency, and animation fidelity. On the NeRSemble benchmark, it outperforms the state-of-the-art LAM by a substantial 5.5 PSNR gain. Furthermore, FFAvatar enables real-time deployment, reconstructing avatars in 2 seconds without personalization and 10 seconds with personalization, while supporting 49 FPS animation on a single NVIDIA A100 GPU.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 26 of its 33 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
26 of 33 references.
References · 26
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
- 2020Differentiable Augmentation for Data-Efficient GAN Trainingcited by 363
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
14 more
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2021Projected GANs Converge Fastercited by 208
- 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 172
- 2022Instant Volumetric Head Avatarscited by 159
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 97
- 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 53
- 2025LAM: Large Avatar Model for One-shot Animatable Gaussian Headcited by 43
- 2024Omni-ID: Holistic Identity Representation Designed for Generative Taskscited by 18
- 2025ComposeMe: Attribute-Specific Image Prompts for Controllable Human Image Generationcited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.