ELITE: Efficient Gaussian Head Avatar from a Monocular Video via Learned Initialization and TEst-time Generative Adaptation
Not on the map. Why?
Abstract (arXiv)
We introduce ELITE, an Efficient Gaussian head avatar synthesis from a monocular video via Learned Initialization and TEst-time generative adaptation. Prior works rely either on a 3D data prior or a 2D generative prior to compensate for missing visual cues in monocular videos. However, 3D data prior methods often struggle to generalize in-the-wild, while 2D generative prior methods are computationally heavy and prone to identity hallucination. We identify a complementary synergy between these two priors and design an efficient system that achieves high-fidelity animatable avatar synthesis with strong in-the-wild generalization. Specifically, we introduce a feed-forward Mesh2Gaussian Prior Model (MGPM) that enables fast initialization of a Gaussian avatar. To further bridge the domain gap at test time, we design a test-time generative adaptation stage, leveraging both real and synthetic images as supervision. Unlike previous full diffusion denoising strategies that are slow and hallucination-prone, we propose a rendering-guided single-step diffusion enhancer that restores missing visual details, grounded on Gaussian avatar renderings. Our experiments demonstrate that ELITE produces visually superior avatars to prior works, even for challenging expressions, while achieving 60x faster synthesis than the 2D generative prior method.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 45 of its 52 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
45 of 52 references.
References · 45
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2023Adversarial Diffusion Distillationcited by 759
33 more
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
- 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 364
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
- 2021Neural Head Avatars from Monocular RGB Videoscited by 213
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 194
- 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 172
- 2018Deep Appearance Models for Face Renderingcited by 164
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
- 2022Instant Volumetric Head Avatarscited by 159
- 2022FILM: Frame Interpolation for Large Motioncited by 153
- 2021Pixel Codec Avatarscited by 127
- 2023Relightable Gaussian Codec Avatarscited by 127
- 2018FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Facescited by 119
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
- 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
- 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
- 2024URAvatar: Universal Relightable Gaussian Codec Avatarscited by 43
- 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
- 2024DifFRelight: Diffusion-Based Facial Performance Relightingcited by 35
- 2024Cafca: High-quality Novel View Synthesis of Expressive Faces from Casual Few-shot Capturescited by 34
- 2023MEGANE: Morphable Eyeglass and Avatar Networkcited by 24
- 2021HUMBI: A Large Multiview Dataset of Human Body Expressions and Benchmark Challengecited by 17
- 2025LuxDiT: Lighting Estimation with Video Diffusion Transformercited by 15
- 2025Synthetic Prior for Few-Shot Drivable Head Avatar Inversioncited by 14
- 2021High-fidelity Face Tracking for AR/VR via Deep Lighting Adaptationcited by 13
- 2023Avatar Fingerprinting for Authorized Use of Synthetic Talking-Head Videoscited by 11
- 2024SqueezeMe: Mobile-Ready Distillation of Gaussian Full-Body Avatarscited by 11
- 2025HairCUP: Hair Compositional Universal Prior for 3D Gaussian Avatarscited by 7
- 2025Audio Driven Real-Time Facial Animation for Social Telepresencecited by 5
- 2025VoluMe -- Authentic 3D Video Calls from Live Gaussian Splat Predictioncited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.