Learning Semantic Inpainting for Animatable Gaussian Head Avatars
Not on the map. Why?
Abstract (arXiv)
We present SInGA, a novel method for learning Semantic Inpainting for animatable Gaussian head Avatars from a single image. Existing avatar approaches often rely on multi-view observations and lack effective handling of unobserved regions in single-view settings, limiting their applicability in such scenarios. To address this, we propose a semantic inpainting framework defined in UV space for completing unobserved facial regions. Our key insight lies in the structured topology of the UV representation, which provides consistent spatial correspondences and enables reliable completion of identity-specific features using the inherent symmetry cues of human faces. We extract features from observed regions and use them to complete unobserved regions. The completed representation is then used to regress Gaussian attributes, effectively performing Gaussian inpainting. In addition, instead of relying on a single Gaussian at each surface or pixel location, we stack multiple Gaussians to enhance detail. The resulting avatar generalizes across identities without requiring per-identity optimization and can be animated with driving inputs. Experimental results show that our method generates high-quality head avatars with improved completeness and identity preservation, while supporting realistic animation and consistent rendering from unobserved views.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 57 of its 69 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
57 of 69 references.
References · 57
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025DINOv3cited by 1,414
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 2020First Order Motion Model for Image Animationcited by 704
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 525
- 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 482
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
38 more
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
- 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 194
- 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 187
- 2024Probing the 3D Awareness of Visual Foundation Modelscited by 177
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 97
- 2024DINOv2 Meets Text: A Unified Framework for Image- and Pixel-Level Vision-Language Alignmentcited by 79
- 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
- 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
- 2023OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Renderingcited by 67
- 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
- 2024DINO-Tracker: Taming DINO for Self-Supervised Point Tracking in a Single Videocited by 64
- 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
- 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
- 2023NOFA: NeRF-based One-shot Facial Avatar Reconstructioncited by 53
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 53
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
- 2025LAM: Large Avatar Model for One-shot Animatable Gaussian Headcited by 43
- 2024Generalizable Human Gaussians for Sparse View Synthesiscited by 40
- 2023HAvatar: High-fidelity Head Avatar via Facial Model Conditioned Neural Radiance Fieldcited by 37
- 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
- 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusioncited by 34
- 2025DINO in the Room: Leveraging 2D Foundation Models for 3D Segmentationcited by 31
- 2023MaLP: Manipulation Localization Using a Proactive Schemecited by 26
- 2023CVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformercited by 24
- 2024FaceLift: Learning Generalizable Single Image 3D Face Reconstruction from Synthetic Headscited by 22
- 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatarcited by 22
- 2024Geometry Image Diffusion: Fast and Data-Efficient Text-to-3D with Image-Based Surface Representationcited by 17
- 2025MVP4D: Multi-View Portrait Video Diffusion for Animatable 4D Avatarscited by 17
- 2024Learning Dynamic Tetrahedra for High-Quality Talking Head Synthesiscited by 12
50 most cited of 57 All 57 (JSON)
Built on by
Not cited yet.