mlsanityData to 14 Oct 2026

Learning Semantic Inpainting for Animatable Gaussian Head Avatars

arXiv 2609.38343 ↗First posted 29 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We present SInGA, a novel method for learning Semantic Inpainting for animatable Gaussian head Avatars from a single image. Existing avatar approaches often rely on multi-view observations and lack effective handling of unobserved regions in single-view settings, limiting their applicability in such scenarios. To address this, we propose a semantic inpainting framework defined in UV space for completing unobserved facial regions. Our key insight lies in the structured topology of the UV representation, which provides consistent spatial correspondences and enables reliable completion of identity-specific features using the inherent symmetry cues of human faces. We extract features from observed regions and use them to complete unobserved regions. The completed representation is then used to regress Gaussian attributes, effectively performing Gaussian inpainting. In addition, instead of relying on a single Gaussian at each surface or pixel location, we stack multiple Gaussians to enhance detail. The resulting avatar generalizes across identities without requiring per-identity optimization and can be animated with driving inputs. Experimental results show that our method generates high-quality head avatars with improved completeness and identity preservation, while supporting realistic animation and consistent rendering from unobserved views.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 57 of its 69 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

57 of 69 references.

References · 57

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  7. 2025DINOv3cited by 1,414
  8. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  9. 2020First Order Motion Model for Image Animationcited by 704
  10. 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 525
  11. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 482
  12. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
38 more
  1. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
  2. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
  3. 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
  4. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
  5. 2024Sapiens: Foundation for Human Vision Modelscited by 229
  6. 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 194
  7. 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 187
  8. 2024Probing the 3D Awareness of Visual Foundation Modelscited by 177
  9. 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
  10. 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
  11. 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
  12. 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
  13. 2024Generalizable and Animatable Gaussian Head Avatarcited by 97
  14. 2024DINOv2 Meets Text: A Unified Framework for Image- and Pixel-Level Vision-Language Alignmentcited by 79
  15. 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
  16. 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
  17. 2023OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Renderingcited by 67
  18. 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
  19. 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
  20. 2024DINO-Tracker: Taming DINO for Self-Supervised Point Tracking in a Single Videocited by 64
  21. 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
  22. 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
  23. 2023NOFA: NeRF-based One-shot Facial Avatar Reconstructioncited by 53
  24. 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 53
  25. 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
  26. 2025LAM: Large Avatar Model for One-shot Animatable Gaussian Headcited by 43
  27. 2024Generalizable Human Gaussians for Sparse View Synthesiscited by 40
  28. 2023HAvatar: High-fidelity Head Avatar via Facial Model Conditioned Neural Radiance Fieldcited by 37
  29. 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
  30. 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusioncited by 34
  31. 2025DINO in the Room: Leveraging 2D Foundation Models for 3D Segmentationcited by 31
  32. 2023MaLP: Manipulation Localization Using a Proactive Schemecited by 26
  33. 2023CVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformercited by 24
  34. 2024FaceLift: Learning Generalizable Single Image 3D Face Reconstruction from Synthetic Headscited by 22
  35. 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatarcited by 22
  36. 2024Geometry Image Diffusion: Fast and Data-Efficient Text-to-3D with Image-Based Surface Representationcited by 17
  37. 2025MVP4D: Multi-View Portrait Video Diffusion for Animatable 4D Avatarscited by 17
  38. 2024Learning Dynamic Tetrahedra for High-Quality Talking Head Synthesiscited by 12

50 most cited of 57 All 57 (JSON)

Built on by

Not cited yet.