SpatialAvatar-0: High-Quality 4D Head Avatar with Multi-Stage Reconstruction
Not on the map. Why?
Abstract (arXiv)
High-quality 4D head avatars from one or a few source portraits are central to telepresence, AR/VR, and digital-human interaction. 3D Gaussian Splatting (3DGS) has emerged as the dominant representation, with two complementary regimes (generalizable feed-forward predictors and per-subject refiners) maturing in parallel. However, existing feed-forward predictors are trained on a single dataset family with a hard-coded source count, inheriting the corresponding domain bias. Per-subject refiners require 300K--600K iterations and rely on adaptive densification that destroys upstream Gaussian layouts, preventing the two regimes from sharing a representation end-to-end. To bridge both regimes we propose SpatialAvatar-0 on a shared FLAME-mesh-bound Gaussian representation: a feed-forward generator with a parameter-free K-source mean-pool and a monocular-temporal to multi-view-spatial two-phase schedule that anchors against identity-prior collapse onto the smaller multi-view set. We further introduce a 10K-iter layout-preserving per-subject refinement loop that freezes the FLAME-binding and Gaussian count and replaces densification with a three-component anti-spike regularization. On VFHQ/HDTF cross-domain zero-shot we surpass the in-domain leader GAGAvatar by +1.5 dB PSNR despite never training on either test domain, and on the SplattingAvatar monocular benchmark we lead every reported metric, surpassing the 300K-iter GeoAvatar by +1.3 dB PSNR at up to 60x shorter per-subject schedule than common SOTA baselines. Website: https://spatialwalk.github.io/SpatialAvatar-0.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 66 of its 78 references that are in the map. First posted on arXiv 14 Jun 2026.
Builds on
66 of 78 references.
References · 66
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 2020First Order Motion Model for Image Animationcited by 704
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
- 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
38 more
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 250
- 2018Explicit Inductive Bias for Transfer Learning with Convolutional Networkscited by 227
- 2021Neural Head Avatars from Monocular RGB Videoscited by 213
- 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 203
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 194
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
- 2021Audio-Driven Emotional Video Portraitscited by 180
- 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 178
- 2019Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervisioncited by 176
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
- 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 172
- 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
- 2022Instant Volumetric Head Avatarscited by 159
- 2022MegaPortraits: One-shot Megapixel Neural Head Avatarscited by 131
- 2023GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesiscited by 131
- 2019Robust Learning with Jacobian Regularizationcited by 129
- 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
- 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
- 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2020Talking-head Generation with Rhythmic Head Motioncited by 112
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
- 2020Neural Head Reenactment with Latent Pose Descriptorscited by 106
- 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 97
- 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesiscited by 93
- 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
- 2022MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptationcited by 69
- 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
- 2023OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Renderingcited by 67
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
- 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
- 2023StyleAvatar: Real-time Photo-realistic Portrait Avatar from a Single Videocited by 52
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
- 2024NPGA: Neural Parametric Gaussian Avatarscited by 46
- 2023Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB Videoscited by 44
- 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
50 most cited of 66 All 66 (JSON)
Built on by
Not cited yet.