Splatshot: 3D Face Avatar Generation from a Single Unconstrained Photo
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Reconstructing a photorealistic 3D face avatar from a single unconstrained photograph is challenging: feed-forward 3D Gaussian Splatting (3DGS) models degrade on out-of-distribution inputs, while pretrained diffusion models produce high-fidelity images but lack multi-view consistency. We observe that these paradigms are fundamentally complementary: explicit 3D representations guarantee geometric consistency, whereas 2D diffusion priors ensure photorealism. Building on this, we propose SplatShot, a training-free framework that couples these representations directly within the denoising process. Given a base 3DGS face model and a single reference image, we jointly denoise all target views using a per-step 3D feedback loop. At each timestep, we predict clean images from the noisy latents, refit the 3DGS to these multi-view predictions, and back-propagate the photometric discrepancy between the 3DGS re-renderings and 2D predictions into the noise estimate. This steers the sampling trajectory toward strictly 3D-coherent, identity-faithful outputs. Experiments on diverse in-the-wild images demonstrate that SplatShot produces 3D avatars with superior identity preservation, photorealism, and multi-view consistency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 85 of its 96 references that are in the map. First posted on arXiv 31 May 2026.
Builds on
85 of 96 references.
Closest ancestors · 7
Same direction, newest first
- 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splatting16 Dec
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models12 Jun
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions27 Nov
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models3 Apr
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
Other references · 78
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
38 more
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
- 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 285
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
- 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 194
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
- 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 184
- 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 172
- 2022Towards Metrical Reconstruction of Human Facescited by 166
- 2023HUGS: Human Gaussian Splatscited by 154
- 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
- 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
- 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
- 2024PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Acceleratorcited by 97
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 97
- 2020Learning Formation of Physically-Based Face Attributescited by 94
- 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
- 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
- 2023PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360circcited by 93
- 2024StyleGaussian: Instant 3D Style Transfer with Gaussian Splattingcited by 79
50 most cited of 78 All 78 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusion
- 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation
- 20243D2-Actor: Learning Pose-Conditioned 3D-Aware Denoiser for Realistic Gaussian Avatar Modeling
- 2024DSplats: 3D Generation by Denoising Splats-Based Multiview Diffusion Models
- 2024DiffHuman: Probabilistic Photorealistic 3D Reconstruction of Humans
- 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creation
- 2023DiffPortrait3D: Controllable Diffusion for Zero-Shot Portrait View Synthesis
- 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergy