mlsanityData to 14 Oct 2026

Splatshot: 3D Face Avatar Generation from a Single Unconstrained Photo

arXiv 2606.01493 ↗First posted 31 May 2026cs.CVcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Reconstructing a photorealistic 3D face avatar from a single unconstrained photograph is challenging: feed-forward 3D Gaussian Splatting (3DGS) models degrade on out-of-distribution inputs, while pretrained diffusion models produce high-fidelity images but lack multi-view consistency. We observe that these paradigms are fundamentally complementary: explicit 3D representations guarantee geometric consistency, whereas 2D diffusion priors ensure photorealism. Building on this, we propose SplatShot, a training-free framework that couples these representations directly within the denoising process. Given a base 3DGS face model and a single reference image, we jointly denoise all target views using a per-step 3D feedback loop. At each timestep, we predict clean images from the noisy latents, refit the 3DGS to these multi-view predictions, and back-propagate the photometric discrepancy between the 3DGS re-renderings and 2D predictions into the noise estimate. This steers the sampling trajectory toward strictly 3D-coherent, identity-faithful outputs. Experiments on diverse in-the-wild images demonstrate that SplatShot produces 3D avatars with superior identity preservation, photorealism, and multi-view consistency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 85 of its 96 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

85 of 96 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splatting16 Dec
  2. 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models12 Jun
  3. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions27 Nov
  4. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  5. 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models3 Apr
  6. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  7. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 78

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  8. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  9. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  10. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  12. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
38 more
  1. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  2. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  3. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  4. 2021Alias-Free Generative Adversarial Networkscited by 1,184
  5. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  6. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  7. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
  8. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  9. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
  10. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
  11. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
  12. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
  13. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
  14. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
  15. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  16. 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 285
  17. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
  18. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  19. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  20. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
  21. 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
  22. 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 194
  23. 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
  24. 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 184
  25. 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 172
  26. 2022Towards Metrical Reconstruction of Human Facescited by 166
  27. 2023HUGS: Human Gaussian Splatscited by 154
  28. 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
  29. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
  30. 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
  31. 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
  32. 2024PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Acceleratorcited by 97
  33. 2024Generalizable and Animatable Gaussian Head Avatarcited by 97
  34. 2020Learning Formation of Physically-Based Face Attributescited by 94
  35. 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
  36. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
  37. 2023PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360circcited by 93
  38. 2024StyleGaussian: Instant 3D Style Transfer with Gaussian Splattingcited by 79

50 most cited of 78 All 78 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusion
  2. 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation
  3. 20243D2-Actor: Learning Pose-Conditioned 3D-Aware Denoiser for Realistic Gaussian Avatar Modeling
  4. 2024DSplats: 3D Generation by Denoising Splats-Based Multiview Diffusion Models
  5. 2024DiffHuman: Probabilistic Photorealistic 3D Reconstruction of Humans
  6. 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creation
  7. 2023DiffPortrait3D: Controllable Diffusion for Zero-Shot Portrait View Synthesis
  8. 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergy