DiffPortrait360: Consistent Portrait Diffusion for 360 View Synthesis
Not on the map. Why?
Abstract (arXiv)
Generating high-quality 360-degree views of human heads from single-view images is essential for enabling accessible immersive telepresence applications and scalable personalized content creation. While cutting-edge methods for full head generation are limited to modeling realistic human heads, the latest diffusion-based approaches for style-omniscient head synthesis can produce only frontal views and struggle with view consistency, preventing their conversion into true 3D models for rendering from arbitrary angles. We introduce a novel approach that generates fully consistent 360-degree head views, accommodating human, stylized, and anthropomorphic forms, including accessories like glasses and hats. Our method builds on the DiffPortrait3D framework, incorporating a custom ControlNet for back-of-head detail generation and a dual appearance module to ensure global front-back consistency. By training on continuous view sequences and integrating a back reference image, our approach achieves robust, locally continuous view synthesis. Our model can be used to produce high-quality neural radiance fields (NeRFs) for real-time, free-viewpoint rendering, outperforming state-of-the-art methods in object synthesis and 360-degree head generation for very challenging input portraits.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 45 of its 61 references that are in the map. First posted on arXiv 19 Mar 2025.
Builds on
45 of 61 references.
References · 45
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
33 more
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
- 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
- 2020State of the Art on Neural Renderingcited by 278
- 2020Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learningcited by 220
- 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 194
- 2018Deep Appearance Models for Face Renderingcited by 164
- 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 135
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2022EpiGRAF: Rethinking training of 3D GANscited by 108
- 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
- 2023PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360circcited by 93
- 2022GIRAFFE HD: A High-Resolution 3D-aware Generative Modelcited by 86
- 2023Real-Time Radiance Fields for Single-Image Portrait View Synthesiscited by 64
- 2023Consistent123: One Image to Highly Consistent 3D Asset Using Case-Aware Diffusion Priorscited by 64
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
- 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
- 2021Generative Occupancy Fields for 3D Surface-Aware Image Synthesiscited by 51
- 2021Towards High Fidelity Monocular Face Reconstruction with Rich Reflectance using Self-supervised Learning and Ray Tracingcited by 48
- 2019MVF-Net: Multi-View 3D Face Morphable Model Regressioncited by 45
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
- 2021Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinementcited by 36
- 2023VOODOO 3D: Volumetric Portrait Disentanglement for One-Shot 3D Head Reenactmentcited by 33
- 2024SphereHead: Stable 3D Full-head Synthesis with Spherical Tri-plane Representationcited by 30
- 2023DiffPortrait3D: Controllable Diffusion for Zero-Shot Portrait View Synthesiscited by 26
- 2024VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresencecited by 19
- 2024Joker: Conditional 3D Head Synthesis with Extreme Facial Expressionscited by 18
- 2022Novel View Synthesis for High-fidelity Headshot Scenescited by 4
Built on by
Citing papers per year: 2025: 5; 2026: 7.
12 papers.
- 2025SOAP: Style-Omniscient Animatable Portraitscited by 11
- 2026FastGHA: Generalized Few-Shot 3D Gaussian Head Avatars with Real-Time Animationcited by 4
- 2025SpinMeRound: Consistent Multi-View Identity Generation Using Diffusion Modelscited by 3
- 2025Stable-Hair v2: Real-World Hair Transfer via Multiple-View Diffusion Modelcited by 2
- 2026Condition Matters in Full-head 3D GANscited by 2
- 2026Any3DAvatar: Fast and High-Quality Full-Head 3D Avatar Reconstruction from Single Portrait Imagecited by 1
- 2026Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generationcited by 1
- 2025StyleFusion360: View-Consistent Head Stylization via Adaptive Style Modulationcited by 0
- 2025Envision: Embodied Visual Planning via Goal-Imagery Video Diffusioncited by 0
- 2026You Only Need One Stage: Novel-View Synthesis From A Single Blind Face Imagecited by 0
- 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatarscited by 0
- 2026GeoFace: Consistent Multi-View Face Generation with Geometry-Constrained Diffusioncited by 0
- 2026GeoFace: Consistent Multi-View Face Generation with Geometry-Constrained Diffusion26 Jun 2026
- 2026Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generation24 May 2026
- 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatars16 Apr 2026
- 2026Any3DAvatar: Fast and High-Quality Full-Head 3D Avatar Reconstruction from Single Portrait Image15 Apr 2026
- 2026You Only Need One Stage: Novel-View Synthesis From A Single Blind Face Image1 Mar 2026
- 2026Condition Matters in Full-head 3D GANs6 Feb 2026
- 2026FastGHA: Generalized Few-Shot 3D Gaussian Head Avatars with Real-Time Animation20 Jan 2026
- 2025Envision: Embodied Visual Planning via Goal-Imagery Video Diffusion27 Dec 2025
- 2025StyleFusion360: View-Consistent Head Stylization via Adaptive Style Modulation27 Nov 2025
- 2025Stable-Hair v2: Real-World Hair Transfer via Multiple-View Diffusion Model10 Jul 2025
- 2025SOAP: Style-Omniscient Animatable Portraits8 May 2025
- 2025SpinMeRound: Consistent Multi-View Identity Generation Using Diffusion Models14 Apr 2025