GeoFace: Consistent Multi-View Face Generation with Geometry-Constrained Diffusion
Not on the map. Why?
Abstract (arXiv)
We present GeoFace, a geometry-constrained multi-view diffusion framework for consistent face generation from a single input. % While recent multi-view diffusion models achieve photorealistic synthesis at the per-view level, they lack an explicit mechanism to enforce a shared 3D structure across views, often leading to inconsistent geometry across viewpoints. To address this, GeoFace proposes a unified dual-stream framework for joint generation of multi-view RGB images and 3D face geometry, where the appearance and geometry streams interact through shared attention layers. To encourage the two streams to mutually constrain each other, we introduce a geometry-guided attention alignment loss that supervises the cross-attention between appearance and geometry tokens with 3D-consistent correspondences, enabling the appearance stream to correctly reference pose-invariant geometric cues for robust alignment across viewpoints. Geometry is represented as a canonical UV position map, derived from a FLAME mesh fitted to multi-view observations, serving as a view-invariant shared constraint across all generated views. Experiments on RenderMe-360 and NeRSemble demonstrate that GeoFace consistently outperforms existing methods in both visual quality and cross-view geometric consistency, facilitating more efficient 3D reconstruction.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 63 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
49 of 63 references.
References · 49
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
37 more
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
- 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 482
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 194
- 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 184
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 182
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
- 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 95
- 2023PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360circcited by 93
- 2020Lifting 2D StyleGAN for 3D-Aware Face Generationcited by 64
- 2019Unsupervised Generative 3D Shape Learning from Natural Imagescited by 57
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
- 2021Towards High Fidelity Monocular Face Reconstruction with Rich Reflectance using Self-supervised Learning and Ray Tracingcited by 48
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
- 2024MVGenMaster: Scaling Multi-View Generation from Any Image via 3D Priors Enhanced Diffusion Modelcited by 32
- 2024SphereHead: Stable 3D Full-head Synthesis with Spherical Tri-plane Representationcited by 30
- 2023DiffPortrait3D: Controllable Diffusion for Zero-Shot Portrait View Synthesiscited by 26
- 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creationcited by 23
- 2024FaceLift: Learning Generalizable Single Image 3D Face Reconstruction from Synthetic Headscited by 22
- 20243D Face Tracking from 2D Video through Iterative Dense UV to Image Flowcited by 20
- 2025Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face Reconstructioncited by 20
- 2025DiffPortrait360: Consistent Portrait Diffusion for 360 View Synthesiscited by 12
- 2025CAMEO: Correspondence-Attention Alignment for Multi-View Diffusion Modelscited by 10
- 2025HyPlaneHead: Rethinking Tri-plane-like Representations in Full-Head Image Synthesiscited by 6
- 2025VGGTFace: Topologically Consistent Facial Geometry Reconstruction in the Wildcited by 4
- 2025SpinMeRound: Consistent Multi-View Identity Generation Using Diffusion Modelscited by 3
- 2026Condition Matters in Full-head 3D GANscited by 2
- 2026Face Anything: 4D Face Reconstruction from Any Image Sequencecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Repurposing Geometric Foundation Models for Multi-view Diffusion
- 2025GeoMVD: Geometry-Enhanced Multi-View Generation Model Based on Geometric Information Extraction
- 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modeling
- 20243D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generation
- 2025NOVA3D: Normal Aligned Video Diffusion Model for Single Image to 3D Generation
- 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space
- 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Models
- 2025Geometry-Aware Diffusion Models for Multiview Scene Inpainting