Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generation
Not on the map. Why?
Abstract (arXiv)
High-fidelity 3D Gaussian head avatar generation is critical for applications such as AR/VR, telepresence, and digital humans. Existing methods depend on multi-view datasets, 3D captures, or intermediate 2D view synthesis. In contrast, we learn both conditional and unconditional 3D head models from randomly sampled 2D images alone, without using multi-view data, 3D supervision, or intermediate view generation. We introduce MVCHead, a single-shot state space model that enforces multi-view consistency (MVC) directly in the 3D representation while regressing 3D Gaussians under these constraints. At its core, we propose a Hierarchical State Space (HiSS) block that progressively refines Gaussians from coarse to fine, while capturing long-range dependencies. Within each HiSS block, we modify Mamba's standard unidirectional scan with the proposed Hierarchical Bi-directional State Scan (HiBiSS) that aligns recurrence with the axes along which multi-view inconsistencies are strongest. Finally, we design an SE(3) Multi-view Critic that judges whether a set of self-renders arises from a single underlying 3D configuration, rewarding cross-view pixel alignment without observing real multi-view pairs. MVCHead achieves state-of-the-art perceptual quality, surpasses prior methods in both texture and geometric consistency, and maintains comparable shape consistency. To demonstrate scalability, we release FaceGS-10K, the first large-scale dataset of ready-to-use 3D Gaussian head assets for training and evaluation of 3D head models. Project Page and code: https://humansensinglab.github.io/MVCHead/
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 74 of its 84 references that are in the map. First posted on arXiv 24 May 2026.
Builds on
74 of 84 references.
References · 74
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2020Point Transformercited by 1,470
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2024VMamba: Visual State Space Modelcited by 969
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
38 more
- 2020PCT: Point cloud transformercited by 732
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
- 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 2024MambaVision: A Hybrid Mamba-Transformer Vision Backbonecited by 224
- 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 194
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
- 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 172
- 2022VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Gridscited by 133
- 2024FeatUp: A Model-Agnostic Framework for Features at Any Resolutioncited by 116
- 2022EpiGRAF: Rethinking training of 3D GANscited by 108
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 97
- 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 95
- 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
- 2024Mamba-ND: Selective State Space Modeling for Multi-Dimensional Datacited by 84
- 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 79
- 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
- 2023Gaussian Shell Maps for Efficient 3D Human Generationcited by 61
- 2023HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splattingcited by 60
- 2022Generative Multiplane Images: Making a 2D GAN 3D-Awarecited by 57
- 2024Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstructioncited by 56
- 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 53
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
- 2024GGHead: Fast and Generalizable 3D Gaussian Headscited by 51
- 2024NPGA: Neural Parametric Gaussian Avatarscited by 46
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
- 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mambacited by 45
- 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
- 2023DiffusionAvatars: Deferred Diffusion for High-fidelity 3D Head Avatarscited by 42
- 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
- 2023MonoNPHM: Dynamic Head Reconstruction from Monocular Videoscited by 35
- 2024Cafca: High-quality Novel View Synthesis of Expressive Faces from Casual Few-shot Capturescited by 34
- 2024FATE: Full-head Gaussian Avatar with Textural Editing from Monocular Videocited by 32
- 2024GaussianHeads: End-to-End Learning of Drivable Gaussian Head Avatars from Coarse-to-fine Representationscited by 31
50 most cited of 74 All 74 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Efficient 3D Gaussian Head Avatars for Edge Devicescited by 0
- 2026Efficient 3D Gaussian Head Avatars for Edge Devices7 Oct 2026
Similar, not cited
Close in wording, no citation either way
- 2026FastGHA: Generalized Few-Shot 3D Gaussian Head Avatars with Real-Time Animation
- 2023Head3D: Complete 3D Head Generation via Tri-plane Feature Distillation
- 2023Gaussian3Diff: 3D Gaussian Diffusion for 3D Full Head Synthesis and Editing
- 2025MoGA: 3D Generative Avatar Prior for Monocular Gaussian Avatar Reconstruction
- 2024HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting
- 2023HeadSculpt: Crafting 3D Head Avatars with Text
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPS
- 2025Geometry and Perception Guided Gaussians for Multiview-consistent 3D Generation from a Single Image