Feed-forward Gaussian Registration for Head Avatar Creation and Editing
Not on the map. Why?
Abstract (arXiv)
We present MATCH (Multi-view Avatars from Topologically Corresponding Heads), a multi-view Gaussian registration method for high-quality head avatar creation and editing. State-of-the-art multi-view head avatar methods require time-consuming head tracking followed by expensive avatar optimization, often resulting in a total creation time of more than one day. MATCH, in contrast, directly predicts Gaussian splat textures in correspondence from calibrated multi-view images in just 0.5 seconds per frame, without requiring data preprocessing. The learned intra-subject correspondence across frames enables fast creation of personalized head avatars, while correspondence across subjects supports applications such as expression transfer, optimization-free tracking, semantic editing, and identity interpolation. We establish these correspondences end-to-end using a transformer-based model that predicts Gaussian splat textures in the fixed UV layout of a template mesh. To achieve this, we introduce a novel registration-guided attention block, where each UV-map token attends exclusively to image tokens depicting its corresponding mesh region. This design improves efficiency and performance compared to dense cross-view attention. MATCH outperforms existing methods in novel-view synthesis, geometry registration, and head avatar generation, while making avatar creation 10 times faster than the closest competing baseline. The code and model weights are available on the project website.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 47 of its 71 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
47 of 71 references.
References · 47
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2020First Order Motion Model for Image Animationcited by 698
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
35 more
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2021Neural Head Avatars from Monocular RGB Videoscited by 212
- 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
- 2020Real-Time High-Resolution Background Mattingcited by 172
- 2022MegaPortraits: One-shot Megapixel Neural Head Avatarscited by 131
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2020Neural Head Reenactment with Latent Pose Descriptorscited by 106
- 2020HeadGAN: One-shot Neural Head Synthesis and Editingcited by 105
- 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
- 2024EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatarscited by 65
- 2022ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 64
- 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 52
- 2025DiffSplat: Repurposing Image Diffusion Models for Scalable Gaussian Splat Generationcited by 49
- 2024NPGA: Neural Parametric Gaussian Avatarscited by 46
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
- 2024URAvatar: Universal Relightable Gaussian Codec Avatarscited by 43
- 2023Instant Multi-View Head Capture through Learnable Registrationcited by 34
- 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatarscited by 27
- 20193D Face Modeling From Diverse Raw Scan Datacited by 25
- 2024FaceLift: Learning Generalizable Single Image 3D Face Reconstruction from Synthetic Headscited by 22
- 2024Gaussian Eigen Models for Human Headscited by 21
- 20243D Face Tracking from 2D Video through Iterative Dense UV to Image Flowcited by 20
- 2025Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face Reconstructioncited by 20
- 2022DINER: Depth-aware Image-based NEural Radiance fieldscited by 19
- 2024VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresencecited by 19
- 2024Joker: Conditional 3D Head Synthesis with Extreme Facial Expressionscited by 17
- 2020Shape My Face: Registering 3D Face Scans by Surface-to-Surface Translationcited by 14
- 2024Topo4D: Topology-Preserving Gaussian Splatting for High-Fidelity 4D Head Capturecited by 8
- 2025PanoLAM: Large Avatar Model for Gaussian Full-Head Synthesis from One-shot Unposed Imagecited by 7
- 2024GRAPE: Generalizable and Robust Multi-view Facial Capturecited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.