AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxels
Not on the map. Why?
Abstract (arXiv)
With NeRF widely used for facial reenactment, recent methods can recover photo-realistic 3D head avatar from just a monocular video. Unfortunately, the training process of the NeRF-based methods is quite time-consuming, as MLP used in the NeRF-based methods is inefficient and requires too many iterations to converge. To overcome this problem, we propose AvatarMAV, a fast 3D head avatar reconstruction method using Motion-Aware Neural Voxels. AvatarMAV is the first to model both the canonical appearance and the decoupled expression motion by neural voxels for head avatar. In particular, the motion-aware neural voxels is generated from the weighted concatenation of multiple 4D tensors. The 4D tensors semantically correspond one-to-one with 3DMM expression basis and share the same weights as 3DMM expression coefficients. Benefiting from our novel representation, the proposed AvatarMAV can recover photo-realistic head avatars in just 5 minutes (implemented with pure PyTorch), which is significantly faster than the state-of-the-art facial reenactment methods. Project page: https://www.liuyebin.com/avatarmav.
Key facts. Cited by 73 papers in the map (data through 14 Oct 2026). Builds on 40 of its 66 references that are in the map. First posted on arXiv 23 Nov 2022.
Builds on
40 of 66 references.
References · 40
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
- 2020First Order Motion Model for Image Animationcited by 704
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
28 more
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 346
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 320
- 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
- 2018Deep Video Portraitscited by 267
- 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 214
- 2021Neural Head Avatars from Monocular RGB Videoscited by 213
- 2018X2Face: A network for controlling face generation by using images, audio, and pose codescited by 189
- 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
- 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 137
- 2022MegaPortraits: One-shot Megapixel Neural Head Avatarscited by 131
- 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
- 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
- 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
- 2022Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generationcited by 119
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2021FENeRF: Face Editing in Neural Radiance Fieldscited by 112
- 2020HeadGAN: One-shot Neural Head Synthesis and Editingcited by 105
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
- 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
- 2020Head2Head: Video-based Neural Head Synthesiscited by 40
- 2021FLAME-in-NeRF : Neural control of Radiance Fields for Free View Face Animationcited by 33
- 2020Head2Head++: Deep Facial Attributes Re-Targetingcited by 30
- 2021VariTex: Variational Neural Face Texturescited by 30
Built on by
Citing papers per year: 2023: 17; 2024: 25; 2025: 19; 2026: 12.
73 papers.
Sort:
By area:
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
- 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
- 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 84
- 2024EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatarscited by 66
- 2023HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splattingcited by 60
- 20243D Gaussian Blendshapes for Head Avatar Animationcited by 58
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 53
- 2023StyleAvatar: Real-time Photo-realistic Portrait Avatar from a Single Videocited by 52
- 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatarcited by 50
- 2023GaussianHead: High-fidelity Head Avatars with Learnable Gaussian Derivationcited by 46
- 2023Learning Disentangled Avatars with Hybrid 3D Representationscited by 44
38 more
- 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
- 2023FLARE: Fast Learning of Animatable and Relightable Mesh Avatarscited by 39
- 2024MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head Editingcited by 38
- 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
- 2023HHAvatar: Gaussian Head Avatar with Dynamic Hairscited by 35
- 2024HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splattingcited by 35
- 2024FATE: Full-head Gaussian Avatar with Textural Editing from Monocular Videocited by 32
- 2024GaussianHeads: End-to-End Learning of Drivable Gaussian Head Avatars from Coarse-to-fine Representationscited by 31
- 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatarscited by 29
- 2025HRAvatar: High-Quality and Relightable Gaussian Head Avatarcited by 25
- 2023VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streamscited by 22
- 2024Gaussian Eigen Models for Human Headscited by 21
- 2023BakedAvatar: Baking Neural Fields for Real-Time Head Avatar Synthesiscited by 20
- 2023InvertAvatar: Incremental GAN Inversion for Generalized Head Avatarscited by 19
- 2025InsTaG: Learning Personalized 3D Talking Head from Few-Second Videocited by 18
- 2024PSAvatar: A Point-based Shape Model for Real-Time Head Avatar Animation with 3D Gaussian Splattingcited by 17
- 2024Improving Robustness for Joint Optimization of Camera Poses and Decomposed Low-Rank Tensorial Radiance Fieldscited by 15
- 2024SurFhead: Affine Rig Blending for Geometrically Accurate 2D Gaussian Surfel Head Avatarscited by 15
- 2025Synthetic Prior for Few-Shot Drivable Head Avatar Inversioncited by 14
- 20253D Gaussian Head Avatars with Expressive Dynamic Appearances by Compact Tensorial Representationscited by 14
- 2024Neural Radiance Field-based Visual Rendering: A Comprehensive Reviewcited by 12
- 2024GeneAvatar: Generic Expression-Aware Volumetric Head Avatar Editing from a Single Imagecited by 12
- 2025ScaffoldAvatar: High-Fidelity Gaussian Avatars with Patch Expressionscited by 12
- 2025SEGA: Drivable 3D Gaussian Head Avatar from a Single Imagecited by 11
- 2025SOAP: Style-Omniscient Animatable Portraitscited by 11
- 2024GPHM: Gaussian Parametric Head Model for Monocular Head Avatar Reconstructioncited by 10
- 2025Zero-1-to-A: Zero-Shot One Image to Animatable Head Avatars Using Video Diffusioncited by 9
- 2024Efficient 3D Implicit Head Avatar with Mesh-anchored Hash Table Blendshapescited by 8
- 2024ConsistentAvatar: Learning to Diffuse Fully Consistent Talking Head Avatar with Temporal Guidancecited by 7
- 2024High-Quality Mesh Blendshape Generation from Face Videos via Neural Inverse Renderingcited by 6
- 2024SPARK: Self-supervised Personalized Real-time Monocular Face Capturecited by 6
- 2023High-Fidelity 3D Head Avatars Reconstruction through Spatially-Varying Expression Conditioned Neural Radiance Fieldcited by 5
- 2024Dynamic NeRF: A Reviewcited by 5
- 2025GHOST 2.0: generative high-fidelity one shot transfer of headscited by 5
- 2026UIKA: Fast Universal Head Avatar from Pose-Free Imagescited by 5
- 2024Gaussian Head & Shoulders: High Fidelity Neural Upper Body Avatars with Anchor Gaussian Guided Texture Warpingcited by 4
- 2024MixedGaussianAvatar: Realistically and Geometrically Accurate Head Avatar via Mixed 2D-3D Gaussianscited by 4
- 2025GeoAvatar: Adaptive Geometrical Gaussian Splatting for 3D Head Avatarcited by 3
50 most cited of 73 All 73 (JSON)
- 2026Tele360: Real-Time Feed-Forward Human Reconstruction from Sparse Unposed Cameras14 Sep 2026
- 2026FA-LAM: Focus-Aware Large Avatar Model for One-Shot 4D Animatable Gaussian Head23 Jul 2026
- 2026Self-Learning Expression Deformations for Data-Efficient Gaussian Avatars4 Jun 2026
- 2026AvatarPointillist: AutoRegressive 4D Gaussian Avatarization6 Apr 2026
- 2026DipGuava: Disentangling Personalized Gaussian Features for 3D Head Avatars from Monocular Video30 Mar 2026
- 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Field24 Mar 2026
- 2026NBAvatar: Neural Billboards Avatars with Realistic Hand-Face Interaction12 Mar 2026
- 2026Retrieval-Augmented Gaussian Avatars: Improving Expression Generalization9 Mar 2026
- 2026Lightweight High-Fidelity Low-Bitrate Talking Face Compression for 3D Video Conference29 Jan 2026
- 2026CAG-Avatar: Cross-Attention Guided Gaussian Avatars for High-Fidelity Head Reconstruction21 Jan 2026
- 2026UIKA: Fast Universal Head Avatar from Pose-Free Images12 Jan 2026
- 2026CaricatureGS: Exaggerating 3D Gaussian Splatting Faces With Gaussian Curvature6 Jan 2026
38 more
- 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformation19 Dec 2025
- 2025VASA-3D: Lifelike Audio-Driven Gaussian Head Avatars from a Single Image16 Dec 2025
- 2025AvatarBack: Back-Head Generation for Complete 3D Avatars from Front-View Images28 Aug 2025
- 2025GeoAvatar: Adaptive Geometrical Gaussian Splatting for 3D Head Avatar24 Jul 2025
- 2025ScaffoldAvatar: High-Fidelity Gaussian Avatars with Patch Expressions14 Jul 2025
- 2025ToonifyGB: StyleGAN-based Gaussian Blendshapes for 3D Stylized Head Avatars15 May 2025
- 2025SOAP: Style-Omniscient Animatable Portraits8 May 2025
- 20253D Gaussian Head Avatars with Expressive Dynamic Appearances by Compact Tensorial Representations21 Apr 2025
- 2025SEGA: Drivable 3D Gaussian Head Avatar from a Single Image19 Apr 2025
- 2025InteractAvatar: Modeling Hand-Face Interaction in Photorealistic Avatars with Deformable Gaussians10 Apr 2025
- 2025Refined Geometry-guided Head Avatar Reconstruction from Monocular RGB Video27 Mar 2025
- 2025Zero-1-to-A: Zero-Shot One Image to Animatable Head Avatars Using Video Diffusion20 Mar 2025
- 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatars17 Mar 2025
- 2025HRAvatar: High-Quality and Relightable Gaussian Head Avatar11 Mar 2025
- 2025InsTaG: Learning Personalized 3D Talking Head from Few-Second Video27 Feb 2025
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatars27 Feb 2025
- 2025GHOST 2.0: generative high-fidelity one shot transfer of heads25 Feb 2025
- 2025High-Fidelity Human Avatars from Laptop Webcams using Edge Compute4 Feb 2025
- 2025Synthetic Prior for Few-Shot Drivable Head Avatar Inversion12 Jan 2025
- 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusion13 Dec 2024
- 2024MixedGaussianAvatar: Realistically and Geometrically Accurate Head Avatar via Mixed 2D-3D Gaussians6 Dec 2024
- 2024TimeWalker: Personalized Neural Space for Lifelong Head Avatars3 Dec 2024
- 2024FATE: Full-head Gaussian Avatar with Textural Editing from Monocular Video23 Nov 2024
- 2024ConsistentAvatar: Learning to Diffuse Fully Consistent Talking Head Avatar with Temporal Guidance23 Nov 2024
- 2024SurFhead: Affine Rig Blending for Geometrically Accurate 2D Gaussian Surfel Head Avatars15 Oct 2024
- 2024High-quality Animatable Eyelid Shapes from Lightweight Captures2 Oct 2024
- 2024GaussianHeads: End-to-End Learning of Drivable Gaussian Head Avatars from Coarse-to-fine Representations18 Sep 2024
- 2024SPARK: Self-supervised Personalized Real-time Monocular Face Capture12 Sep 2024
- 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priors12 Aug 2024
- 2024GPHM: Gaussian Parametric Head Model for Monocular Head Avatar Reconstruction21 Jul 2024
- 2024Gaussian Eigen Models for Human Heads5 Jul 2024
- 2024FAGhead: Fully Animate Gaussian Head from Monocular Videos27 Jun 2024
- 2024Gaussian Head & Shoulders: High Fidelity Neural Upper Body Avatars with Anchor Gaussian Guided Texture Warping20 May 2024
- 2024Dynamic NeRF: A Review14 May 2024
- 20243D Gaussian Blendshapes for Head Avatar Animation30 Apr 2024
- 2024EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatars29 Apr 2024
- 2024MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head Editing29 Apr 2024
- 2024GeneAvatar: Generic Expression-Aware Volumetric Head Avatar Editing from a Single Image2 Apr 2024
50 newest of 73 All 73 (JSON)
- 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
- 2025SOAP: Style-Omniscient Animatable Portraitscited by 11
- 2025Zero-1-to-A: Zero-Shot One Image to Animatable Head Avatars Using Video Diffusioncited by 9
- 2024ConsistentAvatar: Learning to Diffuse Fully Consistent Talking Head Avatar with Temporal Guidancecited by 7
- 2025SOAP: Style-Omniscient Animatable Portraits8 May 2025
- 2025Zero-1-to-A: Zero-Shot One Image to Animatable Head Avatars Using Video Diffusion20 Mar 2025
- 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusion13 Dec 2024
- 2024ConsistentAvatar: Learning to Diffuse Fully Consistent Talking Head Avatar with Temporal Guidance23 Nov 2024
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
- 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
- 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 84
- 2024EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatarscited by 66
- 2023HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splattingcited by 60
- 20243D Gaussian Blendshapes for Head Avatar Animationcited by 58
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 53
- 2023StyleAvatar: Real-time Photo-realistic Portrait Avatar from a Single Videocited by 52
- 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatarcited by 50
- 2023GaussianHead: High-fidelity Head Avatars with Learnable Gaussian Derivationcited by 46
- 2023Learning Disentangled Avatars with Hybrid 3D Representationscited by 44
12 most cited of 68 All 68 (JSON)
- 2026Tele360: Real-Time Feed-Forward Human Reconstruction from Sparse Unposed Cameras14 Sep 2026
- 2026FA-LAM: Focus-Aware Large Avatar Model for One-Shot 4D Animatable Gaussian Head23 Jul 2026
- 2026Self-Learning Expression Deformations for Data-Efficient Gaussian Avatars4 Jun 2026
- 2026AvatarPointillist: AutoRegressive 4D Gaussian Avatarization6 Apr 2026
- 2026DipGuava: Disentangling Personalized Gaussian Features for 3D Head Avatars from Monocular Video30 Mar 2026
- 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Field24 Mar 2026
- 2026NBAvatar: Neural Billboards Avatars with Realistic Hand-Face Interaction12 Mar 2026
- 2026Lightweight High-Fidelity Low-Bitrate Talking Face Compression for 3D Video Conference29 Jan 2026
- 2026CAG-Avatar: Cross-Attention Guided Gaussian Avatars for High-Fidelity Head Reconstruction21 Jan 2026
- 2026UIKA: Fast Universal Head Avatar from Pose-Free Images12 Jan 2026
- 2026CaricatureGS: Exaggerating 3D Gaussian Splatting Faces With Gaussian Curvature6 Jan 2026
- 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformation19 Dec 2025
12 newest of 68 All 68 (JSON)