MegaPortraits: One-shot Megapixel Neural Head Avatars
Not on the map. Why?
Cited by 23 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
In this work, we advance the neural head avatar technology to the megapixel resolution while focusing on the particularly challenging task of cross-driving synthesis, i.e., when the appearance of the driving image is substantially different from the animated source image. We propose a set of new neural architectures and training methods that can leverage both medium-resolution video data and high-resolution image data to achieve the desired levels of rendered image quality and generalization to novel views and motion. We demonstrate that suggested architectures and methods produce convincing high-resolution neural avatars, outperforming the competitors in the cross-driving scenario. Lastly, we show how a trained high-resolution neural avatar model can be distilled into a lightweight student model which runs in real-time and locks the identities of neural avatars to several dozens of pre-defined source images. Real-time operation and identity lock are essential for many practical applications head avatar systems.
Key facts. Cited by 131 papers in the map (data through 7 Oct 2026). Builds on 29 of its 46 references that are in the map. First posted on arXiv 15 Jul 2022.
Builds on
29 of 46 references.
References · 29
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
- 2018VoxCeleb2: Deep Speaker Recognitioncited by 862
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2020First Order Motion Model for Image Animationcited by 698
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524
17 more
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
- 2018Video-to-Video Synthesiscited by 388
- 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
- 2018Deep Video Portraitscited by 265
- 2018Animating Arbitrary Objects via Deep Motion Transfercited by 206
- 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 195
- 2019Neural Volumes: Learning Dynamic Renderable Volumes from Imagescited by 173
- 2018Deep Appearance Models for Face Renderingcited by 164
- 2017S3FD: Single Shot Scale-invariant Face Detectorcited by 142
- 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
- 2020Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatarscited by 116
- 2020Neural Head Reenactment with Latent Pose Descriptorscited by 106
- 2020HeadGAN: One-shot Neural Head Synthesis and Editingcited by 105
- 2019MarioNETte: Few-shot Face Reenactment Preserving Identity of Unseen Targetscited by 90
- 2019Graphonomy: Universal Human Parsing via Graph Transfer Learningcited by 81
- 2020HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishmentcited by 70
Built on by
Citing papers per year: 2022: 7; 2023: 29; 2024: 39; 2025: 39; 2026: 17.
131 papers.
Sort:
By area:
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
- 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 198
- 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
- 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 186
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
- 2024Loopy: Taming Audio-Driven Portrait Avatar with Long-Term Motion Dependencycited by 102
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 95
- 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesiscited by 93
- 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 88
- 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
- 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
38 more
- 2022MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptationcited by 69
- 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
- 2024EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatarscited by 65
- 2023Real-Time Radiance Fields for Single-Image Portrait View Synthesiscited by 64
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
- 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
- 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 55
- 2023NOFA: NeRF-based One-shot Facial Avatar Reconstructioncited by 53
- 2023StyleAvatar: Real-time Photo-realistic Portrait Avatar from a Single Videocited by 52
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 52
- 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatarcited by 50
- 2023DPE: Disentanglement of Pose and Expression for General Video Portrait Editingcited by 45
- 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
- 2023GAIA: Zero-shot Talking Avatar Generationcited by 43
- 2025LAM: Large Avatar Model for One-shot Animatable Gaussian Headcited by 43
- 2024Ditto: Motion-Space Diffusion for Controllable Realtime Talking Head Synthesiscited by 41
- 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 41
- 2024FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portraitcited by 40
- 2024INFP: Audio-Driven Interactive Head Generation in Dyadic Conversationscited by 40
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
- 2023VOODOO 3D: Volumetric Portrait Disentanglement for One-Shot 3D Head Reenactmentcited by 33
- 2024MegActor: Harness the Power of Raw Video for Vivid Portrait Animationcited by 27
- 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attentioncited by 26
- 2023CVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformercited by 24
- 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatarcited by 22
- 2023Generalizable One-shot Neural Head Avatarcited by 21
- 2025Pippo: High-Resolution Multi-View Humans from a Single Imagecited by 20
- 2022DINER: Depth-aware Image-based NEural Radiance fieldscited by 19
- 2023InvertAvatar: Incremental GAN Inversion for Generalized Head Avatarscited by 19
- 2024VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresencecited by 19
- 2023Unsupervised Volumetric Animationcited by 18
- 2025MIDAS: Multimodal Interactive Digital-humAn Synthesis via Real-time Autoregressive Video Generationcited by 18
- 2024Joker: Conditional 3D Head Synthesis with Extreme Facial Expressionscited by 17
- 2025MVP4D: Multi-View Portrait Video Diffusion for Animatable 4D Avatarscited by 17
- 2026Avatar Forcing: Real-Time Interactive Head Avatar Generation for Natural Conversationcited by 17
- 2025Teller: Real-Time Streaming Audio-Driven Portrait Animation with Autoregressive Motion Generationcited by 16
- 2025CanonSwap: High-Fidelity and Consistent Video Face Swapping via Canonical Space Modulationcited by 16
50 most cited of 131 All 131 (JSON)
- 2026ViDS: Video Diffusion Shader using 3D Face Tracking27 Jul 2026
- 2026FA-LAM: Focus-Aware Large Avatar Model for One-Shot 4D Animatable Gaussian Head23 Jul 2026
- 2026FFAvatar: Feed-Forward 4D Head Avatar Reconstruction from Sparse Portrait Images29 Jun 2026
- 2026SpatialAvatar-0: High-Quality 4D Head Avatar with Multi-Stage Reconstruction14 Jun 2026
- 2026MagPlus: Bridging Micro-to-Regular Facial Expressions through Learnable Magnification11 Jun 2026
- 2026CogPortrait: Fine-Grained Eye-Region Control in Portrait Animation via Hierarchical Agent Planning27 May 2026
- 2026Test-Time Self-Adaptive Conditioning for Stable Audio-Driven Talking-Head Generation25 May 2026
- 2026MeshLAM: Feed-Forward One-Shot Animatable Textured Mesh Avatar Reconstruction23 Apr 2026
- 2026PortraitDirector: A Hierarchical Disentanglement Framework for Controllable and Real-time Facial Reenactment21 Apr 2026
- 2026AvatarPointillist: AutoRegressive 4D Gaussian Avatarization6 Apr 2026
- 2026FG-Portrait: 3D Flow Guided Editable Portrait Animation24 Mar 2026
- 2026PerformRecast: Expression and Head Pose Disentanglement for Portrait Video Editing20 Mar 2026
38 more
- 2026Feed-forward Gaussian Registration for Head Avatar Creation and Editing16 Mar 2026
- 2026OMG-Avatar: One-shot Multi-LOD Gaussian Head Avatar2 Mar 2026
- 2026From Frames to Sequences: Temporally Consistent Human-Centric Dense Prediction2 Feb 2026
- 2026UIKA: Fast Universal Head Avatar from Pose-Free Images12 Jan 2026
- 2026Avatar Forcing: Real-Time Interactive Head Avatar Generation for Natural Conversation2 Jan 2026
- 2025DyStream: Streaming Dyadic Talking Heads Generation via Flow Matching-based Autoregressive Model30 Dec 2025
- 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformation19 Dec 2025
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPS18 Dec 2025
- 2025DeX-Portrait: Disentangled and Expressive Portrait Animation via Explicit and Latent Motion Representations17 Dec 2025
- 2025FactorPortrait: Controllable Portrait Animation via Disentangled Expression, Pose, and Viewpoint12 Dec 2025
- 2025LiveNeRF: Efficient Face Replacement Through Neural Radiance Fields Integration10 Nov 2025
- 2025MVP4D: Multi-View Portrait Video Diffusion for Animatable 4D Avatars14 Oct 2025
- 2025SynchroRaMa : Lip-Synchronized and Emotion-Aware Talking Face Generation via Multi-Modal Emotion Embedding24 Sep 2025
- 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animation20 Sep 2025
- 2025MIDAS: Multimodal Interactive Digital-humAn Synthesis via Real-time Autoregressive Video Generation26 Aug 2025
- 2025X-Actor: Emotional and Expressive Long-Range Portrait Acting from Audio4 Aug 2025
- 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attention30 Jul 2025
- 2025JOLT3D: Joint Learning of Talking Heads and 3DMM Parameters with Application to Lip-Sync28 Jul 2025
- 2025FantasyPortrait: Enhancing Multi-Character Portrait Animation with Expression-Augmented Diffusion Transformers17 Jul 2025
- 2025HairShifter: Consistent and High-Fidelity Video Hair Transfer via Anchor-Guided Animation17 Jul 2025
- 2025MoDA: Multi-modal Diffusion Architecture for Talking Head Generation4 Jul 2025
- 2025CanonSwap: High-Fidelity and Consistent Video Face Swapping via Canonical Space Modulation3 Jul 2025
- 2025FixTalk: Taming Identity Leakage for High-Quality Talking Head Generation in Extreme Cases2 Jul 2025
- 2025Advancing Talking Head Generation: A Comprehensive Survey of Multi-Modal Methodologies, Datasets, Evaluation Metrics, and Loss Functions23 Jun 2025
- 2025Controllable and Expressive One-Shot Video Head Swapping20 Jun 2025
- 2025LLIA -- Enabling Low-Latency Interactive Avatars: Real-Time Audio-Driven Portrait Video Generation with Diffusion Models6 Jun 2025
- 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatar6 May 2025
- 2025IM-Portrait: Learning 3D-aware Video Diffusion for Photorealistic Talking Heads from Monocular Videos27 Apr 2025
- 2025FaceCraft4D: Animated 3D Facial Avatar Generation from a Single Image21 Apr 2025
- 2025Pose and Facial Expression Transfer by using StyleGAN17 Apr 2025
- 2025DiTaiListener: Controllable High Fidelity Listener Video Generation with Diffusion5 Apr 2025
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidance2 Apr 2025
- 2025AvatarArtist: Open-Domain 4D Avatarization25 Mar 2025
- 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animation24 Mar 2025
- 2025Teller: Real-Time Streaming Audio-Driven Portrait Animation with Autoregressive Motion Generation24 Mar 2025
- 2025Controlling Avatar Diffusion with Learnable Gaussian Embedding20 Mar 2025
- 2025FaceShot: Bring Any Character into Life2 Mar 2025
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatars27 Feb 2025
50 newest of 131 All 131 (JSON)
- 2024Loopy: Taming Audio-Driven Portrait Avatar with Long-Term Motion Dependencycited by 102
- 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 88
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
- 2024Ditto: Motion-Space Diffusion for Controllable Realtime Talking Head Synthesiscited by 41
- 2024FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portraitcited by 40
- 2025MVP4D: Multi-View Portrait Video Diffusion for Animatable 4D Avatarscited by 17
- 2025AvatarArtist: Open-Domain 4D Avatarizationcited by 15
- 2025FantasyPortrait: Enhancing Multi-Character Portrait Animation with Expression-Augmented Diffusion Transformerscited by 12
- 2025DiTaiListener: Controllable High Fidelity Listener Video Generation with Diffusioncited by 10
- 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applicationscited by 9
- 2025Playmate: Flexible Control of Portrait Animation via 3D-Implicit Space Guided Diffusioncited by 8
- 2025LLIA -- Enabling Low-Latency Interactive Avatars: Real-Time Audio-Driven Portrait Video Generation with Diffusion Modelscited by 7
12 most cited of 23 All 23 (JSON)
- 2026ViDS: Video Diffusion Shader using 3D Face Tracking27 Jul 2026
- 2025DyStream: Streaming Dyadic Talking Heads Generation via Flow Matching-based Autoregressive Model30 Dec 2025
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPS18 Dec 2025
- 2025DeX-Portrait: Disentangled and Expressive Portrait Animation via Explicit and Latent Motion Representations17 Dec 2025
- 2025FactorPortrait: Controllable Portrait Animation via Disentangled Expression, Pose, and Viewpoint12 Dec 2025
- 2025MVP4D: Multi-View Portrait Video Diffusion for Animatable 4D Avatars14 Oct 2025
- 2025X-Actor: Emotional and Expressive Long-Range Portrait Acting from Audio4 Aug 2025
- 2025FantasyPortrait: Enhancing Multi-Character Portrait Animation with Expression-Augmented Diffusion Transformers17 Jul 2025
- 2025MoDA: Multi-modal Diffusion Architecture for Talking Head Generation4 Jul 2025
- 2025LLIA -- Enabling Low-Latency Interactive Avatars: Real-Time Audio-Driven Portrait Video Generation with Diffusion Models6 Jun 2025
- 2025IM-Portrait: Learning 3D-aware Video Diffusion for Photorealistic Talking Heads from Monocular Videos27 Apr 2025
- 2025DiTaiListener: Controllable High Fidelity Listener Video Generation with Diffusion5 Apr 2025
12 newest of 23 All 23 (JSON)
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
- 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 198
- 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
- 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 186
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 95
- 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesiscited by 93
- 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
- 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
- 2022MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptationcited by 69
- 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
12 most cited of 106 All 106 (JSON)
- 2026FA-LAM: Focus-Aware Large Avatar Model for One-Shot 4D Animatable Gaussian Head23 Jul 2026
- 2026FFAvatar: Feed-Forward 4D Head Avatar Reconstruction from Sparse Portrait Images29 Jun 2026
- 2026SpatialAvatar-0: High-Quality 4D Head Avatar with Multi-Stage Reconstruction14 Jun 2026
- 2026MagPlus: Bridging Micro-to-Regular Facial Expressions through Learnable Magnification11 Jun 2026
- 2026Test-Time Self-Adaptive Conditioning for Stable Audio-Driven Talking-Head Generation25 May 2026
- 2026MeshLAM: Feed-Forward One-Shot Animatable Textured Mesh Avatar Reconstruction23 Apr 2026
- 2026PortraitDirector: A Hierarchical Disentanglement Framework for Controllable and Real-time Facial Reenactment21 Apr 2026
- 2026AvatarPointillist: AutoRegressive 4D Gaussian Avatarization6 Apr 2026
- 2026FG-Portrait: 3D Flow Guided Editable Portrait Animation24 Mar 2026
- 2026PerformRecast: Expression and Head Pose Disentanglement for Portrait Video Editing20 Mar 2026
- 2026Feed-forward Gaussian Registration for Head Avatar Creation and Editing16 Mar 2026
- 2026OMG-Avatar: One-shot Multi-LOD Gaussian Head Avatar2 Mar 2026
12 newest of 106 All 106 (JSON)