mlsanityData to 14 Oct 2026

Realistic One-shot Mesh-based Head Avatars

arXiv 2206.08343 ↗First posted 16 Jun 2022cs.CV cs.GRcited by 119

Not on the map. Why?

Abstract (arXiv)

We present a system for realistic one-shot mesh-based human head avatars creation, ROME for short. Using a single photograph, our model estimates a person-specific head mesh and the associated neural texture, which encodes both local photometric and geometric details. The resulting avatars are rigged and can be rendered using a neural network, which is trained alongside the mesh and texture estimators on a dataset of in-the-wild videos. In the experiments, we observe that our system performs competitively both in terms of head geometry recovery and the quality of renders, especially for the cross-person reenactment. See results https://samsunglabs.github.io/rome/

Key facts. Cited by 119 papers in the map (data through 14 Oct 2026). Builds on 54 of its 69 references that are in the map. First posted on arXiv 16 Jun 2022.

Builds on

54 of 69 references.

References · 54

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  7. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  8. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  9. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  10. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  11. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
  12. 2016Identity Mappings in Deep Residual Networkscited by 1,965
38 more
  1. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
  2. 2018Group Normalizationcited by 1,524
  3. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,198
  4. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
  5. 2017VGGFace2: A dataset for recognising faces across pose and agecited by 914
  6. 2018VoxCeleb2: Deep Speaker Recognitioncited by 875
  7. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
  8. 2020First Order Motion Model for Image Animationcited by 704
  9. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
  10. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
  11. 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 525
  12. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  13. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
  14. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
  15. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
  16. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
  17. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  18. 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
  19. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  20. 20193D Morphable Face Models -- Past, Present and Futurecited by 270
  21. 2018Deep Video Portraitscited by 267
  22. 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
  23. 2020Towards Fast, Accurate and Stable 3D Dense Face Alignmentcited by 219
  24. 2021Neural Head Avatars from Monocular RGB Videoscited by 213
  25. 2022Thin-Plate Spline Motion Model for Image Animationcited by 210
  26. 2019Few-shot Video-to-Video Synthesiscited by 197
  27. 2019Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervisioncited by 176
  28. 2019Neural Volumes: Learning Dynamic Renderable Volumes from Imagescited by 173
  29. 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
  30. 2018Deep Appearance Models for Face Renderingcited by 164
  31. 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
  32. 2020Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatarscited by 118
  33. 2016Regressing Robust and Discriminative 3D Morphable Models with a very Deep Neural Networkcited by 109
  34. 2020i3DMM: Deep Implicit 3D Morphable Model of Human Headscited by 109
  35. 2019Three-D Safari: Learning to Estimate Zebra Pose, Shape, and Texture from Images "In the Wild"cited by 106
  36. 2021Neural Lumigraph Renderingcited by 105
  37. 2021H3D-Net: Few-Shot High-Fidelity 3D Head Reconstructioncited by 81
  38. 2021SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elementscited by 72

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 6; 2023: 33; 2024: 31; 2025: 32; 2026: 17.

119 papers.

Sort:

By area:

  1. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 206
  2. 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 184
  3. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
  4. 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
  5. 2024Generalizable and Animatable Gaussian Head Avatarcited by 97
  6. 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 91
  7. 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
  8. 2024EDTalk: Efficient Disentanglement for Emotional Talking Head Synthesiscited by 80
  9. 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
  10. 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
  11. 2022MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptationcited by 69
  12. 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
38 more
  1. 2024EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatarscited by 66
  2. 2023Real-Time Radiance Fields for Single-Image Portrait View Synthesiscited by 64
  3. 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
  4. 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 61
  5. 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 59
  6. 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
  7. 2023NOFA: NeRF-based One-shot Facial Avatar Reconstructioncited by 53
  8. 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 53
  9. 2023StyleAvatar: Real-time Photo-realistic Portrait Avatar from a Single Videocited by 52
  10. 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
  11. 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatarcited by 50
  12. 2023HeadSculpt: Crafting 3D Head Avatars with Textcited by 49
  13. 2023HyperReenact: One-Shot Reenactment via Jointly Learning to Refine and Retarget Facescited by 48
  14. 2023Learning Disentangled Avatars with Hybrid 3D Representationscited by 44
  15. 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
  16. 2023Neural Haircut: Prior-Guided Strand-Based Hair Reconstructioncited by 43
  17. 2025LAM: Large Avatar Model for One-shot Animatable Gaussian Headcited by 43
  18. 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 43
  19. 2023High-Fidelity and Freely Controllable Talking Head Video Generationcited by 42
  20. 2023DiffusionAvatars: Deferred Diffusion for High-fidelity 3D Head Avatarscited by 42
  21. 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
  22. 2023HHAvatar: Gaussian Head Avatar with Dynamic Hairscited by 35
  23. 2023VOODOO 3D: Volumetric Portrait Disentanglement for One-Shot 3D Head Reenactmentcited by 33
  24. 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatarscited by 29
  25. 2023AI-Generated Content (AIGC) for Various Data Modalities: A Surveycited by 25
  26. 2024Lite2Relight: 3D-aware Single Image Portrait Relightingcited by 25
  27. 2023CVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformercited by 24
  28. 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creationcited by 23
  29. 2023Generalizable One-shot Neural Head Avatarcited by 21
  30. 2022DINER: Depth-aware Image-based NEural Radiance fieldscited by 19
  31. 2023InvertAvatar: Incremental GAN Inversion for Generalized Head Avatarscited by 19
  32. 2024Joker: Conditional 3D Head Synthesis with Extreme Facial Expressionscited by 18
  33. 2024PSAvatar: A Point-based Shape Model for Real-Time Head Avatar Animation with 3D Gaussian Splattingcited by 17
  34. 2024GaussianTalker: Real-Time High-Fidelity Talking Head Synthesis with Audio-Driven 3D Gaussian Splattingcited by 17
  35. 2023Single-Shot Implicit Morphable Faces with Consistent Texture Parameterizationcited by 16
  36. 2024Learning to Generate Conditional Tri-plane for 3D-aware Expression Controllable Portrait Animationcited by 15
  37. 2024SurFhead: Affine Rig Blending for Geometrically Accurate 2D Gaussian Surfel Head Avatarscited by 15
  38. 2023Neural Point-based Volumetric Avatar: Surface-guided Neural Points for Efficient and Photorealistic Volumetric Head Avatarcited by 14

50 most cited of 119 All 119 (JSON)