OMG-Avatar: One-shot Multi-LOD Gaussian Head Avatar
Not on the map. Why?
Abstract (arXiv)
We propose OMG-Avatar, a novel One-shot method that leverages a Multi-LOD (Level-of-Detail) Gaussian representation for animatable 3D head reconstruction from a single image in 0.2s. Our method enables LOD head avatar modeling using a unified model that accommodates diverse hardware capabilities and inference speed requirements. To capture both global and local facial characteristics, we employ a transformer-based architecture for global feature extraction and projection-based sampling for local feature acquisition. These features are effectively fused under the guidance of a depth buffer, ensuring occlusion plausibility. We further introduce a coarse-to-fine learning paradigm to support Level-of-Detail functionality and enhance the perception of hierarchical details. To address the limitations of 3DMMs in modeling non-head regions such as the shoulders, we introduce a multi-region decomposition scheme in which the head and shoulders are predicted separately and then integrated through cross-region combination. Extensive experiments demonstrate that OMG-Avatar outperforms state-of-the-art methods in reconstruction quality, reenactment performance, and computational efficiency. The project homepage is https://human3daigc.github.io/OMGAvatar_project_page/ .
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 62 of its 74 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
62 of 74 references.
References · 62
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 2020First Order Motion Model for Image Animationcited by 698
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524
- 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
- 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
38 more
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
- 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 256
- 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
- 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 202
- 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
- 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 198
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
- 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 183
- 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 177
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 174
- 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
- 2022Instant Volumetric Head Avatarscited by 157
- 2017Morphable Face Models - An Open Frameworkcited by 138
- 2022MegaPortraits: One-shot Megapixel Neural Head Avatarscited by 131
- 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
- 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 107
- 2020Neural Head Reenactment with Latent Pose Descriptorscited by 106
- 2024Loopy: Taming Audio-Driven Portrait Avatar with Long-Term Motion Dependencycited by 102
- 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
- 2024Hallo2: Long-Duration and High-Resolution Audio-Driven Portrait Image Animationcited by 95
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 95
- 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesiscited by 93
- 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
- 2022MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptationcited by 69
- 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
- 2023OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Renderingcited by 67
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
- 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
- 2024HiSplat: Hierarchical 3D Gaussian Splatting for Generalizable Sparse-View Reconstructioncited by 55
- 2023NOFA: NeRF-based One-shot Facial Avatar Reconstructioncited by 53
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 52
- 2023Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB Videoscited by 44
- 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.