Large-scale Codec Avatars: The Unreasonable Effectiveness of Large-scale Avatar Pretraining
Not on the map. Why?
Abstract (arXiv)
High-quality 3D avatar modeling faces a critical trade-off between fidelity and generalization. On the one hand, multi-view studio data enables high-fidelity modeling of humans with precise control over expressions and poses, but it struggles to generalize to real-world data due to limited scale and the domain gap between the studio environment and the real world. On the other hand, recent large-scale avatar models trained on millions of in-the-wild samples show promise for generalization across a wide range of identities, yet the resulting avatars are often of low-quality due to inherent 3D ambiguities. To address this, we present Large-Scale Codec Avatars (LCA), a high-fidelity, full-body 3D avatar model that generalizes to world-scale populations in a feedforward manner, enabling efficient inference. Inspired by the success of large language models and vision foundation models, we present, for the first time, a pre/post-training paradigm for 3D avatar modeling at scale: we pretrain on 1M in-the-wild videos to learn broad priors over appearance and geometry, then post-train on high-quality curated data to enhance expressivity and fidelity. LCA generalizes across hair styles, clothing, and demographics while providing precise, fine-grained facial expressions and finger-level articulation control, with strong identity preservation. Notably, we observe emergent generalization to relightability and loose garment support to unconstrained inputs, and zero-shot robustness to stylized imagery, despite the absence of direct supervision.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 59 of its 76 references that are in the map. First posted on arXiv 2 Apr 2026.
Builds on
59 of 76 references.
References · 59
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2023Mistral 7Bcited by 3,164
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
38 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2025DINOv3cited by 1,414
- 2024Genie: Generative Interactive Environmentscited by 747
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 326
- 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2019Understanding and Improving Layer Normalizationcited by 217
- 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 187
- 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
- 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
- 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
- 2021Pixel Codec Avatarscited by 127
- 2023Relightable Gaussian Codec Avatarscited by 127
- 2023Drivable 3D Gaussian Avatarscited by 120
- 2021Scale Efficiently: Insights from Pre-training and Fine-tuning Transformerscited by 106
- 2024Expressive Whole-Body 3D Gaussian Avatarcited by 89
- 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 84
- 2021Driving-Signal Aware Full-Body Avatarscited by 81
- 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 80
- 2025LHM: Large Animatable Human Reconstruction Model from a Single Image in Secondscited by 61
- 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Imagecited by 55
- 2022Learning Implicit Templates for Point-Based Clothed Human Modelingcited by 50
- 2024URAvatar: Universal Relightable Gaussian Codec Avatarscited by 43
- 2016A Formal Evaluation of PSNR as Quality Measurement Parameter for Image Segmentation Algorithmscited by 42
- 2022Predicting Loose-Fitting Garment Deformations Using Bone-Driven Motion Networkscited by 39
- 2024DifFRelight: Diffusion-Based Facial Performance Relightingcited by 35
- 2023Towards Practical Capture of High-Fidelity Relightable Avatarscited by 34
- 2024MeshAvatar: Learning High-quality Triangular Human Avatars from Multi-view Videoscited by 34
- 2025Vid2Avatar-Pro: Authentic Avatar from Videos in the Wild via Universal Priorcited by 31
- 2024Robust Dual Gaussian Splatting for Immersive Human-centric Volumetric Videoscited by 30
- 2024Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRMcited by 23
- 2025Relightable Full-Body Gaussian Codec Avatarscited by 22
- 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatarcited by 22
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026GenLCA: 3D Diffusion for Full-Body Avatars from In-the-Wild Videos
- 2025InfiniHuman: Infinite 3D Human Creation with Precise Control
- 2024Instant 3D Human Avatar Generation using Image Diffusion Models
- 2026Avatar V: Scaling Video-Reference Avatar Video Generation
- 2025GAS: Generative Avatar Synthesis from a Single Image
- 2024GenCA: A Text-conditioned Generative Model for Realistic and Drivable Codec Avatars
- 2024One Shot, One Talk: Whole-body Talking Avatar from a Single Image
- 2026FiCA: Feed-forward instant Gaussian Codec Avatars from a Single Portrait Image