mlsanityData to 14 Oct 2026

Large-scale Codec Avatars: The Unreasonable Effectiveness of Large-scale Avatar Pretraining

arXiv 2604.02320 ↗First posted 2 Apr 2026cs.CV cs.GRcited by 3

Not on the map. Why?

Abstract (arXiv)

High-quality 3D avatar modeling faces a critical trade-off between fidelity and generalization. On the one hand, multi-view studio data enables high-fidelity modeling of humans with precise control over expressions and poses, but it struggles to generalize to real-world data due to limited scale and the domain gap between the studio environment and the real world. On the other hand, recent large-scale avatar models trained on millions of in-the-wild samples show promise for generalization across a wide range of identities, yet the resulting avatars are often of low-quality due to inherent 3D ambiguities. To address this, we present Large-Scale Codec Avatars (LCA), a high-fidelity, full-body 3D avatar model that generalizes to world-scale populations in a feedforward manner, enabling efficient inference. Inspired by the success of large language models and vision foundation models, we present, for the first time, a pre/post-training paradigm for 3D avatar modeling at scale: we pretrain on 1M in-the-wild videos to learn broad priors over appearance and geometry, then post-train on high-quality curated data to enhance expressivity and fidelity. LCA generalizes across hair styles, clothing, and demographics while providing precise, fine-grained facial expressions and finger-level articulation control, with strong identity preservation. Notably, we observe emergent generalization to relightability and loose garment support to unconstrained inputs, and zero-shot robustness to stylized imagery, despite the absence of direct supervision.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 59 of its 76 references that are in the map. First posted on arXiv 2 Apr 2026.

Builds on

59 of 76 references.

References · 59

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2022Training language models to follow instructions with human feedbackcited by 15,971
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  7. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  8. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  9. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  10. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  11. 2023Mistral 7Bcited by 3,164
  12. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
38 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  2. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  3. 2025DINOv3cited by 1,414
  4. 2024Genie: Generative Interactive Environmentscited by 747
  5. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  6. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
  7. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
  8. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  9. 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 326
  10. 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
  11. 2024Sapiens: Foundation for Human Vision Modelscited by 229
  12. 2019Understanding and Improving Layer Normalizationcited by 217
  13. 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 187
  14. 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
  15. 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
  16. 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
  17. 2021Pixel Codec Avatarscited by 127
  18. 2023Relightable Gaussian Codec Avatarscited by 127
  19. 2023Drivable 3D Gaussian Avatarscited by 120
  20. 2021Scale Efficiently: Insights from Pre-training and Fine-tuning Transformerscited by 106
  21. 2024Expressive Whole-Body 3D Gaussian Avatarcited by 89
  22. 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 84
  23. 2021Driving-Signal Aware Full-Body Avatarscited by 81
  24. 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 80
  25. 2025LHM: Large Animatable Human Reconstruction Model from a Single Image in Secondscited by 61
  26. 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Imagecited by 55
  27. 2022Learning Implicit Templates for Point-Based Clothed Human Modelingcited by 50
  28. 2024URAvatar: Universal Relightable Gaussian Codec Avatarscited by 43
  29. 2016A Formal Evaluation of PSNR as Quality Measurement Parameter for Image Segmentation Algorithmscited by 42
  30. 2022Predicting Loose-Fitting Garment Deformations Using Bone-Driven Motion Networkscited by 39
  31. 2024DifFRelight: Diffusion-Based Facial Performance Relightingcited by 35
  32. 2023Towards Practical Capture of High-Fidelity Relightable Avatarscited by 34
  33. 2024MeshAvatar: Learning High-quality Triangular Human Avatars from Multi-view Videoscited by 34
  34. 2025Vid2Avatar-Pro: Authentic Avatar from Videos in the Wild via Universal Priorcited by 31
  35. 2024Robust Dual Gaussian Splatting for Immersive Human-centric Volumetric Videoscited by 30
  36. 2024Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRMcited by 23
  37. 2025Relightable Full-Body Gaussian Codec Avatarscited by 22
  38. 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatarcited by 22

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026GenLCA: 3D Diffusion for Full-Body Avatars from In-the-Wild Videos
  2. 2025InfiniHuman: Infinite 3D Human Creation with Precise Control
  3. 2024Instant 3D Human Avatar Generation using Image Diffusion Models
  4. 2026Avatar V: Scaling Video-Reference Avatar Video Generation
  5. 2025GAS: Generative Avatar Synthesis from a Single Image
  6. 2024GenCA: A Text-conditioned Generative Model for Realistic and Drivable Codec Avatars
  7. 2024One Shot, One Talk: Whole-body Talking Avatar from a Single Image
  8. 2026FiCA: Feed-forward instant Gaussian Codec Avatars from a Single Portrait Image