AvatarPointillist: AutoRegressive 4D Gaussian Avatarization
Not on the map. Why?
Abstract (arXiv)
We introduce AvatarPointillist, a novel framework for generating dynamic 4D Gaussian avatars from a single portrait image. At the core of our method is a decoder-only Transformer that autoregressively generates a point cloud for 3D Gaussian Splatting. This sequential approach allows for precise, adaptive construction, dynamically adjusting point density and the total number of points based on the subject's complexity. During point generation, the AR model also jointly predicts per-point binding information, enabling realistic animation. After generation, a dedicated Gaussian decoder converts the points into complete, renderable Gaussian attributes. We demonstrate that conditioning the decoder on the latent features from the AR generator enables effective interaction between stages and markedly improves fidelity. Extensive experiments validate that AvatarPointillist produces high-quality, photorealistic, and controllable avatars. We believe this autoregressive formulation represents a new paradigm for avatar generation, and we will release our code inspire future research.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 80 of its 89 references that are in the map. First posted on arXiv 6 Apr 2026.
Builds on
80 of 89 references.
References · 80
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Generative Adversarial Networkscited by 5,603
- 2017Neural Discrete Representation Learningcited by 4,650
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
38 more
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2020First Order Motion Model for Image Animationcited by 698
- 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
- 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
- 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
- 2021Motion Representations for Articulated Animationcited by 253
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
- 2021Neural Head Avatars from Monocular RGB Videoscited by 212
- 2022Thin-Plate Spline Motion Model for Image Animationcited by 209
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2018Animating Arbitrary Objects via Deep Motion Transfercited by 206
- 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
- 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 198
- 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
- 2024AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animationcited by 191
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
- 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 186
- 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 183
- 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 177
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 174
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
- 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
- 2022Instant Volumetric Head Avatarscited by 157
- 2022MegaPortraits: One-shot Megapixel Neural Head Avatarscited by 131
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 107
- 2020Neural Head Reenactment with Latent Pose Descriptorscited by 106
- 2018PointGrow: Autoregressively Learned Point Cloud Generation with Self-Attentioncited by 105
- 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 95
- 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
50 most cited of 80 All 80 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.