mlsanityData to 7 Oct 2026

LiftAvatar: Kinematic-Space Completion for Expression-Controlled 3D Gaussian Avatar Animation

arXiv 2603.02129 ↗First posted 2 Mar 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We present LiftAvatar, a new paradigm that completes sparse monocular observations in kinematic space (e.g., facial expressions and head pose) and uses the completed signals to drive high-fidelity avatar animation. LiftAvatar is a fine-grained, expression-controllable large-scale video diffusion Transformer that synthesizes high-quality, temporally coherent expression sequences conditioned on single or multiple reference images. The key idea is to lift incomplete input data into a richer kinematic representation, thereby strengthening both reconstruction and animation in downstream 3D avatar pipelines. To this end, we introduce (i) a multi-granularity expression control scheme that combines shading maps with expression coefficients for precise and stable driving, and (ii) a multi-reference conditioning mechanism that aggregates complementary cues from multiple frames, enabling strong 3D consistency and controllability. As a plug-and-play enhancer, LiftAvatar directly addresses the limited expressiveness and reconstruction artifacts of 3D Gaussian Splatting-based avatars caused by sparse kinematic cues in everyday monocular videos. By expanding incomplete observations into diverse pose-expression variations, LiftAvatar also enables effective prior distillation from large-scale video generative models into 3D pipelines, leading to substantial gains. Extensive experiments show that LiftAvatar consistently boosts animation quality and quantitative metrics of state-of-the-art 3D avatar methods, especially under extreme, unseen expressions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 64 references that are in the map. First posted on arXiv 2 Mar 2026.

Builds on

38 of 64 references.

References · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  6. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  7. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  8. 2020First Order Motion Model for Image Animationcited by 698
  9. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
  10. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
  11. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
  12. 2019Capture, Learning, and Synthesis of 3D Speaking Stylescited by 257
26 more
  1. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
  2. 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
  3. 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
  4. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
  5. 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
  6. 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 171
  7. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 160
  8. 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
  9. 2021Pixel Codec Avatarscited by 125
  10. 2022Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generationcited by 119
  11. 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
  12. 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
  13. 2022Learning Neural Parametric Head Modelscited by 73
  14. 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
  15. 2024BAD-Gaussians: Bundle Adjusted Deblur Gaussian Splattingcited by 61
  16. 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 55
  17. 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 52
  18. 2025Long-Term TalkingFace Generation via Motion-Prior Conditional Diffusion Modelcited by 49
  19. 2023GaussianHead: High-fidelity Head Avatars with Learnable Gaussian Derivationcited by 46
  20. 2025LAM: Large Avatar Model for One-shot Animatable Gaussian Headcited by 43
  21. 2023DiffusionAvatars: Deferred Diffusion for High-fidelity 3D Head Avatarscited by 42
  22. 2024HAHA: Highly Articulated Gaussian Human Avatars with Textured Mesh Priorcited by 30
  23. 2023CVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformercited by 24
  24. 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creationcited by 23
  25. 2024GeneAvatar: Generic Expression-Aware Volumetric Head Avatar Editing from a Single Imagecited by 12
  26. 2024Single Image, Any Face: Generalisable 3D Face Generationcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Dream, Lift, Animate: From Single Images to Animatable Gaussian Avatars
  2. 2024AniFaceDiff: Animating Stylized Avatars via Parametric Conditioned Diffusion Models
  3. 20243D2-Actor: Learning Pose-Conditioned 3D-Aware Denoiser for Realistic Gaussian Avatar Modeling
  4. 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation
  5. 2025AdaHuman: Animatable Detailed 3D Human Generation with Compositional Multiview Diffusion
  6. 2025Instant Expressive Gaussian Head Avatars at Over 100 FPS
  7. 2024E3Gen: Efficient, Expressive and Editable Avatars Generation
  8. 2025SkyReels-A1: Expressive Portrait Animation in Video Diffusion Transformers