AvatarDynamizer: From Static to Dynamic Human Avatars via Generative Dynamic Textures
Not on the map. Why?
Abstract (arXiv)
For full-body avatars, modeling surface dynamics is crucial for overcoming the uncanny valley and achieving perceptual realism. Person-agnostic methods recover static 3D avatars from monocular images, videos, or text prompts, but their skeleton-driven animations lack realistic surface dynamics such as clothing wrinkles. In contrast, person-specific methods achieve high-quality rendering and realistic dynamics, but require expensive multi-view captures for each individual. Recent generalizable dynamic avatar methods struggle to embed surface dynamics, leading to either limited multi-view consistency or dynamic expressiveness. To this end, we propose AvatarDynamizer, a generative method that transforms an off-the-shelf static 3D avatar into a controllable, realistic, and multi-view-consistent 4D avatar. We introduce a novel texture-space surface-dynamics embedding and formulate avatar dynamics modeling as conditional texture generation. Our encoder--decoder representation embeds pose-dependent dynamics into dynamic texture maps, enabling compatibility with pre-trained video diffusion models while decoding them into 3D Gaussians for multi-view consistent rendering. Since existing datasets are limited in scale, sequence length, or motion diversity, we collect a large-scale multi-view dataset with long sequences covering diverse skeletal motions and surface dynamics. Experiments show that our method effectively animates static avatars with faithful surface dynamics and outperforms competing generalizable methods in visual fidelity, especially under limited dynamic training data.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 85 of its 102 references that are in the map. First posted on arXiv 20 Aug 2026.
Builds on
85 of 102 references.
References · 85
- 2017Attention Is All You Needcited by 60,361
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
38 more
- 2017End-to-end Recovery of Human Shape and Posecited by 885
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 695
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 314
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 272
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2018Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodiescited by 239
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
- 2020DeepCap: Monocular Human Performance Capture Using Weak Supervisioncited by 162
- 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
- 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
- 2021Real-time Deep Dynamic Characterscited by 133
- 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
- 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 117
- 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
- 2023TADA! Text to Animatable Digital Avatarscited by 110
- 2023ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Renderingcited by 104
- 2023DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Renderingcited by 103
- 2018Image Inpainting via Generative Multi-column Convolutional Neural Networkscited by 81
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
- 2023High-fidelity 3D Human Digitization from Single 2K Resolution Imagescited by 70
- 2024Human4DiT: 360-degree Human Video Generation with 4D Diffusion Transformercited by 61
- 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Imagecited by 55
- 2021Adversarial Parametric Pose Priorcited by 38
- 2021Neural Free-Viewpoint Performance Rendering under Complex Human-object Interactionscited by 37
- 2023AvatarBooth: High-Quality and Customizable 3D Human Avatar Generationcited by 37
- 2023DELIFFAS: Deformable Light Fields for Fast Avatar Synthesiscited by 36
- 2023PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generationcited by 34
- 2025Vid2Avatar-Pro: Authentic Avatar from Videos in the Wild via Universal Priorcited by 31
50 most cited of 85 All 85 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Generative Relightable Avatars
- 2025ViSA: 3D-Aware Video Shading for Real-Time Upper-Body Avatar Creation
- 2024HR Human: Modeling Human Avatars with Triangular Mesh and High-Resolution Textures from Videos
- 2025HGC-Avatar: Hierarchical Gaussian Compression for Streamable Dynamic 3D Avatars
- 2023AvatarFusion: Zero-shot Generation of Clothing-Decoupled 3D Avatars Using 2D Diffusion
- 2026UNICA: A Unified Neural Framework for Controllable 3D Avatars
- 2023AvatarStudio: High-fidelity and Animatable 3D Avatar Creation from Text
- 2023AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars