Zero-Shot Reconstruction of Animatable 3D Avatars with Cloth Dynamics from a Single Image
Not on the map. Why?
Abstract (arXiv)
Existing single-image 3D human avatar methods primarily rely on rigid joint transformations, limiting their ability to model realistic cloth dynamics. We present DynaAvatar, a zero-shot framework that reconstructs animatable 3D human avatars with motion-dependent cloth dynamics from a single image. Trained on large-scale multi-person motion datasets, DynaAvatar employs a Transformer-based feed-forward architecture that directly predicts dynamic 3D Gaussian deformations without subject-specific optimization. To overcome the scarcity of dynamic captures, we introduce a static-to-dynamic knowledge transfer strategy: a Transformer pretrained on large-scale static captures provides strong geometric and appearance priors, which are efficiently adapted to motion-dependent deformations through lightweight LoRA fine-tuning on dynamic captures. We further propose the DynaFlow loss, an optical flow-guided objective that provides reliable motion-direction geometric cues for cloth dynamics in rendered space. Finally, we reannotate the missing or noisy SMPL-X fittings in existing dynamic capture datasets, as most public dynamic capture datasets contain incomplete or unreliable fittings that are unsuitable for training high-quality 3D avatar reconstruction models. Experiments demonstrate that DynaAvatar produces visually rich and generalizable animations, outperforming prior methods.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 51 of its 60 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
51 of 60 references.
References · 51
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
38 more
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 190
- 2020DeepCap: Monocular Human Performance Capture Using Weak Supervisioncited by 162
- 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
- 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
- 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatarscited by 105
- 2023DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Renderingcited by 103
- 2024Expressive Whole-Body 3D Gaussian Avatarcited by 89
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 85
- 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 83
- 2021Driving-Signal Aware Full-Body Avatarscited by 81
- 2022HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamicscited by 77
- 2023High-fidelity 3D Human Digitization from Single 2K Resolution Imagescited by 70
- 2024MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modelingcited by 63
- 2024Human4DiT: 360-degree Human Video Generation with 4D Diffusion Transformercited by 61
- 2025LHM: Large Animatable Human Reconstruction Model from a Single Image in Secondscited by 61
- 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Imagecited by 55
- 2023MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Capturescited by 54
- 20244D-DRESS: A 4D Dataset of Real-world Human Clothing with Semantic Annotationscited by 51
- 2024AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstructioncited by 36
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
- 2025SMPLest-X: Ultimate Scaling for Expressive Human Pose and Shape Estimationcited by 31
- 2023REC-MV: REconstructing 3D Dynamic Cloth from Monocular Videoscited by 29
- 2024Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Videocited by 25
- 2024ContourCraft: Learning to Resolve Intersections in Neural Multi-Garment Simulationscited by 23
- 2024ReLoo: Reconstructing Humans Dressed in Loose Garments from Monocular Video in the Wildcited by 19
- 2025X-UniMotion: Animating Human Images with Expressive, Unified and Identity-Agnostic Motion Latentscited by 13
- 2025PERSONA: Personalized Whole-Body 3D Avatar with Pose-Driven Deformations from a Single Imagecited by 13
- 2025Real-time High-fidelity Gaussian Human Avatars with Position-based Interpolation of Spatially Distributed MLPscited by 12
- 2024Within the Dynamic Context: Inertia-aware 3D Human Modeling with Pose Sequencecited by 11
- 2025PGC: Physics-Based Gaussian Cloth from a Single Posecited by 11
- 2025MPMAvatar: Learning 3D Gaussian Avatars with Accurate and Robust Physics-Based Dynamicscited by 8
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.