Dream, Lift, Animate: From Single Images to Animatable Gaussian Avatars
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
We introduce Dream, Lift, Animate (DLA), a novel framework that reconstructs animatable 3D human avatars from a single image. This is achieved by leveraging multi-view generation, 3D Gaussian lifting, and pose-aware UV-space mapping of 3D Gaussians. Given an image, we first dream plausible multi-views using a video diffusion model, capturing rich geometric and appearance details. These views are then lifted into unstructured 3D Gaussians. To enable animation, we propose a transformer-based encoder that models global spatial relationships and projects these Gaussians into a structured latent representation aligned with the UV space of a parametric body model. This latent code is decoded into UV-space Gaussians that can be animated via body-driven deformation and rendered conditioned on pose and viewpoint. By anchoring Gaussians to the UV manifold, our method ensures consistency during animation while preserving fine visual details. DLA enables real-time rendering and intuitive editing without requiring post-processing. Our method outperforms state-of-the-art approaches on the ActorsHQ and 4D-Dress datasets in both perceptual quality and photometric accuracy. By combining the generative strengths of video diffusion models with a pose-aware UV-space Gaussian mapping, DLA bridges the gap between unstructured 3D representations and high-fidelity, animation-ready avatars.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 76 of its 89 references that are in the map. First posted on arXiv 21 Jul 2025.
Builds on
76 of 89 references.
Closest ancestors · 16
Same direction, newest first
- 2025GAS: Generative Avatar Synthesis from a Single Image10 Feb
- 2024Human-VDM: Learning Single-Image 3D Human Gaussian Splatting from Video Diffusion Models4 Sep
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models12 Jun
- 2024Instant 3D Human Avatar Generation using Image Diffusion Models11 Jun
- 2024Portrait3D: Text-Guided High-Quality 3D Portrait Generation Using Pyramid Representation and GANs Prior16 Apr
- 2024StructLDM: Structured Latent Diffusion for 3D Human Generation1 Apr
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion18 Mar
- 2023PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generation7 Dec
- 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusion28 Nov
- 2023SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion27 Nov
- 2023Single-Image 3D Human Digitization with Shape-Guided Diffusion15 Nov
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model10 Nov
4 more
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humans16 Aug
- 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatars16 Mar
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
Other references · 60
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2017Neural Discrete Representation Learningcited by 4,650
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
38 more
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
- 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
- 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
- 2022Generative Neural Articulated Radiance Fieldscited by 101
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
- 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
- 2022Unsupervised Learning of Efficient Geometry-Aware Neural Articulated Representationscited by 65
- 2023Gaussian Shell Maps for Efficient 3D Human Generationcited by 61
- 2025LHM: Large Animatable Human Reconstruction Model from a Single Image in Secondscited by 61
- 2023AG3D: Learning to Generate 3D Avatars from 2D Image Collectionscited by 55
- 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Imagecited by 55
- 2023Learning Locally Editable Virtual Humanscited by 54
- 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
- 20244D-DRESS: A 4D Dataset of Real-world Human Clothing with Semantic Annotationscited by 51
- 2023Global-correlated 3D-decoupling Transformer for Clothed Avatar Reconstructioncited by 42
- 2022One-shot Implicit Animatable Avatars with Model-based Priorscited by 38
- 2023Preface: A Data-driven Volumetric Prior for Few-shot Ultra High-resolution Face Synthesiscited by 37
- 2024Cafca: High-quality Novel View Synthesis of Expressive Faces from Casual Few-shot Capturescited by 34
- 2021VariTex: Variational Neural Face Texturescited by 30
- 2024Generalizable Human Gaussians from Single-View Imagecited by 29
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Bringing Your Portrait to 3D Presencecited by 3
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priorscited by 2
- 2026Information-Regularized Constrained Inversion for Stable Avatar Editing from Sparse Supervisioncited by 0
- 2026DiGS-Avatar: Single-Image Animatable 3D Human Reconstruction via UV-Space Diffusioncited by 0
- 2026DiGS-Avatar: Single-Image Animatable 3D Human Reconstruction via UV-Space Diffusion21 Aug 2026
- 2026Information-Regularized Constrained Inversion for Stable Avatar Editing from Sparse Supervision3 Apr 2026
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priors18 Mar 2026
- 2025Bringing Your Portrait to 3D Presence27 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026LiftAvatar: Kinematic-Space Completion for Expression-Controlled 3D Gaussian Avatar Animation
- 2025GaussianMotion: End-to-End Learning of Animatable Gaussian Avatars with Pose Guidance from Text
- 2026FastGHA: Generalized Few-Shot 3D Gaussian Head Avatars with Real-Time Animation
- 2024E3Gen: Efficient, Expressive and Editable Avatars Generation
- 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation
- 2024DreamWaltz-G: Expressive 3D Gaussian Avatars from Skeleton-Guided 2D Diffusion
- 2024HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting
- 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusion