mlsanityData to 7 Oct 2026

Dream, Lift, Animate: From Single Images to Animatable Gaussian Avatars

arXiv 2507.15979 ↗First posted 21 Jul 2025cs.GR cs.AIcited by 4

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We introduce Dream, Lift, Animate (DLA), a novel framework that reconstructs animatable 3D human avatars from a single image. This is achieved by leveraging multi-view generation, 3D Gaussian lifting, and pose-aware UV-space mapping of 3D Gaussians. Given an image, we first dream plausible multi-views using a video diffusion model, capturing rich geometric and appearance details. These views are then lifted into unstructured 3D Gaussians. To enable animation, we propose a transformer-based encoder that models global spatial relationships and projects these Gaussians into a structured latent representation aligned with the UV space of a parametric body model. This latent code is decoded into UV-space Gaussians that can be animated via body-driven deformation and rendered conditioned on pose and viewpoint. By anchoring Gaussians to the UV manifold, our method ensures consistency during animation while preserving fine visual details. DLA enables real-time rendering and intuitive editing without requiring post-processing. Our method outperforms state-of-the-art approaches on the ActorsHQ and 4D-Dress datasets in both perceptual quality and photometric accuracy. By combining the generative strengths of video diffusion models with a pose-aware UV-space Gaussian mapping, DLA bridges the gap between unstructured 3D representations and high-fidelity, animation-ready avatars.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 76 of its 89 references that are in the map. First posted on arXiv 21 Jul 2025.

Builds on

76 of 89 references.

Closest ancestors · 16

Same direction, newest first

  1. 2025GAS: Generative Avatar Synthesis from a Single Image10 Feb
  2. 2024Human-VDM: Learning Single-Image 3D Human Gaussian Splatting from Video Diffusion Models4 Sep
  3. 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models12 Jun
  4. 2024Instant 3D Human Avatar Generation using Image Diffusion Models11 Jun
  5. 2024Portrait3D: Text-Guided High-Quality 3D Portrait Generation Using Pyramid Representation and GANs Prior16 Apr
  6. 2024StructLDM: Structured Latent Diffusion for 3D Human Generation1 Apr
  7. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion18 Mar
  8. 2023PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generation7 Dec
  9. 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusion28 Nov
  10. 2023SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion27 Nov
  11. 2023Single-Image 3D Human Digitization with Shape-Guided Diffusion15 Nov
  12. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model10 Nov
4 more
  1. 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humans16 Aug
  2. 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatars16 Mar
  3. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan
  4. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 60

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  7. 2022Flow Matching for Generative Modelingcited by 5,426
  8. 2017Neural Discrete Representation Learningcited by 4,650
  9. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  10. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  12. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
38 more
  1. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  2. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  3. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  4. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  5. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  6. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  7. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
  8. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  9. 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
  10. 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
  11. 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
  12. 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
  13. 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
  14. 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
  15. 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
  16. 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
  17. 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
  18. 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
  19. 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
  20. 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
  21. 2022Generative Neural Articulated Radiance Fieldscited by 101
  22. 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
  23. 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
  24. 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
  25. 2022Unsupervised Learning of Efficient Geometry-Aware Neural Articulated Representationscited by 65
  26. 2023Gaussian Shell Maps for Efficient 3D Human Generationcited by 61
  27. 2025LHM: Large Animatable Human Reconstruction Model from a Single Image in Secondscited by 61
  28. 2023AG3D: Learning to Generate 3D Avatars from 2D Image Collectionscited by 55
  29. 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Imagecited by 55
  30. 2023Learning Locally Editable Virtual Humanscited by 54
  31. 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
  32. 20244D-DRESS: A 4D Dataset of Real-world Human Clothing with Semantic Annotationscited by 51
  33. 2023Global-correlated 3D-decoupling Transformer for Clothed Avatar Reconstructioncited by 42
  34. 2022One-shot Implicit Animatable Avatars with Model-based Priorscited by 38
  35. 2023Preface: A Data-driven Volumetric Prior for Few-shot Ultra High-resolution Face Synthesiscited by 37
  36. 2024Cafca: High-quality Novel View Synthesis of Expressive Faces from Casual Few-shot Capturescited by 34
  37. 2021VariTex: Variational Neural Face Texturescited by 30
  38. 2024Generalizable Human Gaussians from Single-View Imagecited by 29

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026LiftAvatar: Kinematic-Space Completion for Expression-Controlled 3D Gaussian Avatar Animation
  2. 2025GaussianMotion: End-to-End Learning of Animatable Gaussian Avatars with Pose Guidance from Text
  3. 2026FastGHA: Generalized Few-Shot 3D Gaussian Head Avatars with Real-Time Animation
  4. 2024E3Gen: Efficient, Expressive and Editable Avatars Generation
  5. 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation
  6. 2024DreamWaltz-G: Expressive 3D Gaussian Avatars from Skeleton-Guided 2D Diffusion
  7. 2024HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting
  8. 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusion