mlsanityData to 7 Oct 2026

Disco4D: Disentangled 4D Human Generation and Animation from a Single Image

arXiv 2409.17280 ↗First posted 25 Sep 2024cs.CVcited by 17

Not on the map. Why?

Abstract (arXiv)

We present Disco4D, a novel Gaussian Splatting framework for 4D human generation and animation from a single image. Different from existing methods, Disco4D distinctively disentangles clothings (with Gaussian models) from the human body (with SMPL-X model), significantly enhancing the generation details and flexibility. It has the following technical innovations. 1) Disco4D learns to efficiently fit the clothing Gaussians over the SMPL-X Gaussians. 2) It adopts diffusion models to enhance the 3D generation process, textite.g., modeling occluded parts not visible in the input image. 3) It learns an identity encoding for each clothing Gaussian to facilitate the separation and extraction of clothing assets. Furthermore, Disco4D naturally supports 4D human animation with vivid dynamics. Extensive experiments demonstrate the superiority of Disco4D on 4D human generation and animation tasks. Our visualizations can be found in urlhttps://disco-4d.github.io/.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 107 of its 124 references that are in the map. First posted on arXiv 25 Sep 2024.

Builds on

107 of 124 references.

References · 107

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  5. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  6. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  8. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  9. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  10. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  11. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  12. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
38 more
  1. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  2. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  3. 2017End-to-end Recovery of Human Shape and Posecited by 883
  4. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  5. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  6. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  7. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  8. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  9. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  10. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  11. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  12. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  13. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  14. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  15. 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
  16. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
  17. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  18. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  19. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  20. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
  21. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
  22. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  23. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  24. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  25. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
  26. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
  27. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 359
  28. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
  29. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
  30. 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
  31. 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 332
  32. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  33. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
  34. 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
  35. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
  36. 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
  37. 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
  38. 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248

50 most cited of 107 All 107 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 7; 2026: 10.

17 papers.

Sort:

By area:

  1. 2025LHM: Large Animatable Human Reconstruction Model from a Single Image in Secondscited by 61
  2. 2025Generative Physical AI in Vision: A Surveycited by 24
  3. 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 14
  4. 2025CharacterShot: Controllable and Consistent 4D Character Animationcited by 9
  5. 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
  6. 2025MonoCloth: Reconstruction and Animation of Cloth-Decoupled Human Avatars from Monocular Videoscited by 3
  7. 2026Light4D: Training-Free Extreme Viewpoint 4D Video Relightingcited by 2
  8. 2026Gaussian Wardrobe: Compositional 3D Gaussian Avatars for Free-Form Virtual Try-Oncited by 2
  9. 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priorscited by 2
  10. 2025Advances in 4D Generation: A Surveycited by 1
  11. 2026Ani3DHuman: Photorealistic 3D Human Animation with Self-guided Stochastic Samplingcited by 1
  12. 2026Visually-grounded Humanoid Agentscited by 1
5 more
  1. 2026DAMA: Disentangled Body-Anchored Gaussians for Controllable Multi-Layered Avatarscited by 1
  2. 2026One-Shot Novel View and Pose Human Image Synthesis via 3D Prior Guided Diffusion Modelcited by 1
  3. 2026Information-Regularized Constrained Inversion for Stable Avatar Editing from Sparse Supervisioncited by 0
  4. 2026Alignment Is All You Need For X-to-4D Generationcited by 0
  5. 2026Forwardrobe: Garment-Aware Gaussian Avatars from a Single Imagecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Splat4D: Diffusion-Enhanced 4D Gaussian Splatting for Temporally and Spatially Consistent Content Creation
  2. 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Model
  3. 2025HuGeDiff: 3D Human Generation via Diffusion with Gaussian Splatting
  4. 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priors
  5. 2025Diff4Splat: Controllable 4D Scene Generation with Latent Dynamic Reconstruction Models
  6. 2024GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Details
  7. 2024Human-VDM: Learning Single-Image 3D Human Gaussian Splatting from Video Diffusion Models
  8. 2025GaussianIP: Identity-Preserving Realistic 3D Human Generation via Human-Centric Diffusion Prior