mlsanityData to 14 Oct 2026

SIGMAN:Scaling 3D Human Gaussian Generation with Millions of Assets

arXiv 2504.06982 ↗First posted 9 Apr 2025cs.CVcited by 12

Not on the map. Why?

Abstract (arXiv)

3D human digitization has long been a highly pursued yet challenging task. Existing methods aim to generate high-quality 3D digital humans from single or multiple views, but remain primarily constrained by current paradigms and the scarcity of 3D human assets. Specifically, recent approaches fall into several paradigms: optimization-based and feed-forward (both single-view regression and multi-view generation with reconstruction). However, they are limited by slow speed, low quality, cascade reasoning, and ambiguity in mapping low-dimensional planes to high-dimensional space due to occlusion and invisibility, respectively. Furthermore, existing 3D human assets remain small-scale, insufficient for large-scale training. To address these challenges, we propose a latent space generation paradigm for 3D human digitization, which involves compressing multi-view images into Gaussians via a UV-structured VAE, along with DiT-based conditional generation, we transform the ill-posed low-to-high-dimensional mapping problem into a learnable distribution shift, which also supports end-to-end inference. In addition, we employ the multi-view optimization approach combined with synthetic data to construct the HGS-1M dataset, which contains 1 million 3D Gaussian assets to support the large-scale training. Experimental results demonstrate that our paradigm, powered by large-scale training, produces high-quality 3D human Gaussians with intricate textures, facial details, and loose clothing deformation.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 73 of its 94 references that are in the map. First posted on arXiv 9 Apr 2025.

Builds on

73 of 94 references.

References · 73

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2022Classifier-Free Diffusion Guidancecited by 5,847
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  10. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  11. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  12. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
38 more
  1. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  2. 2019Root Mean Square Layer Normalizationcited by 1,480
  3. 2022Human Motion Diffusion Modelcited by 1,080
  4. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  5. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  6. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  7. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  8. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  9. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  10. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  11. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  12. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  13. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  14. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 332
  15. 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
  16. 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
  17. 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
  18. 2024Sapiens: Foundation for Human Vision Modelscited by 229
  19. 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
  20. 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
  21. 2019DeepHuman: 3D Human Reconstruction from a Single Imagecited by 182
  22. 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
  23. 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
  24. 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
  25. 2016Variational Autoencoder for Deep Learning of Images, Labels and Captionscited by 137
  26. 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 117
  27. 2024Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Modelscited by 116
  28. 2021HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputscited by 112
  29. 2023DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Renderingcited by 103
  30. 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
  31. 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
  32. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
  33. 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
  34. 2023High-fidelity 3D Human Digitization from Single 2K Resolution Imagescited by 70
  35. 2024MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modelingcited by 64
  36. 2024WF-VAE: Enhancing Video VAE by Wavelet-Driven Energy Flow for Latent Video Diffusion Modelcited by 57
  37. 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Imagecited by 55
  38. 2023MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Capturescited by 54

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 6.

12 papers.