SIGMAN:Scaling 3D Human Gaussian Generation with Millions of Assets
Not on the map. Why?
Abstract (arXiv)
3D human digitization has long been a highly pursued yet challenging task. Existing methods aim to generate high-quality 3D digital humans from single or multiple views, but remain primarily constrained by current paradigms and the scarcity of 3D human assets. Specifically, recent approaches fall into several paradigms: optimization-based and feed-forward (both single-view regression and multi-view generation with reconstruction). However, they are limited by slow speed, low quality, cascade reasoning, and ambiguity in mapping low-dimensional planes to high-dimensional space due to occlusion and invisibility, respectively. Furthermore, existing 3D human assets remain small-scale, insufficient for large-scale training. To address these challenges, we propose a latent space generation paradigm for 3D human digitization, which involves compressing multi-view images into Gaussians via a UV-structured VAE, along with DiT-based conditional generation, we transform the ill-posed low-to-high-dimensional mapping problem into a learnable distribution shift, which also supports end-to-end inference. In addition, we employ the multi-view optimization approach combined with synthetic data to construct the HGS-1M dataset, which contains 1 million 3D Gaussian assets to support the large-scale training. Experimental results demonstrate that our paradigm, powered by large-scale training, produces high-quality 3D human Gaussians with intricate textures, facial details, and loose clothing deformation.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 73 of its 94 references that are in the map. First posted on arXiv 9 Apr 2025.
Builds on
73 of 94 references.
References · 73
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
38 more
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2019Root Mean Square Layer Normalizationcited by 1,480
- 2022Human Motion Diffusion Modelcited by 1,080
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 332
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
- 2019DeepHuman: 3D Human Reconstruction from a Single Imagecited by 182
- 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
- 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
- 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
- 2016Variational Autoencoder for Deep Learning of Images, Labels and Captionscited by 137
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 117
- 2024Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Modelscited by 116
- 2021HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputscited by 112
- 2023DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Renderingcited by 103
- 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
- 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
- 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
- 2023High-fidelity 3D Human Digitization from Single 2K Resolution Imagescited by 70
- 2024MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modelingcited by 64
- 2024WF-VAE: Enhancing Video VAE by Wavelet-Driven Energy Flow for Latent Video Diffusion Modelcited by 57
- 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Imagecited by 55
- 2023MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Capturescited by 54
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2025: 6; 2026: 6.
12 papers.
- 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 68
- 2025SyncHuman: Synchronizing 2D and 3D Generative Models for Single-view Human Reconstructioncited by 9
- 2025LHM++: An Efficient Large Human Reconstruction Model for Pose-free Images to 3Dcited by 6
- 2026Gloria: Consistent Character Video Generation via Content Anchorscited by 3
- 2025Snap-Snap: Taking Two Images to Reconstruct 3D Human Gaussians in Millisecondscited by 2
- 2025HuGeDiff: 3D Human Generation via Diffusion with Gaussian Splattingcited by 1
- 2026End-to-End Spatial-Temporal Transformer for Real-time 4D HOI Reconstructioncited by 1
- 2026GenLCA: 3D Diffusion for Full-Body Avatars from In-the-Wild Videoscited by 1
- 2026Large-Scale High-Quality 3D Gaussian Head Reconstruction from Multi-View Capturescited by 1
- 2026LogiShot: Logically Coherent Cross-Shot Video Generationcited by 1
- 2025NoPo-Avatar: Generalizable and Animatable Avatars from Sparse Inputs without Human Posescited by 0
- 2026HumanNOVA: Photorealistic, Universal and Rapid 3D Human Avatar Modeling from a Single Imagecited by 0
- 2026LogiShot: Logically Coherent Cross-Shot Video Generation9 Aug 2026
- 2026HumanNOVA: Photorealistic, Universal and Rapid 3D Human Avatar Modeling from a Single Image1 Jun 2026
- 2026Large-Scale High-Quality 3D Gaussian Head Reconstruction from Multi-View Captures5 May 2026
- 2026GenLCA: 3D Diffusion for Full-Body Avatars from In-the-Wild Videos8 Apr 2026
- 2026Gloria: Consistent Character Video Generation via Content Anchors31 Mar 2026
- 2026End-to-End Spatial-Temporal Transformer for Real-time 4D HOI Reconstruction15 Mar 2026
- 2025NoPo-Avatar: Generalizable and Animatable Avatars from Sparse Inputs without Human Poses20 Nov 2025
- 2025SyncHuman: Synchronizing 2D and 3D Generative Models for Single-view Human Reconstruction9 Oct 2025
- 2025Snap-Snap: Taking Two Images to Reconstruct 3D Human Gaussians in Milliseconds20 Aug 2025
- 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Data9 Jul 2025
- 2025LHM++: An Efficient Large Human Reconstruction Model for Pose-free Images to 3D16 Jun 2025
- 2025HuGeDiff: 3D Human Generation via Diffusion with Gaussian Splatting4 Jun 2025