4DHumanDiff: Direct Text-to-4DGS Generation for Consistent 360-Degree Dynamic Humans
Not on the map. Why?
Abstract (arXiv)
Generating high-quality 360-degree dynamic human assets from text prompts is challenging. Existing methods usually synthesize monocular or multi-view videos first and then fit a 4D representation, which is expensive and often causes incomplete geometry or view-inconsistent renderings. We present 4DHumanDiff, a diffusion framework that directly generates dynamic humans represented by 4D Gaussian Splatting (4DGS) from text prompts. By modeling the structured 4D representation space end-to-end, 4DHumanDiff avoids video pre-generation and per-scene reconstruction, making it better suited for view-consistent and temporally coherent asset generation. The model uses a 3D U-Net backbone with temporal attention for motion-aware generation. We further construct a large-scale text-to-4DGS dataset with 60,000 high-quality pairs, and introduce 2D regularization and training-free 4D interpolation to improve rendering quality and motion smoothness. Experiments show that 4DHumanDiff generates consistent 360-degree dynamic humans within one minute, achieves better temporal and multi-view consistency, and reduces inference time by more than 10x.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 114 of its 127 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
114 of 127 references.
References · 114
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
38 more
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
- 2018PointConv: Deep Convolutional Networks on 3D Point Cloudscited by 656
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 488
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generationcited by 330
- 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 310
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 211
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2023COLMAP-Free 3D Gaussian Splattingcited by 193
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 190
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
- 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
50 most cited of 114 All 114 (JSON)
Built on by
Not cited yet.