mlsanityData to 14 Oct 2026

DreamGaussian4D: Generative 4D Gaussian Splatting

arXiv 2312.17142 ↗First posted 28 Dec 2023cs.CV cs.GRcited by 194

Not on the map. Why?

Cited by 51 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

4D content generation has achieved remarkable progress recently. However, existing methods suffer from long optimization times, a lack of motion controllability, and a low quality of details. In this paper, we introduce DreamGaussian4D (DG4D), an efficient 4D generation framework that builds on Gaussian Splatting (GS). Our key insight is that combining explicit modeling of spatial transformations with static GS makes an efficient and powerful representation for 4D generation. Moreover, video generation methods have the potential to offer valuable spatial-temporal priors, enhancing the high-quality 4D generation. Specifically, we propose an integral framework with two major modules: 1) Image-to-4D GS - we initially generate static GS with DreamGaussianHD, followed by HexPlane-based dynamic generation with Gaussian deformation; and 2) Video-to-Video Texture Refinement - we refine the generated UV-space texture maps and meanwhile enhance their temporal consistency by utilizing a pre-trained image-to-video diffusion model. Notably, DG4D reduces the optimization time from several hours to just a few minutes, allows the generated 3D motion to be visually controlled, and produces animated meshes that can be realistically rendered in 3D engines.

Key facts. Cited by 194 papers in the map (data through 14 Oct 2026). Builds on 53 of its 60 references that are in the map. First posted on arXiv 28 Dec 2023.

Builds on

53 of 60 references.

References · 53

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  5. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  7. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  8. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  9. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  10. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  11. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  12. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
38 more
  1. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  2. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  3. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  4. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  5. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  6. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
  7. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  8. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  9. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  10. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
  11. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  12. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
  13. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  14. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  15. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  16. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
  17. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 364
  18. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
  19. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 346
  20. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
  21. 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 333
  22. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
  23. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  24. 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
  25. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  26. 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 220
  27. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  28. 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 206
  29. 2023Text-To-4D Dynamic Scene Generationcited by 205
  30. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 185
  31. 2020GRF: Learning a General Radiance Field for 3D Representation and Renderingcited by 183
  32. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  33. 2023SUDS: Scalable Urban Dynamic Scenescited by 151
  34. 2022KNN-Diffusion: Image Generation via Large-Scale Retrievalcited by 137
  35. 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 125
  36. 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 115
  37. 2023A Unified Approach for Text- and Image-guided 4D Scene Generationcited by 82
  38. 2020STaR: Self-supervised Tracking and Reconstruction of Rigid Objects in Motion with Neural Renderingcited by 76

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 77; 2025: 72; 2026: 45.

194 papers.

Sort:

By area:

  1. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  2. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  3. 2024A Survey on 3D Gaussian Splattingcited by 224
  4. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
  5. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 161
  6. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  7. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
  8. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
  9. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 144
  10. 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusioncited by 140
  11. 2024Recent Advances in 3D Gaussian Splattingcited by 131
  12. 20243D Gaussian as a New Era: A Surveycited by 104
38 more
  1. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
  2. 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102
  3. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 100
  4. 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 100
  5. 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Modelscited by 100
  6. 2025TesserAct: Learning 4D Embodied World Modelscited by 94
  7. 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 89
  8. 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusioncited by 80
  9. 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 78
  10. 2024TC4D: Trajectory-Conditioned Text-to-4D Generationcited by 77
  11. 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 70
  12. 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Modelscited by 64
  13. 2024DreamScene4D: Dynamic Multi-Object Scene Generation from Monocular Videoscited by 63
  14. 2024SC4D: Sparse-Controlled Video-to-4D Generation and Motion Transfercited by 61
  15. 2024Click-Gaussian: Interactive Segmentation to Any 3D Gaussianscited by 58
  16. 2024FlashSplat: 2D to 3D Gaussian Splatting Segmentation Solved Optimallycited by 58
  17. 2024DreamMesh4D: Video-to-4D Generation with Sparse-Controlled Gaussian-Mesh Hybrid Representationcited by 58
  18. 2024Animate3D: Animating Any 3D Model with Multi-view Video Diffusioncited by 56
  19. 20244K4DGen: Panoramic 4D Generation at 4K Resolutioncited by 54
  20. 2024GVGEN: Text-to-3D Generation with Volumetric Representationcited by 51
  21. 2024Comp4D: LLM-Guided Compositional 4D Scene Generationcited by 50
  22. 2024GenXD: Generating Any 3D and 4D Scenescited by 50
  23. 2024Feed-Forward Bullet-Time Reconstruction of Dynamic Scenes from Monocular Videoscited by 49
  24. 2025SV4D 2.0: Enhancing Spatio-Temporal Consistency in Multi-View Video Diffusion for High-Quality 4D Generationcited by 48
  25. 2024EG4D: Explicit Generation of 4D Object without Score Distillationcited by 45
  26. 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
  27. 2025WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actionscited by 45
  28. 2024Efficient4D: Fast Dynamic 3D Object Generation from a Single-view Videocited by 44
  29. 20243D-HGS: 3D Half-Gaussian Splattingcited by 44
  30. 2024Generative Gaussian Splatting for Unbounded 3D City Generationcited by 44
  31. 2025Puppeteer: Rig and Animate Your 3D Modelscited by 43
  32. 2025Motion Anything: Any to Motion Generationcited by 42
  33. 2025LangSplatV2: High-dimensional 3D Language Gaussian Splatting with 450+ FPScited by 41
  34. 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 41
  35. 2024Vivid-ZOO: Multi-View Video Generation with Diffusion Modelcited by 40
  36. 2025UniEdit-Flow: Unleashing Inversion and Editing in the Era of Flow Modelscited by 39
  37. 2024DynamicCity: Large-Scale 4D Occupancy Generation from Dynamic Scenescited by 38
  38. 2024DreamDrive: Generative 4D Scene Modeling from Street View Imagescited by 35

50 most cited of 194 All 194 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Splat4D: Diffusion-Enhanced 4D Gaussian Splatting for Temporally and Spatially Consistent Content Creation
  2. 20264DGS-Fixer: Generative Sparse-View 4D Gaussian Splatting with Iterative Refinement Guided by Video Diffusion Priors
  3. 2025Optimized Minimal 4D Gaussian Splatting
  4. 2025P-4DGS: Predictive 4D Gaussian Splatting with 90× Compression
  5. 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors
  6. 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularization
  7. 2025STP4D: Spatio-Temporal-Prompt Consistent Modeling for Text-to-4D Gaussian Splatting
  8. 2026PD-4DGS:Progressive Decomposition of 4D Gaussian Splatting for Bandwidth-Adaptive Dynamic Scene Streaming