mlsanityData to 7 Oct 2026

DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation

arXiv 2309.16653 ↗First posted 28 Sep 2023cs.CVcited by 837

Not on the map. Why?

Cited by 220 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Recent advances in 3D content creation mostly leverage optimization-based 3D generation via score distillation sampling (SDS). Though promising results have been exhibited, these methods often suffer from slow per-sample optimization, limiting their practical usage. In this paper, we propose DreamGaussian, a novel 3D content generation framework that achieves both efficiency and quality simultaneously. Our key insight is to design a generative 3D Gaussian Splatting model with companioned mesh extraction and texture refinement in UV space. In contrast to the occupancy pruning used in Neural Radiance Fields, we demonstrate that the progressive densification of 3D Gaussians converges significantly faster for 3D generative tasks. To further enhance the texture quality and facilitate downstream applications, we introduce an efficient algorithm to convert 3D Gaussians into textured meshes and apply a fine-tuning stage to refine the details. Extensive experiments demonstrate the superior efficiency and competitive generation quality of our proposed approach. Notably, DreamGaussian produces high-quality textured meshes in just 2 minutes from a single-view image, achieving approximately 10 times acceleration compared to existing methods.

Key facts. Cited by 837 papers in the map (data through 7 Oct 2026). Builds on 66 of its 77 references that are in the map. First posted on arXiv 28 Sep 2023.

Builds on

66 of 77 references.

References · 66

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  8. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  9. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  10. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  11. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  12. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
38 more
  1. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  2. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  3. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  4. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  5. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  6. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  7. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  8. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  9. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  10. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  11. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  12. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  13. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  14. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  15. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  16. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  17. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  18. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
  19. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
  20. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
  21. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  22. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
  23. 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 410
  24. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  25. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  26. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
  27. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  28. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
  29. 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 308
  30. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
  31. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
  32. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
  33. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  34. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  35. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
  36. 2023Text-To-4D Dynamic Scene Generationcited by 204
  37. 2020GRF: Learning a General Radiance Field for 3D Representation and Renderingcited by 183
  38. 20233DGen: Triplane Latent Diffusion for Textured Mesh Generationcited by 181

50 most cited of 66 All 66 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 68; 2024: 376; 2025: 254; 2026: 139.

837 papers.

Sort:

By area:

  1. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  2. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  3. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
  4. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  5. 2023Gaussian Splatting SLAMcited by 410
  6. 2023LangSplat: 3D Language Gaussian Splattingcited by 410
  7. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
  8. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
  9. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  10. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
  11. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
  12. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
38 more
  1. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  2. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  3. 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 280
  4. 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
  5. 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
  6. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  7. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
  8. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
  9. 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 225
  10. 2024A Survey on 3D Gaussian Splattingcited by 221
  11. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 214
  12. 20243D Gaussian Splatting as Markov Chain Monte Carlocited by 210
  13. 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
  14. 2024Mini-Splatting: Representing Scenes with a Constrained Number of Gaussianscited by 208
  15. 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 199
  16. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
  17. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 185
  18. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
  19. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  20. 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformerscited by 169
  21. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  22. 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 163
  23. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 155
  24. 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 151
  25. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
  26. 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 141
  27. 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 140
  28. 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
  29. 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 132
  30. 2024Recent Advances in 3D Gaussian Splattingcited by 130
  31. 2024Revising Densification in Gaussian Splattingcited by 127
  32. 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
  33. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
  34. 2023GART: Gaussian Articulated Template Modelscited by 121
  35. 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 120
  36. 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
  37. 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 113
  38. 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 110

50 most cited of 837 All 837 (JSON)