mlsanityData to 14 Oct 2026

LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes

arXiv 2311.13384 ↗First posted 22 Nov 2023cs.CVcited by 231

Not on the map. Why?

Cited by 62 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

With the widespread usage of VR devices and contents, demands for 3D scene generation techniques become more popular. Existing 3D scene generation models, however, limit the target scene to specific domain, primarily due to their training strategies using 3D scan dataset that is far from the real-world. To address such limitation, we propose LucidDreamer, a domain-free scene generation pipeline by fully leveraging the power of existing large-scale diffusion-based generative model. Our LucidDreamer has two alternate steps: Dreaming and Alignment. First, to generate multi-view consistent images from inputs, we set the point cloud as a geometrical guideline for each image generation. Specifically, we project a portion of point cloud to the desired view and provide the projection as a guidance for inpainting using the generative model. The inpainted images are lifted to 3D space with estimated depth maps, composing a new points. Second, to aggregate the new points into the 3D scene, we propose an aligning algorithm which harmoniously integrates the portions of newly generated 3D scenes. The finally obtained 3D scene serves as initial points for optimizing Gaussian splats. LucidDreamer produces Gaussian splats that are highly-detailed compared to the previous 3D scene generation methods, with no constraint on domain of the target scene. Project page: https://luciddreamer-cvlab.github.io/

Key facts. Cited by 231 papers in the map (data through 14 Oct 2026). Builds on 68 of its 105 references that are in the map. First posted on arXiv 22 Nov 2023.

Builds on

68 of 105 references.

References · 68

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  6. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  7. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  8. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  9. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  10. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  11. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  12. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
38 more
  1. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  2. 2023Consistency Modelscited by 1,822
  3. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  4. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  5. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  6. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  7. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  8. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  9. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
  10. 2020Neural Sparse Voxel Fieldscited by 959
  11. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
  12. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  13. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  14. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
  15. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
  16. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  17. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  18. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
  19. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
  20. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
  21. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  22. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  23. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
  24. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  25. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
  26. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  27. 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 488
  28. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
  29. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  30. 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
  31. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
  32. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  33. 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 311
  34. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
  35. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  36. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  37. 2019Learning Shape Templates with Structured Implicit Functionscited by 242
  38. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 212

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 74; 2025: 97; 2026: 59.

231 papers.

Sort:

By area:

  1. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  2. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  3. 2024A Survey on 3D Gaussian Splattingcited by 224
  4. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
  5. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  6. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
  7. 2024Recent Advances in 3D Gaussian Splattingcited by 131
  8. 2024Training-free Camera Control for Video Generationcited by 122
  9. 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 113
  10. 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
  11. 20243D Gaussian as a New Era: A Surveycited by 104
  12. 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generationcited by 101
38 more
  1. 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 100
  2. 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 99
  3. 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modelingcited by 96
  4. 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 94
  5. 2024I-Design: Personalized LLM Interior Designercited by 87
  6. 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splattingcited by 82
  7. 2024AbsGS: Recovering Fine Details for 3D Gaussian Splattingcited by 82
  8. 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 78
  9. 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splattingcited by 74
  10. 2024GenWarp: Single Image to Novel Views with Semantic-Preserving Generative Warpingcited by 73
  11. 2024MagicDrive3D: Controllable 3D Generation for Any-View Rendering in Street Scenescited by 71
  12. 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 70
  13. 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
  14. 2024Advances in 3D Generation: A Surveycited by 63
  15. 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 62
  16. 2024MegaScenes: Scene-Level View Synthesis at Scalecited by 58
  17. 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 56
  18. 2024Wild-GS: Real-Time Novel View Synthesis from Unconstrained Photo Collectionscited by 56
  19. 20244K4DGen: Panoramic 4D Generation at 4K Resolutioncited by 54
  20. 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
  21. 2024MoDGS: Dynamic Gaussian Splatting from Casually-captured Monocular Videos with Depth Priorscited by 51
  22. 2024Director3D: Real-world Camera Trajectory and 3D Scene Generation from Textcited by 50
  23. 2025World-in-World: World Models in a Closed-Loop Worldcited by 47
  24. 2024Generative Gaussian Splatting for Unbounded 3D City Generationcited by 44
  25. 2024SceneTeller: Language-to-3D Scene Generationcited by 43
  26. 2024Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Reviewcited by 41
  27. 2024WaterSplatting: Fast Underwater 3D Scene Reconstruction Using Gaussian Splattingcited by 41
  28. 2024Streetscapes: Large-scale Consistent Street View Generation Using Autoregressive Video Diffusioncited by 39
  29. 2024VistaDream: Sampling multiview consistent images for single-view scene reconstructioncited by 38
  30. 2025Deformable Beta Splattingcited by 38
  31. 2025FlexWorld: Progressively Expanding 3D Scenes for Flexiable-View Synthesiscited by 37
  32. 2025Depth Anything with Any Priorcited by 36
  33. 2025EmbodiedGen: Towards a Generative 3D World Engine for Embodied Intelligencecited by 36
  34. 2024DreamDrive: Generative 4D Scene Modeling from Street View Imagescited by 35
  35. 2025Reangle-A-Video: 4D Video Generation as Video-to-Video Translationcited by 35
  36. 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesiscited by 34
  37. 2024Prometheus: 3D-Aware Latent Diffusion Models for Feed-Forward Text-to-3D Scene Generationcited by 34
  38. 2025AutoPartGen: Autogressive 3D Part Generation and Discoverycited by 33

50 most cited of 231 All 231 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025BloomScene: Lightweight Structured 3D Gaussian Splatting for Crossmodal Scene Generation
  2. 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors
  3. 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior
  4. 2024Generative Object Insertion in Gaussian Splatting with a Multi-View Diffusion Model
  5. 2025Scene Splatter: Momentum 3D Scene Generation from Single Image with Video Diffusion Model
  6. 2026Benchmarking Single-Step Inpainting Methods for Multi-Object 3D Gaussian Splatting Scenes
  7. 2025Dragen3D: Multiview Geometry Consistent 3D Gaussian Generation with Drag-Based Control
  8. 20243D-SceneDreamer: Text-Driven 3D-Consistent Scene Generation