mlsanityData to 14 Oct 2026

Text2Immersion: Generative Immersive Scene with 3D Gaussians

arXiv 2312.09242 ↗First posted 14 Dec 2023cs.CV cs.GRcited by 43

Not on the map. Why?

Abstract (arXiv)

We introduce Text2Immersion, an elegant method for producing high-quality 3D immersive scenes from text prompts. Our proposed pipeline initiates by progressively generating a Gaussian cloud using pre-trained 2D diffusion and depth estimation models. This is followed by a refining stage on the Gaussian cloud, interpolating and refining it to enhance the details of the generated scene. Distinct from prevalent methods that focus on single object or indoor scenes, or employ zoom-out trajectories, our approach generates diverse scenes with various objects, even extending to the creation of imaginary scenes. Consequently, Text2Immersion can have wide-ranging implications for various applications such as virtual reality, game development, and automated content creation. Extensive evaluations demonstrate that our system surpasses other methods in rendering quality and diversity, further progressing towards text-driven 3D scene generation. We will make the source code publicly accessible at the project page.

Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). Builds on 45 of its 54 references that are in the map. First posted on arXiv 14 Dec 2023.

Builds on

45 of 54 references.

References · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  7. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  9. 2022Generative Adversarial Networkscited by 5,627
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  12. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
33 more
  1. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  2. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  3. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  4. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  5. 2017Deep Image Priorcited by 1,098
  6. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  7. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
  8. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  9. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
  10. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  11. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  12. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  13. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
  14. 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
  15. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
  16. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  17. 2022Novel View Synthesis with Diffusion Modelscited by 300
  18. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  19. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  20. 2020Single-View View Synthesis with Multiplane Imagescited by 263
  21. 2023DiffBIR: Towards Blind Image Restoration with Generative Diffusion Priorcited by 257
  22. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  23. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  24. 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
  25. 20233DGen: Triplane Latent Diffusion for Textured Mesh Generationcited by 183
  26. 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 180
  27. 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
  28. 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
  29. 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 123
  30. 2023HoloDiffusion: Training a 3D Diffusion Model using 2D Imagescited by 106
  31. 2019Towards Unsupervised Learning of Generative Models for 3D Controllable Image Synthesiscited by 104
  32. 2021PixelSynth: Generating a 3D-Consistent Experience from a Single Imagecited by 82
  33. 2022Understanding Pure CLIP Guidance for Voxel Grid NeRF Modelscited by 56

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 20; 2025: 16; 2026: 7.

43 papers.

Sort:

By area:

  1. 2024A Survey on 3D Gaussian Splattingcited by 224
  2. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
  3. 2024Recent Advances in 3D Gaussian Splattingcited by 131
  4. 20243D Gaussian as a New Era: A Surveycited by 104
  5. 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splattingcited by 82
  6. 2024AbsGS: Recovering Fine Details for 3D Gaussian Splattingcited by 82
  7. 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 78
  8. 2024GenWarp: Single Image to Novel Views with Semantic-Preserving Generative Warpingcited by 73
  9. 2024DreamScene: 3D Gaussian-based Text-to-3D Scene Generation via Formation Pattern Samplingcited by 72
  10. 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 56
  11. 20244K4DGen: Panoramic 4D Generation at 4K Resolutioncited by 54
  12. 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
31 more
  1. 2024Streetscapes: Large-scale Consistent Street View Generation Using Autoregressive Video Diffusioncited by 39
  2. 2025SynCity: Training-Free Generation of 3D Worldscited by 31
  3. 2024DepthLab: From Partial to Completecited by 27
  4. 2024Invisible Stitch: Generating Smooth 3D Scenes with Depth Inpaintingcited by 24
  5. 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
  6. 2025WorldGen: From Text to Traversable and Interactive 3D Worldscited by 19
  7. 2024Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospectscited by 17
  8. 2025Scene4U: Hierarchical Layered 3D Scene Reconstruction from Single Panoramic Image for Your Immerse Explorationcited by 11
  9. 2024RoomPainter: View-Integrated Diffusion for Consistent Indoor Scene Texturingcited by 10
  10. 2024HouseCrafter: Lifting Floorplans to 3D Scenes with 2D Diffusion Modelcited by 9
  11. 2024DreamScape: 3D Scene Creation via Gaussian Splatting joint Correlation Modelingcited by 7
  12. 2025M3DLayout: A Multi-Source Dataset of 3D Indoor Layouts and Structured Descriptions for 3D Generationcited by 6
  13. 2025From Programs to Poses: Factored Real-World Scene Generation via Learned Program Librariescited by 6
  14. 2025Generating 360deg Video is What You Need For a 3D Scenecited by 5
  15. 2025Optimizing 4D Gaussians for Dynamic Scene Video from Single Landscape Imagescited by 4
  16. 2024PanoDreamer: Optimization-Based Single Image to 360 3D Scene With Diffusioncited by 2
  17. 2025Text2Stereo: Repurposing Stable Diffusion for Stereo Generation with Consistency Rewardscited by 2
  18. 2025PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenescited by 1
  19. 2025DreamScene: 3D Gaussian-based End-to-end Text-to-3D Scene Generationcited by 1
  20. 2025From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representationscited by 1
  21. 2025MVRoom: Controllable 3D Indoor Scene Generation with Multi-View Diffusion Modelscited by 1
  22. 2025TexAVi: Generating Stereoscopic VR Video Clips from Text Descriptionscited by 0
  23. 2025GeoTexBuild: 3D Building Model Generation from Map Footprintscited by 0
  24. 2025WarpGAN: Warping-Guided 3D GAN Inversion with Style-Based Novel View Inpaintingcited by 0
  25. 2026studentSplat: Your Student Model Learns Single-view 3D Gaussian Splattingcited by 0
  26. 2026LivingWorld: Interactive 4D World Generation with Environmental Dynamicscited by 0
  27. 2026DecoRec: Decomposed 3D Scene Reconstruction from Single-View Images via Object-Level Diffusioncited by 0
  28. 2026Native3D: End-to-End 3D Scene Generation via Unified Mesh-Texture Modeling and Semantic Alignmentcited by 0
  29. 2026CGGS: Consistency-Augmented Geometric Gaussian Splatting for Ego-Centric 3D Scene Generationcited by 0
  30. 2026Interpretable Human-Label-Free Deep Learning for Real-Bogus Classification with Uncertainty Quantificationcited by 0
  31. 2026Filling the Unseen: Scene Extrapolation via 3D Gaussian Splattingcited by 0