mlsanityData to 7 Oct 2026

GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splatting

arXiv 2402.07207 ↗First posted 11 Feb 2024cs.CVcited by 104

Not on the map. Why?

Abstract (arXiv)

We present GALA3D, generative 3D GAussians with LAyout-guided control, for effective compositional text-to-3D generation. We first utilize large language models (LLMs) to generate the initial layout and introduce a layout-guided 3D Gaussian representation for 3D content generation with adaptive geometric constraints. We then propose an instance-scene compositional optimization mechanism with conditioned diffusion to collaboratively generate realistic 3D scenes with consistent geometry, texture, scale, and accurate interactions among multiple objects while simultaneously adjusting the coarse layout priors extracted from the LLMs to align with the generated scene. Experiments show that GALA3D is a user-friendly, end-to-end framework for state-of-the-art scene-level 3D content generation and controllable editing while ensuring the high fidelity of object-level entities within the scene. The source codes and models will be available at gala3d.github.io.

Key facts. Cited by 104 papers in the map (data through 7 Oct 2026). Builds on 33 of its 37 references that are in the map. First posted on arXiv 11 Feb 2024.

Builds on

33 of 37 references.

References · 33

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  5. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  6. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  7. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  8. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  9. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  10. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  11. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  12. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
21 more
  1. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
  2. 2023Text-to-3D using Gaussian Splattingcited by 299
  3. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  4. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
  5. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  6. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 166
  7. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
  8. 2023Compositional 3D Scene Generation using Locally Conditioned Diffusioncited by 101
  9. 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 91
  10. 2023HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splattingcited by 89
  11. 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 81
  12. 2023Set-the-Scene: Global-Local Training for Generating Controllable NeRF Scenescited by 75
  13. 2023CompoNeRF: Text-guided Multi-object Compositional NeRF with Editable 3D Scene Layoutcited by 57
  14. 2023T3Bench: Benchmarking Current Progress in Text-to-3D Generationcited by 56
  15. 2023SceneWiz3D: Towards Text-guided 3D Scene Compositioncited by 54
  16. 2023Robust e-NeRF: NeRF from Sparse & Noisy Events under Non-Uniform Motioncited by 44
  17. 2023CG3D: Compositional Generation for Text-to-3D via Gaussian Splattingcited by 42
  18. 2015Text to 3D Scene Generation with Rich Lexical Groundingcited by 36
  19. 2023GaussianDiffusion: 3D Gaussian Splatting for Denoising Diffusion Probabilistic Models with Structured Noisecited by 30
  20. 2023Towards Language-guided Interactive 3D Generation: LLMs as Layout Interpreter with Generative Feedbackcited by 17
  21. 2023Make-A-Character: High Quality Text-to-3D Character Generation within Minutescited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 36; 2025: 47; 2026: 21.

104 papers.

Sort:

By area:

  1. 2024Recent Advances in 3D Gaussian Splattingcited by 130
  2. 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 94
  3. 2024AbsGS: Recovering Fine Details for 3D Gaussian Splattingcited by 80
  4. 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
  5. 2024TC4D: Trajectory-Conditioned Text-to-4D Generationcited by 76
  6. 2024DreamScene: 3D Gaussian-based Text-to-3D Scene Generation via Formation Pattern Samplingcited by 72
  7. 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusioncited by 66
  8. 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
  9. 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 65
  10. 20244K4DGen: Panoramic 4D Generation at 4K Resolutioncited by 54
  11. 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 53
  12. 2024SceneTeller: Language-to-3D Scene Generationcited by 43
38 more
  1. 2024When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Modelscited by 41
  2. 2024The Scene Language: Representing Scenes with Programs, Words, and Embeddingscited by 31
  3. 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Priorcited by 30
  4. 2025Global-Local Tree Search in VLMs for 3D Indoor Scene Generationcited by 29
  5. 2025ArtiScene: Language-Driven Artistic 3D Scene Generation Through Image Intermediarycited by 27
  6. 2025Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial Reasoningcited by 27
  7. 2024AvatarGO: Zero-shot 4D Human-Object Interaction Generation and Animationcited by 25
  8. 2024Large Language Models for Manufacturingcited by 24
  9. 2024DynamicScaler: Seamless and Scalable Video Generation for Panoramic Scenescited by 24
  10. 20253D Scene Generation: A Surveycited by 24
  11. 2024VividDream: Generating 3D Scene with Ambient Dynamicscited by 21
  12. 2024Layout-your-3D: Controllable and Precise 3D Generation with 2D Blueprintcited by 21
  13. 2024BrightDreamer: Generic 3D Gaussian Generative Framework for Fast Text-to-3D Synthesiscited by 20
  14. 2024Trans4D: Realistic Geometry-Aware Transition for Compositional Text-to-4D Synthesiscited by 19
  15. 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
  16. 2024Compositional 3D-aware Video Generation with LLM Directorcited by 18
  17. 2025HiScene: Creating Hierarchical 3D Scenes with Isometric View Generationcited by 18
  18. 2025WorldGen: From Text to Traversable and Interactive 3D Worldscited by 18
  19. 2024Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospectscited by 17
  20. 2026MV-SAM3D: Adaptive Multi-View Fusion for Layout-Aware 3D Generationcited by 16
  21. 2025Sat2City: 3D City Generation from A Single Satellite Image with Cascaded Latent Diffusioncited by 15
  22. 2024EditRoom: LLM-parameterized Graph Diffusion for Composable 3D Room Layout Editingcited by 14
  23. 2025SPATIALGEN: Layout-guided 3D Indoor Scene Generationcited by 14
  24. 2025PAT3D: Physics-Augmented Text-to-3D Scene Generationcited by 14
  25. 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generationcited by 13
  26. 2024SceneGenAgent: Precise Industrial Scene Generation with Coding Agentcited by 12
  27. 2025LAYOUTDREAMER: Physics-guided Layout for Text-to-3D Compositional Scene Generationcited by 11
  28. 2024CompGS: Unleashing 2D Compositionality for Compositional Text-to-3D via Dynamically Optimizing 3D Gaussianscited by 10
  29. 2024Story3D-Agent: Exploring 3D Storytelling Visualization with Large Language Modelscited by 9
  30. 2024DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priorscited by 9
  31. 2024Semantic Score Distillation Sampling for Compositional Text-to-3D Generationcited by 9
  32. 2024DreamDissector: Learning Disentangled Text-to-3D Generation from 2D Diffusion Priorscited by 8
  33. 2024DreamScape: 3D Scene Creation via Gaussian Splatting joint Correlation Modelingcited by 7
  34. 2024MARVEL-40M+: Multi-Level Visual Elaboration for High-Fidelity Text-to-3D Content Creationcited by 7
  35. 2025Digital Twin Generation from Visual Data: A Surveycited by 7
  36. 2025TRELLISWorld: Training-Free World Generation from Object Generatorscited by 7
  37. 2025DiMeR: Disentangled Mesh Reconstruction Modelcited by 6
  38. 2025Towards Geometric and Textural Consistency 3D Scene Generation via Single Image-guided Model Generation and Layout Optimizationcited by 6

50 most cited of 104 All 104 (JSON)