mlsanityData to 14 Oct 2026

Text to 3D Scene Generation with Rich Lexical Grounding

arXiv 1505.06289 ↗First posted 23 May 2015cs.CL cs.GRcited by 36

Not on the map. Why?

Abstract (arXiv)

The ability to map descriptions of scenes to 3D geometric representations has many applications in areas such as art, education, and robotics. However, prior work on the text to 3D scene generation task has used manually specified object categories and language that identifies them. We introduce a dataset of 3D scenes annotated with natural language descriptions and learn from this data how to ground textual descriptions to physical objects. Our method successfully grounds a variety of lexical terms to concrete referents, and we show quantitatively that our method improves 3D scene generation over previous work using purely rule-based methods. We evaluate the fidelity and plausibility of 3D scenes generated with our grounding approach through human judgments. To ease evaluation on this task, we also introduce an automated metric that strongly correlates with human judgments.

Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 May 2015.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 3; 2022: 3; 2023: 7; 2024: 11; 2025: 6; 2026: 6.

36 papers.

Sort:

By area:

  1. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  2. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
  3. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Codecited by 134
  4. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 117
  5. 2024GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splattingcited by 109
  6. 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
  7. 2024I-Design: Personalized LLM Interior Designercited by 87
  8. 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusioncited by 67
  9. 2023Graphologue: Exploring Large Language Model Responses with Interactive Diagramscited by 66
  10. 2022MIME: Human-Aware 3D Scene Generationcited by 57
  11. 2021Grounding 'Grounding' in NLPcited by 44
  12. 2023SceneHGN: Hierarchical Graph Networks for 3D Indoor Scene Generation with Fine-Grained Geometrycited by 39
24 more
  1. 2021Indoor Scene Generation from a Collection of Semantic-Segmented Depth Imagescited by 27
  2. 2025SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesiscited by 26
  3. 2023A Theory of Multimodal Learningcited by 25
  4. 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 21
  5. 2024Neural MP: A Generalist Neural Motion Plannercited by 19
  6. 2023XVO: Generalized Visual Odometry via Cross-Modal Self-Trainingcited by 18
  7. 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimizationcited by 14
  8. 2023Aladdin: Zero-Shot Hallucination of Stylized 3D Assets from Abstract Scene Descriptionscited by 11
  9. 2023Language-driven Scene Synthesis using Multi-conditional Diffusion Modelcited by 10
  10. 2025PlaceIt3D: Language-Guided Object Placement in Real 3D Scenescited by 9
  11. 2025FreeScene: Mixed Graph Diffusion for 3D Scene Synthesis from Free Promptscited by 8
  12. 2026GS-Agent: Creating 4D Physical Worlds With Generative Simulationcited by 5
  13. 2022Point Cloud Generation with Continuous Conditioningcited by 4
  14. 2024Multimodal Classification via Modal-Aware Interactive Enhancementcited by 4
  15. 2024Automatic Scene Generation: State-of-the-Art Techniques, Models, Datasets, Challenges, and Future Prospectscited by 2
  16. 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoisingcited by 2
  17. 2023On the Computational Benefit of Multimodal Learningcited by 1
  18. 2026HOG-Layout: Hierarchical 3D Scene Generation, Optimization and Editing via Vision-Language Modelscited by 1
  19. 2026Function2Scene: 3D Indoor Scene Layout from Functional Specificationscited by 1
  20. 2026iARCS: Iterative Agentic RL for Controllable 3D Scene Generationcited by 1
  21. 2024VP-LLM: Text-Driven 3D Volume Completion with Large Language Models through Patchificationcited by 0
  22. 2025LPA3D: 3D Room-Level Scene Generation from In-the-Wild Imagescited by 0
  23. 2025Sceniris: A Fast Procedural Scene Generation Frameworkcited by 0
  24. 2026ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoningcited by 0