mlsanityData to 7 Oct 2026

SDesc3D: Towards Layout-Aware 3D Indoor Scene Generation from Short Descriptions

arXiv 2604.01972 ↗First posted 2 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D indoor scene generation conditioned on short textual descriptions provides a promising avenue for interactive 3D environment construction without the need for labor-intensive layout specification. Despite recent progress in text-conditioned 3D scene generation, existing works suffer from poor physical plausibility and insufficient detail richness in such semantic condensation cases, largely due to their reliance on explicit semantic cues about compositional objects and their spatial relationships. This limitation highlights the need for enhanced 3D reasoning capabilities, particularly in terms of prior integration and spatial anchoring. Motivated by this, we propose SDesc3D, a short-text conditioned 3D indoor scene generation framework, that leverages multi-view structural priors and regional functionality implications to enable 3D layout reasoning under sparse textual guidance. Specifically, we introduce a Multi-view scene prior augmentation that enriches underspecified textual inputs with aggregated multi-view structural knowledge, shifting from inaccessible semantic relation cues to multi-view relational prior aggregation. Building on this, we design a Functionality-aware layout grounding, employing regional functionality grounding for implicit spatial anchors and conducting hierarchical layout reasoning to enhance scene organization and semantic plausibility. Furthermore, an Iterative reflection-rectification scheme is employed for progressive structural plausibility refinement via self-rectification. Extensive experiments show that our method outperforms existing approaches on short-text conditioned 3D indoor scene generation. Code will be publicly available.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 41 references that are in the map. First posted on arXiv 2 Apr 2026.

Builds on

24 of 41 references.

References · 24

  1. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  2. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
  3. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
  4. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
  5. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
  6. 2024I-Design: Personalized LLM Interior Designercited by 87
  7. 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 65
  8. 2018Deep Generative Modeling for Scene Synthesis via Hybrid Representationscited by 63
  9. 2023CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusioncited by 54
  10. 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 53
  11. 2020End-to-End Optimization of Scene Layoutcited by 52
  12. 2024Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databasescited by 43
12 more
  1. 2024Architect: Generating Vivid and Interactive 3D Scenes with Hierarchical 2D Inpaintingcited by 37
  2. 2025Global-Local Tree Search in VLMs for 3D Indoor Scene Generationcited by 29
  3. 2025Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial Reasoningcited by 27
  4. 2025FirePlace: Geometric Refinements of LLM Common Sense Reasoning for 3D Object Placementcited by 24
  5. 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generationcited by 22
  6. 2025SPATIALGEN: Layout-guided 3D Indoor Scene Generationcited by 14
  7. 2024Graph Canvas for Controllable 3D Scene Generationcited by 11
  8. 2025Imaginarium: Vision-guided High-Quality 3D Scene Layout Generationcited by 11
  9. 2025Text-to-Scene with Large Reasoning Modelscited by 7
  10. 2025DisCo-Layout: Disentangling and Coordinating Semantic and Physical Refinement in a Multi-Agent Framework for 3D Indoor Layout Synthesiscited by 5
  11. 2025Learning to Place Objects with Programs and Iterative Self Trainingcited by 2
  12. 2025SceneLCM: End-to-End Layout-Guided Interactive Indoor Scene Generation with Latent Consistency Modelcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025M3DLayout: A Multi-Source Dataset of 3D Indoor Layouts and Structured Descriptions for 3D Generation
  2. 2025SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesis
  3. 2025ReSpace: Text-Driven Autoregressive 3D Indoor Scene Synthesis and Editing
  4. 2026CasLayout: Cascaded 3D Layout Diffusion for Indoor Scene Synthesis with Implicit Relation Modeling
  5. 2026Scene Generation at Absolute Scale: Utilizing Semantic and Geometric Guidance From Text for Accurate and Interpretable 3D Indoor Scene Generation
  6. 2026ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoning
  7. 2026SceneCritic: A Symbolic Evaluator for 3D Indoor Scene Synthesis
  8. 2026Global Graph-Validated Optimization for VLM-based 3D Indoor Scene Generation