HLG: Comprehensive 3D Room Construction via Hierarchical Layout Generation
Not on the map. Why?
Abstract (arXiv)
Realistic 3D indoor scene generation is crucial for virtual reality, interior design, embodied intelligence, and scene understanding. While existing methods have made progress in coarse-scale furniture arrangement, they struggle to capture fine-grained object placements, limiting the realism and utility of generated environments. This gap hinders immersive virtual experiences and detailed scene comprehension for embodied AI applications. To address these issues, we propose Hierarchical Layout Generation (HLG), a novel method for fine-grained 3D scene generation. HLG is the first to adopt a coarse-to-fine hierarchical approach, refining scene layouts from large-scale furniture placement to intricate object arrangements. Specifically, our fine-grained layout alignment module constructs a hierarchical layout through vertical and horizontal decoupling, effectively decomposing complex 3D indoor scenes into multiple levels of granularity. Additionally, our trainable layout optimization network addresses placement issues, such as incorrect positioning, orientation errors, and object intersections, ensuring structurally coherent and physically plausible scene generation. We demonstrate the effectiveness of our approach through extensive experiments, showing superior performance in generating realistic indoor scenes compared to existing methods. This work advances the field of scene generation and opens new possibilities for applications requiring detailed 3D environments. We will release our code upon publication to encourage future research.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 36 of its 54 references that are in the map. First posted on arXiv 25 Aug 2025.
Builds on
36 of 54 references.
References · 36
- 2017Graph Attention Networkscited by 8,923
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 200
- 2020Total3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes from a Single Imagecited by 172
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 137
- 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 117
- 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
24 more
- 2024GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splattingcited by 109
- 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstructioncited by 95
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 82
- 2024DreamScene: 3D Gaussian-based Text-to-3D Scene Generation via Formation Pattern Samplingcited by 72
- 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusioncited by 67
- 2023ControlRoom3D: Room Generation using Semantic Proxy Roomscited by 56
- 2024SceneTeller: Language-to-3D Scene Generationcited by 43
- 2025FlairGPT: Repurposing LLMs for Interior Designscited by 24
- 2023PSDR-Room: Single Photo to Scene using Differentiable Renderingcited by 23
- 2024CityX: Controllable Procedural Content Generation for Unbounded 3D Citiescited by 22
- 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 21
- 2024DeBaRA: Denoising-Based 3D Room Arrangement Generationcited by 20
- 2025MMGDreamer: Mixed-Modality Graph for Geometry-Controllable 3D Indoor Scene Generationcited by 19
- 2023Text2Scene: Text-driven Indoor Scene Stylization with Part-aware Detailscited by 18
- 2025HiScene: Creating Hierarchical 3D Scenes with Isometric View Generationcited by 18
- 2024Open Vocabulary 3D Scene Understanding via Geometry Guided Self-Distillationcited by 17
- 2024EditRoom: LLM-parameterized Graph Diffusion for Composable 3D Room Layout Editingcited by 15
- 2025CasaGPT: Cuboid Arrangement and Scene Assembly for Interior Designcited by 14
- 2025Agentic 3D Scene Generation with Spatially Contextualized VLMscited by 14
- 2023RoomDesigner: Encoding Anchor-latents for Style-consistent and Shape-compatible Indoor Scene Generationcited by 12
- 2024FurniScene: A Large-scale 3D Room Dataset with Intricate Furnishing Scenescited by 10
- 2024GenRC: Generative 3D Room Completion from Sparse Image Collectionscited by 9
- 2025Unposed Sparse Views Room Layout Reconstruction in the Age of Pretrain Modelcited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Co-generation of Layout and Shape from Text via Autoregressive 3D Diffusioncited by 1
- 2026Function2Scene: 3D Indoor Scene Layout from Functional Specificationscited by 1
- 2026R3L: Reasoning 3D Layouts from Relative Spatial Relationscited by 0
- 2026ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoningcited by 0
- 2026ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoning15 Jul 2026
- 2026Function2Scene: 3D Indoor Scene Layout from Functional Specifications29 May 2026
- 2026R3L: Reasoning 3D Layouts from Relative Spatial Relations7 May 2026
- 2026Co-generation of Layout and Shape from Text via Autoregressive 3D Diffusion17 Apr 2026