HetScene: Heterogeneity-Aware Diffusion for Dense Indoor Scene Generation
Not on the map. Why?
Abstract (arXiv)
Generating controllable and physically plausible indoor scenes is a pivotal prerequisite for constructing high-fidelity simulation environments for embodied AI. However, existing deeplearning-based methods usually treat all objects as homogeneous instances within a unified generation process. While effective for sparse and simplistic layouts, they struggle to model realistic layouts with dense object arrangements and complex spatial dependencies, leadingto limited scalability and degraded physical plausibility. To deal with these challenges, we revisit indoor layout generation from the perspective of structural heterogeneity and decompose the objects into primary objects and secondary objects according to their distinct roles in shaping a scene. Based on this decomposition, we propose HetScene, a heterogeneous two-stage generation framework that decouples indoor layout synthesis into Structural Layout Generation (SLG) and Contextual Layout Generation (CLG). SLG first generates globally coherent structural layouts with only primary objects conditioned on text descriptions, top-down binary room masks, and spatial relation graphs, establishing a stable global macro-skeleton of large core furniture.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 30 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
20 of 30 references.
References · 20
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 200
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
- 2020SceneFormer: Indoor Scene Generation with Transformerscited by 158
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 137
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
- 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 117
- 2021Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphscited by 84
- 2023LEGO-Net: Learning Regular Rearrangements of Objects in Roomscited by 76
- 2018Human-centric Indoor Scene Synthesis Using Stochastic Grammarcited by 74
8 more
- 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusioncited by 67
- 2021StructFormer: Learning Spatial Structure for Language-Guided Semantic Rearrangement of Novel Objectscited by 59
- 2022StructDiffusion: Language-Guided Creation of Physically-Valid Structures using Unseen Objectscited by 50
- 2023SceneHGN: Hierarchical Graph Networks for 3D Indoor Scene Generation with Fine-Grained Geometrycited by 39
- 2024Mixed Diffusion for 3D Indoor Scene Synthesiscited by 32
- 2023CabiNet: Scaling Neural Collision Detection for Object Rearrangement with Procedural Scene Generationcited by 18
- 2024ClutterGen: A Cluttered Scene Generator for Robot Learningcited by 8
- 2025M3DLayout: A Multi-Source Dataset of 3D Indoor Layouts and Structured Descriptions for 3D Generationcited by 6
Built on by
Not cited yet.