Fast and Flexible Indoor Scene Synthesis via Deep Convolutional Generative Models
Not on the map. Why?
Abstract (arXiv)
We present a new, fast and flexible pipeline for indoor scene synthesis that is based on deep convolutional generative models. Our method operates on a top-down image-based representation, and inserts objects iteratively into the scene by predicting their category, location, orientation and size with separate neural network modules. Our pipeline naturally supports automatic completion of partial scenes, as well as synthesis of complete scenes. Our method is significantly faster than the previous image-based method and generates result that outperforms it and other state-of-the-art deep generative scene models in terms of faithfulness to training data and perceived visual quality.
Key facts. Cited by 105 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 11; 2023: 19; 2024: 20; 2025: 22; 2026: 15.
105 papers.
Sort:
By area:
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
- 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
- 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
- 2021Variational Transformer Networks for Layout Generationcited by 88
- 2021Constrained Graphic Layout Generation via Latent Optimizationcited by 83
- 2021SetVAE: Learning Hierarchical Composition for Generative Modeling of Set-Structured Datacited by 78
- 2023LEGO-Net: Learning Regular Rearrangements of Objects in Roomscited by 75
- 2023CC3D: Layout-Conditioned Generation of Compositional 3D Scenescited by 58
38 more
- 2022MIME: Human-Aware 3D Scene Generationcited by 57
- 2023RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texturecited by 53
- 2022RGBD2: Generative Scene Synthesis via Incremental View Inpainting using RGBD Diffusion Modelscited by 45
- 2024Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databasescited by 43
- 2023SceneHGN: Hierarchical Graph Networks for 3D Indoor Scene Generation with Fine-Grained Geometrycited by 38
- 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Modelcited by 34
- 2024Mixed Diffusion for 3D Indoor Scene Synthesiscited by 30
- 2021Scene Synthesis via Uncertainty-Driven Attribute Synchronizationcited by 29
- 2021Indoor Scene Generation from a Collection of Semantic-Segmented Depth Imagescited by 27
- 2024Frankenstein: Generating Semantic-Compositional 3D Scenes in One Tri-Planecited by 26
- 2025SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesiscited by 26
- 2023NAP: Neural 3D Articulation Priorcited by 25
- 2022Learning 3D Scene Priors with 2D Supervisioncited by 24
- 2023SG-Bot: Object Rearrangement via Coarse-to-Fine Robotic Imagination on Scene Graphscited by 24
- 2025FirePlace: Geometric Refinements of LLM Common Sense Reasoning for 3D Object Placementcited by 24
- 20253D Scene Generation: A Surveycited by 24
- 2023Category-Level Multi-Part Multi-Joint 3D Shape Assemblycited by 22
- 2023CityGen: Infinite and Controllable City Layout Generationcited by 22
- 2025FlairGPT: Repurposing LLMs for Interior Designscited by 22
- 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generationcited by 22
- 2023Scene Synthesis from Human Motioncited by 20
- 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 20
- 2024DeBaRA: Denoising-Based 3D Room Arrangement Generationcited by 20
- 2024Neural MP: A Generalist Neural Motion Plannercited by 18
- 2023CLIP-Layout: Style-Consistent Indoor Scene Synthesis with Semantic Furniture Embeddingcited by 16
- 2023GlobalMapper: Arbitrary-Shaped Urban Layout Generationcited by 15
- 2022COFS: Controllable Furniture layout Synthesiscited by 14
- 2024PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformerscited by 14
- 2021House-GAN++: Generative Adversarial Layout Refinement Networkscited by 13
- 2021LUMINOUS: Indoor Scene Generation for Embodied AI Challengescited by 12
- 2024Forest2Seq: Revitalizing Order Prior for Sequential Indoor Scene Synthesiscited by 12
- 2025PrimitiveAnything: Human-Crafted 3D Primitive Assembly Generation with Auto-Regressive Transformercited by 12
- 2022Towards Better User Studies in Computer Graphics and Visioncited by 11
- 2023Aladdin: Zero-Shot Hallucination of Stylized 3D Assets from Abstract Scene Descriptionscited by 11
- 2023Language-driven Scene Synthesis using Multi-conditional Diffusion Modelcited by 10
- 2024FurniScene: A Large-scale 3D Room Dataset with Intricate Furnishing Scenescited by 10
- 2024UniGen: Unified Modeling of Initial Agent States and Trajectories for Generating Autonomous Driving Scenarioscited by 10
- 2024VRCopilot: Authoring 3D Layouts with Generative AI Models in VRcited by 10
50 most cited of 105 All 105 (JSON)
- 2026ESG: Generating Physically Consistent Dynamic 3D Scenes from Text Descriptions14 Sep 2026
- 2026GIF: Agentic Generation of Interactive and Functional Object Compositions for Robot Learning5 Sep 2026
- 2026ScenePilot: Grow-and-Repair Policy for Text-Driven 3D Indoor Scene Generation31 Aug 2026
- 2026PolyLayout: Hierarchical VLM-Guided Layout Generation Beyond Rectangular Rooms11 Aug 2026
- 2026Learning an Interior Layout Policy in a Domain Specific Language Action Space31 Jul 2026
- 2026Agentic Designer: Progressive Multi-Agent Collaboration for Structure-Aware Interior Layout Generation23 Jul 2026
- 2026Text-Driven 3D Indoor Scene Synthesis in Non-Manhattan Environments2 Jul 2026
- 2026Function2Scene: 3D Indoor Scene Layout from Functional Specifications29 May 2026
- 2026CasLayout: Cascaded 3D Layout Diffusion for Indoor Scene Synthesis with Implicit Relation Modeling30 Apr 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026HOG-Layout: Hierarchical 3D Scene Generation, Optimization and Editing via Vision-Language Models12 Apr 2026
- 2026SceneTeract: Probing and Improving Agent-Aware Activity Reasoning in 3D Indoor Scenes31 Mar 2026
38 more
- 2026Extended to Reality: Prompt Injection in 3D Environments6 Feb 2026
- 2026Class-Partitioned VQ-VAE and Latent Flow Matching for Point Cloud Scene Generation18 Jan 2026
- 2026SceneNAT: Masked Generative Modeling for Language-Guided Indoor Scene Synthesis12 Jan 2026
- 2025Co-Layout: LLM-driven Co-optimization for Interior Layout16 Nov 2025
- 2025CHARM: Control-point-based 3D Anime Hairstyle Auto-Regressive Modeling25 Sep 2025
- 2025LayoutAgent: A Vision-Language Agent Guided Compositional Diffusion for Spatial Layout Planning24 Sep 2025
- 2025SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesis26 Aug 2025
- 2025PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenes23 Jun 2025
- 2025FreeScene: Mixed Graph Diffusion for 3D Scene Synthesis from Free Prompts3 Jun 2025
- 2025ReSpace: Text-Driven Autoregressive 3D Indoor Scene Synthesis and Editing3 Jun 2025
- 20253D Scene Generation: A Survey8 May 2025
- 2025PrimitiveAnything: Human-Crafted 3D Primitive Assembly Generation with Auto-Regressive Transformer7 May 2025
- 2025ScanEdit: Hierarchically-Guided Functional 3D Scan Editing21 Apr 2025
- 2025Computer-Aided Layout Generation for Building Design: A Review13 Apr 2025
- 2025LPA3D: 3D Room-Level Scene Generation from In-the-Wild Images3 Apr 2025
- 2025HierRelTriple: Guiding Indoor Layout Generation with Hierarchical Relationship Triplet Losses26 Mar 2025
- 2025Decorum: A Language-Based Approach For Style-Conditioned Synthesis of Indoor 3D Scenes23 Mar 2025
- 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generation21 Mar 2025
- 2025SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesis18 Mar 2025
- 2025CHOrD: Generation of Collision-Free, House-Scale, and Organized Digital Twins for 3D Indoor Scenes with Controllable Floor Plans and Optimal Layouts15 Mar 2025
- 2025FirePlace: Geometric Refinements of LLM Common Sense Reasoning for 3D Object Placement6 Mar 2025
- 2025Learning to Place Objects with Programs and Iterative Self Training6 Mar 2025
- 2025AccioScene: Compositional 3D Scene Generation via Graph Diffusion and Interaction-driven Critics5 Feb 2025
- 2025Unit Region Encoding: A Unified and Compact Geometry-aware Representation for Floorplan Applications19 Jan 2025
- 2025FlairGPT: Repurposing LLMs for Interior Designs8 Jan 2025
- 2024Diorama: Unleashing Zero-shot Single-view 3D Indoor Scene Modeling29 Nov 2024
- 2024DeBaRA: Denoising-Based 3D Room Arrangement Generation26 Sep 2024
- 2024From Geometric Mimicry to Comprehensive Generation: A Context-Informed Multimodal Diffusion Model for Urban Morphology Synthesis25 Sep 2024
- 2024Automatic Scene Generation: State-of-the-Art Techniques, Models, Datasets, Challenges, and Future Prospects14 Sep 2024
- 2024Neural MP: A Generalist Neural Motion Planner9 Sep 2024
- 2024VRCopilot: Authoring 3D Layouts with Generative AI Models in VR18 Aug 2024
- 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLM31 Jul 2024
- 2024PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformers18 Jul 2024
- 2024InstructLayout: Instruction-Driven 2D and 3D Layout Synthesis with Semantic Graph Prior10 Jul 2024
- 2024Forest2Seq: Revitalizing Order Prior for Sequential Indoor Scene Synthesis7 Jul 2024
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generation17 Jun 2024
- 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Model6 Jun 2024
- 2024Mixed Diffusion for 3D Indoor Scene Synthesis31 May 2024
50 newest of 105 All 105 (JSON)
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
- 2023RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texturecited by 53
- 2022RGBD2: Generative Scene Synthesis via Incremental View Inpainting using RGBD Diffusion Modelscited by 45
- 2024Mixed Diffusion for 3D Indoor Scene Synthesiscited by 30
- 20253D Scene Generation: A Surveycited by 24
- 2024DeBaRA: Denoising-Based 3D Room Arrangement Generationcited by 20
- 2023Language-driven Scene Synthesis using Multi-conditional Diffusion Modelcited by 10
- 2025SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesiscited by 6
- 2024From Geometric Mimicry to Comprehensive Generation: A Context-Informed Multimodal Diffusion Model for Urban Morphology Synthesiscited by 3
- 2026Class-Partitioned VQ-VAE and Latent Flow Matching for Point Cloud Scene Generationcited by 0
- 2026Class-Partitioned VQ-VAE and Latent Flow Matching for Point Cloud Scene Generation18 Jan 2026
- 2025SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesis26 Aug 2025
- 20253D Scene Generation: A Survey8 May 2025
- 2024DeBaRA: Denoising-Based 3D Room Arrangement Generation26 Sep 2024
- 2024From Geometric Mimicry to Comprehensive Generation: A Context-Informed Multimodal Diffusion Model for Urban Morphology Synthesis25 Sep 2024
- 2024Mixed Diffusion for 3D Indoor Scene Synthesis31 May 2024
- 2023Language-driven Scene Synthesis using Multi-conditional Diffusion Model24 Oct 2023
- 2023RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texture18 May 2023
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesis24 Mar 2023
- 2022RGBD2: Generative Scene Synthesis via Incremental View Inpainting using RGBD Diffusion Models12 Dec 2022
- 2025LayoutAgent: A Vision-Language Agent Guided Compositional Diffusion for Spatial Layout Planningcited by 1
- 2026Agentic Designer: Progressive Multi-Agent Collaboration for Structure-Aware Interior Layout Generationcited by 1
- 2026GIF: Agentic Generation of Interactive and Functional Object Compositions for Robot Learningcited by 1
- 2026SceneTeract: Probing and Improving Agent-Aware Activity Reasoning in 3D Indoor Scenescited by 0
- 2026GIF: Agentic Generation of Interactive and Functional Object Compositions for Robot Learning5 Sep 2026
- 2026Agentic Designer: Progressive Multi-Agent Collaboration for Structure-Aware Interior Layout Generation23 Jul 2026
- 2026SceneTeract: Probing and Improving Agent-Aware Activity Reasoning in 3D Indoor Scenes31 Mar 2026
- 2025LayoutAgent: A Vision-Language Agent Guided Compositional Diffusion for Spatial Layout Planning24 Sep 2025
- 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 20
- 2026Extended to Reality: Prompt Injection in 3D Environmentscited by 1
- 2026HOG-Layout: Hierarchical 3D Scene Generation, Optimization and Editing via Vision-Language Modelscited by 1
- 2026ScenePilot: Grow-and-Repair Policy for Text-Driven 3D Indoor Scene Generationcited by 0
- 2026ScenePilot: Grow-and-Repair Policy for Text-Driven 3D Indoor Scene Generation31 Aug 2026
- 2026HOG-Layout: Hierarchical 3D Scene Generation, Optimization and Editing via Vision-Language Models12 Apr 2026
- 2026Extended to Reality: Prompt Injection in 3D Environments6 Feb 2026
- 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLM31 Jul 2024
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
- 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
- 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
- 2021Variational Transformer Networks for Layout Generationcited by 88
- 2021Constrained Graphic Layout Generation via Latent Optimizationcited by 83
- 2021SetVAE: Learning Hierarchical Composition for Generative Modeling of Set-Structured Datacited by 78
- 2023LEGO-Net: Learning Regular Rearrangements of Objects in Roomscited by 75
- 2023CC3D: Layout-Conditioned Generation of Compositional 3D Scenescited by 58
- 2022MIME: Human-Aware 3D Scene Generationcited by 57
12 most cited of 85 All 85 (JSON)
- 2026ESG: Generating Physically Consistent Dynamic 3D Scenes from Text Descriptions14 Sep 2026
- 2026PolyLayout: Hierarchical VLM-Guided Layout Generation Beyond Rectangular Rooms11 Aug 2026
- 2026Learning an Interior Layout Policy in a Domain Specific Language Action Space31 Jul 2026
- 2026Text-Driven 3D Indoor Scene Synthesis in Non-Manhattan Environments2 Jul 2026
- 2026Function2Scene: 3D Indoor Scene Layout from Functional Specifications29 May 2026
- 2026CasLayout: Cascaded 3D Layout Diffusion for Indoor Scene Synthesis with Implicit Relation Modeling30 Apr 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026SceneNAT: Masked Generative Modeling for Language-Guided Indoor Scene Synthesis12 Jan 2026
- 2025Co-Layout: LLM-driven Co-optimization for Interior Layout16 Nov 2025
- 2025CHARM: Control-point-based 3D Anime Hairstyle Auto-Regressive Modeling25 Sep 2025
- 2025FreeScene: Mixed Graph Diffusion for 3D Scene Synthesis from Free Prompts3 Jun 2025
- 2025ReSpace: Text-Driven Autoregressive 3D Indoor Scene Synthesis and Editing3 Jun 2025
12 newest of 85 All 85 (JSON)