SceneGraphNet: Neural Message Passing for 3D Indoor Scene Augmentation
Not on the map. Why?
Abstract (arXiv)
In this paper we propose a neural message passing approach to augment an input 3D indoor scene with new objects matching their surroundings. Given an input, potentially incomplete, 3D scene and a query location, our method predicts a probability distribution over object types that fit well in that location. Our distribution is predicted though passing learned messages in a dense graph whose nodes represent objects in the input scene and edges represent spatial and structural relationships. By weighting messages through an attention mechanism, our method learns to focus on the most relevant surrounding scene context to predict new scene objects. We found that our method significantly outperforms state-of-the-art approaches in terms of correctly predicting objects missing in a scene based on our experiments in the SUNCG dataset. We also demonstrate other applications of our method, including context-based 3D object recognition and iterative scene generation.
Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 11; 2023: 9; 2024: 10; 2025: 10; 2026: 6.
55 papers.
Sort:
By area:
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
- 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
- 2021Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphscited by 83
- 2023LEGO-Net: Learning Regular Rearrangements of Objects in Roomscited by 75
- 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusioncited by 66
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 65
- 2022MIME: Human-Aware 3D Scene Generationcited by 57
- 2023CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusioncited by 54
- 2021Exploiting Edge-Oriented Reasoning for 3D Point-based Scene Graph Analysiscited by 47
- 2022Continuous Scene Representations for Embodied AIcited by 39
38 more
- 2023SceneHGN: Hierarchical Graph Networks for 3D Indoor Scene Generation with Fine-Grained Geometrycited by 38
- 2021BuildingNet: Learning to Label 3D Buildingscited by 33
- 2024Mixed Diffusion for 3D Indoor Scene Synthesiscited by 30
- 2024Frankenstein: Generating Semantic-Compositional 3D Scenes in One Tri-Planecited by 26
- 2021Unconditional Scene Graph Generationcited by 22
- 2023Category-Level Multi-Part Multi-Joint 3D Shape Assemblycited by 22
- 2022LayoutEnhancer: Generating Good Indoor Layouts from Imperfect Datacited by 20
- 2023Scene Synthesis from Human Motioncited by 20
- 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 20
- 2025MMGDreamer: Mixed-Modality Graph for Geometry-Controllable 3D Indoor Scene Generationcited by 18
- 2023CLIP-Layout: Style-Consistent Indoor Scene Synthesis with Semantic Furniture Embeddingcited by 16
- 2021Hashing-Accelerated Graph Neural Networks for Link Predictioncited by 14
- 2025CasaGPT: Cuboid Arrangement and Scene Assembly for Interior Designcited by 14
- 2021LUMINOUS: Indoor Scene Generation for Embodied AI Challengescited by 12
- 2024Forest2Seq: Revitalizing Order Prior for Sequential Indoor Scene Synthesiscited by 12
- 2023Narrator: Towards Natural Control of Human-Scene Interaction Generation via Relationship Reasoningcited by 10
- 2022Spatial Commonsense Graph for Object Localisation in Partial Scenescited by 9
- 2025Controllable 3D Outdoor Scene Generation via Scene Graphscited by 9
- 2025PlaceIt3D: Language-Guided Object Placement in Real 3D Scenescited by 8
- 2025FreeScene: Mixed Graph Diffusion for 3D Scene Synthesis from Free Promptscited by 8
- 2022GraphMapper: Efficient Visual Navigation by Scene Graph Generationcited by 6
- 2024InstructLayout: Instruction-Driven 2D and 3D Layout Synthesis with Semantic Graph Priorcited by 6
- 2025SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesiscited by 6
- 2024Human-Aware 3D Scene Generation with Spatially-constrained Diffusion Modelscited by 5
- 2022Explore Contextual Information for 3D Scene Graph Generationcited by 4
- 2022Mutual Scene Synthesis for Mixed Reality Telepresencecited by 3
- 2022A General Purpose Supervisory Signal for Embodied Agentscited by 3
- 2025Computer-Aided Layout Generation for Building Design: A Reviewcited by 3
- 2021Contextual Scene Augmentation and Synthesis via GSACNetcited by 2
- 2022Leveraging commonsense for object localisation in partial scenescited by 2
- 2026SceneNAT: Masked Generative Modeling for Language-Guided Indoor Scene Synthesiscited by 2
- 2026SceneCritic: A Symbolic Evaluator for 3D Indoor Scene Synthesiscited by 2
- 2021Roominoes: Generating Novel 3D Floor Plans From Existing 3D Roomscited by 1
- 2022Learning Two-Step Hybrid Policy for Graph-Based Interpretable Reinforcement Learningcited by 1
- 2025SG-Tailor: Inter-Object Commonsense Relationship Reasoning for Scene Graph Manipulationcited by 1
- 2026HOG-Layout: Hierarchical 3D Scene Generation, Optimization and Editing via Vision-Language Modelscited by 1
- 2023Explicit3D: Graph Network with Spatial Inference for Single Image 3D Object Detectioncited by 0
- 2023Context-Aware Indoor Point Cloud Object Generation through User Instructionscited by 0
50 most cited of 55 All 55 (JSON)
- 2026ESG: Generating Physically Consistent Dynamic 3D Scenes from Text Descriptions14 Sep 2026
- 20263D Scene Graph Prediction: Generating Hierarchical Models from Partially Observed Environments12 Jul 2026
- 2026Function2Scene: 3D Indoor Scene Layout from Functional Specifications29 May 2026
- 2026SceneCritic: A Symbolic Evaluator for 3D Indoor Scene Synthesis14 Apr 2026
- 2026HOG-Layout: Hierarchical 3D Scene Generation, Optimization and Editing via Vision-Language Models12 Apr 2026
- 2026SceneNAT: Masked Generative Modeling for Language-Guided Indoor Scene Synthesis12 Jan 2026
- 2025SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesis26 Aug 2025
- 2025Graph-Guided Dual-Level Augmentation for 3D Scene Segmentation30 Jul 2025
- 2025FreeScene: Mixed Graph Diffusion for 3D Scene Synthesis from Free Prompts3 Jun 2025
- 2025PlaceIt3D: Language-Guided Object Placement in Real 3D Scenes8 May 2025
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generation5 May 2025
- 2025CasaGPT: Cuboid Arrangement and Scene Assembly for Interior Design28 Apr 2025
38 more
- 2025Computer-Aided Layout Generation for Building Design: A Review13 Apr 2025
- 2025SG-Tailor: Inter-Object Commonsense Relationship Reasoning for Scene Graph Manipulation23 Mar 2025
- 2025Controllable 3D Outdoor Scene Generation via Scene Graphs10 Mar 2025
- 2025MMGDreamer: Mixed-Modality Graph for Geometry-Controllable 3D Indoor Scene Generation9 Feb 2025
- 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLM31 Jul 2024
- 2024InstructLayout: Instruction-Driven 2D and 3D Layout Synthesis with Semantic Graph Prior10 Jul 2024
- 2024Forest2Seq: Revitalizing Order Prior for Sequential Indoor Scene Synthesis7 Jul 2024
- 2024Human-Aware 3D Scene Generation with Spatially-constrained Diffusion Models26 Jun 2024
- 2024Mixed Diffusion for 3D Indoor Scene Synthesis31 May 2024
- 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusion2 May 2024
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AI15 Apr 2024
- 20243D scene generation from scene graphs and self-attention2 Apr 2024
- 2024Frankenstein: Generating Semantic-Compositional 3D Scenes in One Tri-Plane24 Mar 2024
- 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Prior7 Feb 2024
- 2023Context-Aware Indoor Point Cloud Object Generation through User Instructions26 Nov 2023
- 2023CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusion25 May 2023
- 2023Narrator: Towards Natural Control of Human-Scene Interaction Generation via Relationship Reasoning16 Mar 2023
- 2023Category-Level Multi-Part Multi-Joint 3D Shape Assembly10 Mar 2023
- 2023CLIP-Layout: Style-Consistent Indoor Scene Synthesis with Semantic Furniture Embedding7 Mar 2023
- 2023SceneHGN: Hierarchical Graph Networks for 3D Indoor Scene Generation with Fine-Grained Geometry16 Feb 2023
- 2023Explicit3D: Graph Network with Spatial Inference for Single Image 3D Object Detection13 Feb 2023
- 2023LEGO-Net: Learning Regular Rearrangements of Objects in Rooms23 Jan 2023
- 2023Scene Synthesis from Human Motion4 Jan 2023
- 2022MIME: Human-Aware 3D Scene Generation8 Dec 2022
- 2022A General Purpose Supervisory Signal for Embodied Agents1 Dec 2022
- 2022Leveraging commonsense for object localisation in partial scenes1 Nov 2022
- 2022Explore Contextual Information for 3D Scene Graph Generation12 Oct 2022
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generation14 Jun 2022
- 2022GraphMapper: Efficient Visual Navigation by Scene Graph Generation17 May 2022
- 2022Mutual Scene Synthesis for Mixed Reality Telepresence1 Apr 2022
- 2022Continuous Scene Representations for Embodied AI31 Mar 2022
- 2022Spatial Commonsense Graph for Object Localisation in Partial Scenes10 Mar 2022
- 2022LayoutEnhancer: Generating Good Indoor Layouts from Imperfect Data1 Feb 2022
- 2022Learning Two-Step Hybrid Policy for Graph-Based Interpretable Reinforcement Learning21 Jan 2022
- 2021Roominoes: Generating Novel 3D Floor Plans From Existing 3D Rooms10 Dec 2021
- 2021LUMINOUS: Indoor Scene Generation for Embodied AI Challenges10 Nov 2021
- 2021BuildingNet: Learning to Label 3D Buildings11 Oct 2021
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesis7 Oct 2021
50 newest of 55 All 55 (JSON)
- 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusioncited by 66
- 2023CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusioncited by 54
- 2024Mixed Diffusion for 3D Indoor Scene Synthesiscited by 30
- 2025SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesiscited by 6
- 2024Human-Aware 3D Scene Generation with Spatially-constrained Diffusion Modelscited by 5
- 20263D Scene Graph Prediction: Generating Hierarchical Models from Partially Observed Environmentscited by 0
- 20263D Scene Graph Prediction: Generating Hierarchical Models from Partially Observed Environments12 Jul 2026
- 2025SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesis26 Aug 2025
- 2024Human-Aware 3D Scene Generation with Spatially-constrained Diffusion Models26 Jun 2024
- 2024Mixed Diffusion for 3D Indoor Scene Synthesis31 May 2024
- 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusion2 May 2024
- 2023CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusion25 May 2023
- 2025Controllable 3D Outdoor Scene Generation via Scene Graphs10 Mar 2025
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
- 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
- 2021Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphscited by 83
- 2023LEGO-Net: Learning Regular Rearrangements of Objects in Roomscited by 75
- 2022MIME: Human-Aware 3D Scene Generationcited by 57
- 2021Exploiting Edge-Oriented Reasoning for 3D Point-based Scene Graph Analysiscited by 47
- 2022Continuous Scene Representations for Embodied AIcited by 39
- 2023SceneHGN: Hierarchical Graph Networks for 3D Indoor Scene Generation with Fine-Grained Geometrycited by 38
- 2021BuildingNet: Learning to Label 3D Buildingscited by 33
- 2024Frankenstein: Generating Semantic-Compositional 3D Scenes in One Tri-Planecited by 26
12 most cited of 44 All 44 (JSON)
- 2026ESG: Generating Physically Consistent Dynamic 3D Scenes from Text Descriptions14 Sep 2026
- 2026Function2Scene: 3D Indoor Scene Layout from Functional Specifications29 May 2026
- 2026SceneNAT: Masked Generative Modeling for Language-Guided Indoor Scene Synthesis12 Jan 2026
- 2025Graph-Guided Dual-Level Augmentation for 3D Scene Segmentation30 Jul 2025
- 2025FreeScene: Mixed Graph Diffusion for 3D Scene Synthesis from Free Prompts3 Jun 2025
- 2025PlaceIt3D: Language-Guided Object Placement in Real 3D Scenes8 May 2025
- 2025CasaGPT: Cuboid Arrangement and Scene Assembly for Interior Design28 Apr 2025
- 2025Computer-Aided Layout Generation for Building Design: A Review13 Apr 2025
- 2025SG-Tailor: Inter-Object Commonsense Relationship Reasoning for Scene Graph Manipulation23 Mar 2025
- 2025MMGDreamer: Mixed-Modality Graph for Geometry-Controllable 3D Indoor Scene Generation9 Feb 2025
- 2024InstructLayout: Instruction-Driven 2D and 3D Layout Synthesis with Semantic Graph Prior10 Jul 2024
- 2024Forest2Seq: Revitalizing Order Prior for Sequential Indoor Scene Synthesis7 Jul 2024
12 newest of 44 All 44 (JSON)