mlsanityData to 7 Oct 2026

Deep Generative Modeling for Scene Synthesis via Hybrid Representations

arXiv 1808.02084 ↗First posted 6 Aug 2018cs.CVcited by 63

Not on the map. Why?

Abstract (arXiv)

We present a deep generative scene modeling technique for indoor environments. Our goal is to train a generative model using a feed-forward neural network that maps a prior distribution (e.g., a normal distribution) to the distribution of primary objects in indoor scenes. We introduce a 3D object arrangement representation that models the locations and orientations of objects, based on their size and shape attributes. Moreover, our scene representation is applicable for 3D objects with different multiplicities (repetition counts), selected from a database. We show a principled way to train this model by combining discriminator losses for both a 3D object arrangement representation and a 2D image-based representation. We demonstrate the effectiveness of our scene representation and the deep learning method on benchmark datasets. We also show the applications of this generative model in scene interpolation and scene completion.

Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Aug 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 16; 2022: 9; 2023: 12; 2024: 11; 2025: 11; 2026: 4.

63 papers.

Sort:

By area:

  1. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
  2. 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
  3. 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
  4. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
  5. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
  6. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
  7. 2021Constrained Graphic Layout Generation via Latent Optimizationcited by 83
  8. 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 81
  9. 2021FoV-NeRF: Foveated Neural Radiance Fields for Virtual Realitycited by 79
  10. 2023LEGO-Net: Learning Regular Rearrangements of Objects in Roomscited by 75
  11. 2022MIME: Human-Aware 3D Scene Generationcited by 57
  12. 2022RGBD2: Generative Scene Synthesis via Incremental View Inpainting using RGBD Diffusion Modelscited by 45
38 more
  1. 2024Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databasescited by 43
  2. 2021ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generatorscited by 40
  3. 2023SceneHGN: Hierarchical Graph Networks for 3D Indoor Scene Generation with Fine-Grained Geometrycited by 38
  4. 2021HPNet: Deep Primitive Segmentation Using Hybrid Representationscited by 35
  5. 2024Mixed Diffusion for 3D Indoor Scene Synthesiscited by 30
  6. 2021Scene Synthesis via Uncertainty-Driven Attribute Synchronizationcited by 29
  7. 2021Indoor Scene Generation from a Collection of Semantic-Segmented Depth Imagescited by 27
  8. 2023NAP: Neural 3D Articulation Priorcited by 25
  9. 2022Learning 3D Scene Priors with 2D Supervisioncited by 24
  10. 20253D Scene Generation: A Surveycited by 24
  11. 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generationcited by 22
  12. 2022LayoutEnhancer: Generating Good Indoor Layouts from Imperfect Datacited by 20
  13. 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 20
  14. 2024DeBaRA: Denoising-Based 3D Room Arrangement Generationcited by 20
  15. 2023CLIP-Layout: Style-Consistent Indoor Scene Synthesis with Semantic Furniture Embeddingcited by 16
  16. 2023Patch-based 3D Natural Scene Generation from a Single Examplecited by 15
  17. 2025Text2CT: Towards 3D CT Volume Generation from Free-text Descriptions Using Diffusion Modelcited by 13
  18. 2021LUMINOUS: Indoor Scene Generation for Embodied AI Challengescited by 12
  19. 2023RoomDesigner: Encoding Anchor-latents for Style-consistent and Shape-compatible Indoor Scene Generationcited by 12
  20. 2024FurniScene: A Large-scale 3D Room Dataset with Intricate Furnishing Scenescited by 10
  21. 2023Conditional 360-degree Image Synthesis for Immersive Indoor Scene Decorationcited by 9
  22. 2025CHOrD: Generation of Collision-Free, House-Scale, and Organized Digital Twins for 3D Indoor Scenes with Controllable Floor Plans and Optimal Layoutscited by 9
  23. 2025FreeScene: Mixed Graph Diffusion for 3D Scene Synthesis from Free Promptscited by 8
  24. 2024InstructLayout: Instruction-Driven 2D and 3D Layout Synthesis with Semantic Graph Priorcited by 6
  25. 2025SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesiscited by 6
  26. 2021Multi-Agent Reinforcement Learning of 3D Furniture Layout Simulation in Indoor Graphics Scenescited by 5
  27. 2022Neural Volumetric Mesh Generatorcited by 5
  28. 2023Rearrange Indoor Scenes for Human-Robot Co-Activitycited by 5
  29. 2024Human-Aware 3D Scene Generation with Spatially-constrained Diffusion Modelscited by 5
  30. 2022RLSS: A Deep Reinforcement Learning Algorithm for Sequential Scene Generationcited by 4
  31. 2025ScanEdit: Hierarchically-Guided Functional 3D Scan Editingcited by 4
  32. 2024S-INF: Towards Realistic Indoor Scene Synthesis via Scene Implicit Neural Fieldcited by 3
  33. 2025Computer-Aided Layout Generation for Building Design: A Reviewcited by 3
  34. 2021In-game Residential Home Planning via Visual Context-aware Global Relation Learningcited by 2
  35. 2024Automatic Scene Generation: State-of-the-Art Techniques, Models, Datasets, Challenges, and Future Prospectscited by 2
  36. 2021Deep Reinforcement Learning for Producing Furniture Layout in Indoor Scenescited by 1
  37. 2021MINERVAS: Massive INterior EnviRonments VirtuAl Synthesiscited by 1
  38. 2021Neural Scene Decoration from a Single Photographcited by 1

50 most cited of 63 All 63 (JSON)