mlsanityData to 7 Oct 2026

DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesis

arXiv 2303.14207 ↗First posted 24 Mar 2023cs.CVcited by 159

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We present DiffuScene for indoor 3D scene synthesis based on a novel scene configuration denoising diffusion model. It generates 3D instance properties stored in an unordered object set and retrieves the most similar geometry for each object configuration, which is characterized as a concatenation of different attributes, including location, size, orientation, semantics, and geometry features. We introduce a diffusion network to synthesize a collection of 3D indoor objects by denoising a set of unordered object attributes. Unordered parametrization simplifies and eases the joint distribution approximation. The shape feature diffusion facilitates natural object placements, including symmetries. Our method enables many downstream applications, including scene completion, scene arrangement, and text-conditioned scene synthesis. Experiments on the 3D-FRONT dataset show that our method can synthesize more physically plausible and diverse indoor scenes than state-of-the-art methods. Extensive ablation studies verify the effectiveness of our design choice in scene diffusion models.

Key facts. Cited by 159 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 64 of its 90 references that are in the map. First posted on arXiv 24 Mar 2023.

Builds on

64 of 90 references.

Closest ancestors · 6

Same direction, newest first

  1. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan
  2. 2022RGBD2: Generative Scene Synthesis via Incremental View Inpainting using RGBD Diffusion Models12 Dec
  3. 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct
  4. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
  5. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan
  6. 2021Diffusion Probabilistic Models for 3D Point Cloud Generation2 Mar

Other references · 58

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  10. 2022Classifier-Free Diffusion Guidancecited by 5,717
  11. 2022Generative Adversarial Networkscited by 5,603
  12. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
38 more
  1. 2017Neural Discrete Representation Learningcited by 4,650
  2. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  3. 2018Neural Ordinary Differential Equationscited by 3,733
  4. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  5. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  6. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  7. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  8. 2015Variational Inference with Normalizing Flowscited by 2,161
  9. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  10. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  11. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  12. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  13. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
  14. 2018Demystifying MMD GANscited by 1,268
  15. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  16. 2020Center-based 3D Object Detection and Trackingcited by 1,143
  17. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  18. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  19. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  20. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  21. 2016Conditional Image Generation with PixelCNN Decoderscited by 859
  22. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
  23. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
  24. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  25. 2013Generating Sequences With Recurrent Neural Networkscited by 549
  26. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  27. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
  28. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
  29. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 306
  30. 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
  31. 2020SceneFormer: Indoor Scene Generation with Transformerscited by 154
  32. 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
  33. 20183DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentationcited by 118
  34. 2018Fast and Flexible Indoor Scene Synthesis via Deep Convolutional Generative Modelscited by 105
  35. 2023LEGO-Net: Learning Regular Rearrangements of Objects in Roomscited by 75
  36. 2018Human-centric Indoor Scene Synthesis Using Stochastic Grammarcited by 73
  37. 2018Deep Generative Modeling for Scene Synthesis via Hybrid Representationscited by 63
  38. 2021SA-ConvONet: Sign-Agnostic Optimization of Convolutional Occupancy Networkscited by 59

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 4; 2024: 18; 2025: 66; 2026: 71.

159 papers.

Sort:

By area:

  1. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
  2. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 113
  3. 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
  4. 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 65
  5. 2024LT3SD: Latent Trees for 3D Scene Diffusioncited by 53
  6. 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 53
  7. 2026SAGE: Scalable Agentic 3D Scene Generation for Embodied AIcited by 40
  8. 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
  9. 2025MetaScenes: Towards Automated Replica Creation for Real-world 3D Scanscited by 31
  10. 2025Global-Local Tree Search in VLMs for 3D Indoor Scene Generationcited by 29
  11. 2024Motion2VecSets: 4D Latent Vector Set Diffusion for Non-rigid Shape Reconstruction and Trackingcited by 27
  12. 2025SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesiscited by 26
38 more
  1. 2024SceneFactor: Factored Latent 3D Diffusion for Controllable 3D Scene Generationcited by 24
  2. 20253D Scene Generation: A Surveycited by 24
  3. 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generationcited by 22
  4. 2025WorldCraft: Photo-Realistic 3D World Creation and Customization via LLM Agentscited by 21
  5. 2024DeBaRA: Denoising-Based 3D Room Arrangement Generationcited by 20
  6. 2025HiScene: Creating Hierarchical 3D Scenes with Isometric View Generationcited by 18
  7. 2025InternScenes: A Large-scale Simulatable Indoor Scene Dataset with Realistic Layoutscited by 18
  8. 2025SceneMaker: Open-set 3D Scene Generation with Decoupled De-occlusion and Pose Estimation Modelcited by 15
  9. 2025CasaGPT: Cuboid Arrangement and Scene Assembly for Interior Designcited by 14
  10. 2025Agentic 3D Scene Generation with Spatially Contextualized VLMscited by 14
  11. 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimizationcited by 14
  12. 2025SPATIALGEN: Layout-guided 3D Indoor Scene Generationcited by 14
  13. 2025WorldGrow: Generating Infinite 3D Worldcited by 14
  14. 2023Functional Diffusioncited by 13
  15. 2026SimWorld Studio: Automatic Environment Generation with Evolving Coding Agent for Embodied Agent Learningcited by 13
  16. 2024Diffusion Models in 3D Vision: A Surveycited by 11
  17. 2023DPHMs: Diffusion Parametric Head Models for Depth-based Trackingcited by 10
  18. 2024FurniScene: A Large-scale 3D Room Dataset with Intricate Furnishing Scenescited by 10
  19. 2024VRCopilot: Authoring 3D Layouts with Generative AI Models in VRcited by 10
  20. 2024Diorama: Unleashing Zero-shot Single-view 3D Indoor Scene Modelingcited by 10
  21. 2024Planner3D: LLM-enhanced graph prior meets 3D indoor scene explicit regularizationcited by 9
  22. 2024HouseCrafter: Lifting Floorplans to 3D Scenes with 2D Diffusion Modelcited by 9
  23. 2025Controllable 3D Outdoor Scene Generation via Scene Graphscited by 9
  24. 2025CHOrD: Generation of Collision-Free, House-Scale, and Organized Digital Twins for 3D Indoor Scenes with Controllable Floor Plans and Optimal Layoutscited by 9
  25. 2026SimRecon: SimReady Compositional Scene Reconstruction from Real Videoscited by 9
  26. 2024DNF: Unconditional 4D Generation with Dictionary-based Neural Fieldscited by 8
  27. 2025Steerable Scene Generation with Post Training and Inference-Time Searchcited by 8
  28. 2025PlaceIt3D: Language-Guided Object Placement in Real 3D Scenescited by 8
  29. 2025FreeScene: Mixed Graph Diffusion for 3D Scene Synthesis from Free Promptscited by 8
  30. 2025Yo'City: Personalized and Boundless 3D Realistic City Scene Generation via Self-Critic Expansioncited by 8
  31. 2024Learning to Edit Visual Programs with Self-Supervisioncited by 7
  32. 2025Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Datacited by 7
  33. 2025Video Perception Models for 3D Scene Synthesiscited by 7
  34. 2025LADB: Latent Aligned Diffusion Bridges for Semi-Supervised Domain Translationcited by 7
  35. 2025TRELLISWorld: Training-Free World Generation from Object Generatorscited by 7
  36. 2026SceneCode: Executable World Programs for Editable Indoor Scenes with Articulated Objectscited by 7
  37. 2025LACONIC: A 3D Layout Adapter for Controllable Image Creationcited by 6
  38. 2025Towards Geometric and Textural Consistency 3D Scene Generation via Single Image-guided Model Generation and Layout Optimizationcited by 6

50 most cited of 159 All 159 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Mixed Diffusion for 3D Indoor Scene Synthesis
  2. 2023DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generation
  3. 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation
  4. 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusion
  5. 2024Move Anything with Layered Scene Diffusion
  6. 2023CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusion
  7. 2023RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texture
  8. 20263D Scene Graph Prediction: Generating Hierarchical Models from Partially Observed Environments