mlsanityData to 7 Oct 2026

BlobGAN-3D: A Spatially-Disentangled 3D-Aware Generative Model for Indoor Scenes

arXiv 2303.14706 ↗First posted 26 Mar 2023cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

3D-aware image synthesis has attracted increasing interest as it models the 3D nature of our real world. However, performing realistic object-level editing of the generated images in the multi-object scenario still remains a challenge. Recently, a 2D GAN termed BlobGAN has demonstrated great multi-object editing capabilities on real-world indoor scene datasets. In this work, we propose BlobGAN-3D, which is a 3D-aware improvement of the original 2D BlobGAN. We enable explicit camera pose control while maintaining the disentanglement for individual objects in the scene by extending the 2D blobs into 3D blobs. We keep the object-level editing capabilities of BlobGAN and in addition allow flexible control over the 3D location of the objects in the scene. We test our method on real-world indoor datasets and show that our method can achieve comparable image quality compared to the 2D BlobGAN and other 3D-aware GAN baselines while being able to enable camera pose control and object-level editing in the challenging multi-object real-world scenarios.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 61 of its 73 references that are in the map. First posted on arXiv 26 Mar 2023.

Builds on

61 of 73 references.

References · 61

  1. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  2. 2022Generative Adversarial Networkscited by 5,603
  3. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  4. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  5. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  6. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  7. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  8. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  9. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
  10. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  11. 2018Demystifying MMD GANscited by 1,268
  12. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
38 more
  1. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
  2. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  3. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  4. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
  5. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  6. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  7. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  8. 2020Convolutional Occupancy Networkscited by 760
  9. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  10. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  11. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
  12. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
  13. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  14. 2019MONet: Unsupervised Scene Decomposition and Representationcited by 388
  15. 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
  16. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
  17. 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
  18. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  19. 2020StyleRig: Rigging StyleGAN for 3D Control over Portrait Imagescited by 267
  20. 2019Learning Shape Templates with Structured Implicit Functionscited by 242
  21. 2019GENESIS: Generative Scene Inference and Sampling with Object-Centric Latent Representationscited by 227
  22. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  23. 2016Attend, Infer, Repeat: Fast Scene Understanding with Generative Modelscited by 209
  24. 2021Projected GANs Converge Fastercited by 204
  25. 2018Escaping Plato's Cave: 3D Shape From Adversarial Renderingcited by 170
  26. 2020BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Imagescited by 166
  27. 2021StyleSwin: Transformer-based GAN for High-resolution Image Generationcited by 152
  28. 2021CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesiscited by 149
  29. 2022VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Gridscited by 133
  30. 2018Sequential Attend, Infer, Repeat: Generative Modelling of Moving Objectscited by 128
  31. 2018Visual Object Networks: Image Generation with Disentangled 3D Representationcited by 124
  32. 2021FENeRF: Face Editing in Neural Radiance Fieldscited by 112
  33. 20213D-aware Image Synthesis via Learning Structural and Textural Representationscited by 109
  34. 2022EpiGRAF: Rethinking training of 3D GANscited by 108
  35. 2020Image Generators with Conditionally-Independent Pixel Synthesiscited by 105
  36. 2019Towards Unsupervised Learning of Generative Models for 3D Controllable Image Synthesiscited by 104
  37. 2022GIRAFFE HD: A High-Resolution 3D-aware Generative Modelcited by 86
  38. 2021Ensembling Off-the-shelf Models for GAN Trainingcited by 84

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 3; 2025: 3; 2026: 1.

8 papers.

  1. 2024Neural Assets: 3D-Aware Multi-Object Scene Synthesis with Image Diffusion Modelscited by 30
  2. 2024Editable Image Elements for Controllable Synthesiscited by 13
  3. 2024Unsupervised Discovery of Object-Centric Neural Fieldscited by 12
  4. 2025Compass Control: Multi Object Orientation Control for Text-to-Image Generationcited by 11
  5. 2026SeeThrough3D: Occlusion Aware 3D Control in Text-to-Image Generationcited by 4
  6. 2025BlobCtrl: Taming Controllable Blob for Element-level Image Editingcited by 2
  7. 2023Survey on Controlable Image Synthesis with Deep Learningcited by 0
  8. 2025LPA3D: 3D Room-Level Scene Generation from In-the-Wild Imagescited by 0