mlsanityData to 7 Oct 2026

CC3D: Layout-Conditioned Generation of Compositional 3D Scenes

arXiv 2303.12074 ↗First posted 21 Mar 2023cs.CVcited by 58

Not on the map. Why?

Cited by 21 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

In this work, we introduce CC3D, a conditional generative model that synthesizes complex 3D scenes conditioned on 2D semantic scene layouts, trained using single-view images. Different from most existing 3D GANs that limit their applicability to aligned single objects, we focus on generating complex scenes with multiple objects, by modeling the compositional nature of 3D scenes. By devising a 2D layout-based approach for 3D synthesis and implementing a new 3D field representation with a stronger geometric inductive bias, we have created a 3D GAN that is both efficient and of high quality, while allowing for a more controllable generation process. Our evaluations on synthetic 3D-FRONT and real-world KITTI-360 datasets demonstrate that our model generates scenes of improved visual and geometric quality in comparison to previous works.

Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). Builds on 56 of its 64 references that are in the map. First posted on arXiv 21 Mar 2023.

Builds on

56 of 64 references.

References · 56

  1. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  2. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  3. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  4. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  5. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  6. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  7. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
  8. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
  9. 2018Demystifying MMD GANscited by 1,268
  10. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  11. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  12. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
38 more
  1. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  2. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  3. 2020Convolutional Occupancy Networkscited by 760
  4. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  5. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
  6. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  7. 2018Which Training Methods for GANs do actually Converge?cited by 672
  8. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  9. 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
  10. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  11. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
  12. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  13. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  14. 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
  15. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
  16. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  17. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  18. 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
  19. 2020BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Imagescited by 166
  20. 2021EditGAN: High-Precision Semantic Image Editingcited by 156
  21. 2020SceneFormer: Indoor Scene Generation with Transformerscited by 154
  22. 2021CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesiscited by 149
  23. 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
  24. 2021Unconstrained Scene Generation with Locally Conditioned Radiance Fieldscited by 130
  25. 2021Generative Adversarial Transformerscited by 120
  26. 20213D-aware Image Synthesis via Learning Structural and Textural Representationscited by 109
  27. 2022EpiGRAF: Rethinking training of 3D GANscited by 108
  28. 2018Fast and Flexible Indoor Scene Synthesis via Deep Convolutional Generative Modelscited by 105
  29. 2022GIRAFFE HD: A High-Resolution 3D-aware Generative Modelcited by 86
  30. 2023LEGO-Net: Learning Regular Rearrangements of Objects in Roomscited by 75
  31. 2022Pix2NeRF: Unsupervised Conditional π-GAN for Single Image to Neural Radiance Fields Translationcited by 73
  32. 2023SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collectionscited by 72
  33. 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
  34. 2022DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesiscited by 61
  35. 2021CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fieldscited by 55
  36. 20223D GAN Inversion for Controllable Portrait Image Animationcited by 53
  37. 20233D generation on ImageNetcited by 47
  38. 2022BlobGAN: Spatially Disentangled Scene Representationscited by 35

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 12; 2024: 24; 2025: 14; 2026: 8.

58 papers.

Sort:

By area:

  1. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  2. 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 151
  3. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
  4. 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 98
  5. 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 81
  6. 2024BlockFusion: Expandable 3D Scene Generation using Latent Tri-plane Extrapolationcited by 81
  7. 2024TC4D: Trajectory-Conditioned Text-to-4D Generationcited by 76
  8. 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusioncited by 66
  9. 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
  10. 2024Advances in 3D Generation: A Surveycited by 62
  11. 2023Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraintscited by 59
  12. 2023CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusioncited by 54
38 more
  1. 2023ControlRoom3D: Room Generation using Semantic Proxy Roomscited by 54
  2. 2023SceneWiz3D: Towards Text-guided 3D Scene Compositioncited by 54
  3. 2023RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texturecited by 53
  4. 2024LT3SD: Latent Trees for 3D Scene Diffusioncited by 53
  5. 2024Streetscapes: Large-scale Consistent Street View Generation Using Autoregressive Video Diffusioncited by 39
  6. 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 37
  7. 2026Lyra 2.0: Explorable Generative 3D Worldscited by 36
  8. 2024Prometheus: 3D-Aware Latent Diffusion Models for Feed-Forward Text-to-3D Scene Generationcited by 33
  9. 2024ScaleDreamer: Scalable Text-to-3D Synthesis with Asynchronous Score Distillationcited by 27
  10. 2023UrbanGIRAFFE: Representing Urban Scenes as Compositional Generative Neural Feature Fieldscited by 26
  11. 2024Frankenstein: Generating Semantic-Compositional 3D Scenes in One Tri-Planecited by 26
  12. 2024SceneFactor: Factored Latent 3D Diffusion for Controllable 3D Scene Generationcited by 24
  13. 2023CAD: Photorealistic 3D Generation via Adversarial Distillationcited by 18
  14. 2024Urban Architect: Steerable 3D Urban Scene Generation with Layout Priorcited by 17
  15. 2023RoomDesigner: Encoding Anchor-latents for Style-consistent and Shape-compatible Indoor Scene Generationcited by 12
  16. 2024Edify 3D: Scalable High-Quality 3D Asset Generationcited by 10
  17. 2024Planner3D: LLM-enhanced graph prior meets 3D indoor scene explicit regularizationcited by 9
  18. 2024HouseCrafter: Lifting Floorplans to 3D Scenes with 2D Diffusion Modelcited by 9
  19. 2024Lay-A-Scene: Personalized 3D Object Arrangement Using Text-to-Image Priorscited by 7
  20. 2025Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Datacited by 7
  21. 2025Revisiting CAD Model Generation by Learning Raster Sketchcited by 6
  22. 2025From Programs to Poses: Factored Real-World Scene Generation via Learned Program Librariescited by 6
  23. 2025GPS as a Control Signal for Image Generationcited by 5
  24. 2023Efficient Text-Guided 3D-Aware Portrait Generation with Score Distillation Sampling on Distributioncited by 4
  25. 2023BerfScene: Bev-conditioned Equivariant Radiance Fields for Infinite 3D Scene Generationcited by 4
  26. 2024Grounded Compositional and Diverse Text-to-3D with Pretrained Multi-View Diffusion Modelcited by 3
  27. 2025Computer-Aided Layout Generation for Building Design: A Reviewcited by 3
  28. 2024MaGRITTe: Manipulative and Generative 3D Realization from Image, Topview and Textcited by 2
  29. 2025Why Settle for Mid: A Probabilistic Viewpoint to Spatial Relationship Alignment in Text-to-image Modelscited by 2
  30. 2024Style-Consistent 3D Indoor Scene Synthesis with Decoupled Objectscited by 1
  31. 2025Programmable-Room: Interactive Textured 3D Room Meshes Generation Empowered by Large Language Modelscited by 1
  32. 2025PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenescited by 1
  33. 2025DreamScene: 3D Gaussian-based End-to-end Text-to-3D Scene Generationcited by 1
  34. 2025MVRoom: Controllable 3D Indoor Scene Generation with Multi-View Diffusion Modelscited by 1
  35. 2026ScenDi: 3D-to-2D Scene Diffusion Cascades for Urban Generationcited by 1
  36. 2026RoamScene3D: Immersive Text-to-3D Scene Generation via Adaptive Object-aware Roamingcited by 1
  37. 2026Cog2Gen3D: Sculpturing 3D Semantic-Geometric Cognition for 3D Generationcited by 1
  38. 2026HOG-Layout: Hierarchical 3D Scene Generation, Optimization and Editing via Vision-Language Modelscited by 1

50 most cited of 58 All 58 (JSON)