mlsanityData to 13 Oct 2026

Pro-DG: Procedural Diffusion Guidance for Architectural Facade Generation

arXiv 2504.01571 ↗First posted 2 Apr 2025cs.GR cs.AI cs.CVcited by 3

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We use hierarchical procedural rules for the generation of control maps within the stable diffusion framework to produce photo-realistic architectural facade images. Starting from a single input image and its segmentation, we apply an inverse procedural module to identify the facade's hierarchical layout. Leveraging this hierarchy and structural features, we introduce a novel ControlNet pipeline that generates new facade imagery guided by procedural transformations. Our method enables various structural edits, including floor duplication and window rearrangement, by integrating hierarchical alignment directly into control maps. This precisely guides the diffusion-based generative process, ensuring local appearance fidelity alongside extensive structural modifications. Comprehensive evaluations, including comparisons with inpainting-based approaches and synthetic benchmarks, confirm our approach's superior capability in preserving architectural identity and achieving accurate, controllable edits. Quantitative results and user feedback validate our method's effectiveness.

Key facts. Cited by 3 papers in the map (data through 13 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 25 of its 50 references that are in the map. First posted on arXiv 2 Apr 2025.

Builds on

25 of 50 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3D2 Dec
  2. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar

Other references · 23

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,952
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,321
  5. 2020Denoising Diffusion Implicit Modelscited by 9,718
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,023
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,564
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,339
  9. 2022Scalable Diffusion Models with Transformerscited by 5,973
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,484
  11. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,299
  12. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,604
11 more
  1. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,453
  2. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,342
  3. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,174
  4. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 926
  5. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 532
  6. 2023Training-Free Layout Control with Cross-Attention Guidancecited by 312
  7. 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 218
  8. 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
  9. 2023OBJECT 3DIT: Language-guided 3D-aware Image Editingcited by 63
  10. 2025VideoHandles: Editing 3D Object Compositions in Videos Using Video Generative Priorscited by 14
  11. 2024FaccAID: A Transformer Model for Neuro-Symbolic Facade Reconstructioncited by 5

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025From Architectural Sketch to Conceptual Representation: Using Structure-Aware Diffusion Model to Generate Renderings of School Buildings
  2. 2023Text Semantics to Image Generation: A method of building facades design base on Stable Diffusion model
  3. 2024DiffDesign: Controllable Diffusion with Meta Prior for Efficient Interior Design Generation
  4. 2023Advancing Urban Renewal: An Automated Approach to Generating Historical Arcade Facades with Stable Diffusion Models
  5. 2026Sketch-Based Facade Renovation With Generative AI: A Streamlined Framework for Bypassing As-Built Modelling in Industrial Adaptive Reuse
  6. 2024Generating Daylight-driven Architectural Design via Diffusion Models
  7. 2025FacaDiffy: Inpainting Unseen Facade Parts Using Diffusion Models
  8. 2025Multi-View Depth Consistent Image Generation Using Generative AI Models: Application on Architectural Design of University Buildings