mlsanityData to 7 Oct 2026

Generative AIBIM: An automatic and intelligent structural design pipeline integrating BIM and generative AI

arXiv 2311.04052 ↗First posted 7 Nov 2023cs.LG cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

AI-based structural design represents a transformative approach that addresses the inefficiencies inherent in traditional structural design practices. This paper innovates the existing AI-based design frameworks from four aspects and proposes Generative AIBIM: an intelligent design pipeline that integrates BIM and generative AI. First, the proposed pipeline not only broadens the application scope of BIM, which aligns with BIM's growing relevance in civil engineering, but also marks a significant supplement to previous methods that relied on CAD drawings. Second, a two-stage generation framework incorporating generative AI (TGAI), inspired by the human drawing process, is designed to simplify the complexity of the design problem. Third, for the AI model in TGAI, this paper pioneers to fuse physical conditions into diffusion models (DMs) to build a novel physics-based conditional diffusion model (PCDM). In contrast to conventional DMs, on the one hand, PCDM directly predicts shear wall drawings to focus on similarity, and on the other hand, PCDM effectively fuses cross-domain information, i.e., design drawings, timesteps, and physical conditions, by integrating well-designed attention modules. Additionally, a new evaluation system including objective and subjective measures is designed to evaluate models' performance, complementing the evaluation system in the traditional methods. The quantitative results demonstrate that PCDM significantly surpasses recent SOTA techniques across both measures. The qualitative results highlight PCDM's superior capabilities in generating high-perceptual-quality drawings adhering to essential design criteria. In addition, benefiting from the fusion of physical conditions, PCDM effectively supports diverse and creative designs tailored to building heights and seismic precautionary intensities, showcasing its unique generation and generalization abilities.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 42 of its 101 references that are in the map. First posted on arXiv 7 Nov 2023.

Builds on

42 of 101 references.

References · 42

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  9. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  10. 2022Scalable Diffusion Models with Transformerscited by 5,931
  11. 2022Generative Adversarial Networkscited by 5,603
  12. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
30 more
  1. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  2. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  3. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  4. 2016Improved Techniques for Training GANscited by 2,938
  5. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  6. 2022Emergent Abilities of Large Language Modelscited by 2,483
  7. 2015Variational Inference with Normalizing Flowscited by 2,161
  8. 2016Density estimation using Real NVPcited by 2,029
  9. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  10. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
  11. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  12. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
  13. 2022Denoising Diffusion Restoration Modelscited by 951
  14. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
  15. 2016Pixel Recurrent Neural Networkscited by 814
  16. 2017The Perception-Distortion Tradeoffcited by 582
  17. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 574
  18. 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 366
  19. 2022Understanding Diffusion Models: A Unified Perspectivecited by 337
  20. 2017Are GANs Created Equal? A Large-Scale Studycited by 267
  21. 2021Deblurring via Stochastic Refinementcited by 248
  22. 2016Unrolled Generative Adversarial Networkscited by 208
  23. 2017VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learningcited by 199
  24. 2023Generative AIcited by 119
  25. 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generationcited by 104
  26. 2023Hierarchical Integration Diffusion Model for Realistic Image Deblurringcited by 87
  27. 2020House-GAN: Relational Generative Adversarial Networks for Graph-constrained House Layout Generationcited by 86
  28. 2023Unsupervised Hyperspectral Pansharpening via Low-rank Diffusion Modelcited by 19
  29. 2022iPLAN: Interactive and Procedural Layout Planningcited by 8
  30. 2020Data fusion strategies for energy efficiency in buildings: Overview, challenges and novel orientationscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 3; 2026: 3.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Large Language Model Agent for Structural Drawing Generation Using ReAct Prompt Engineering and Retrieval Augmented Generation
  2. 2023Constructing a personalized AI assistant for shear wall layout using Stable Diffusion
  3. 2023Automating Computational Design with Generative AI
  4. 2026Generative AI for material design: A mechanics perspective from burgers to matter
  5. 2024Generating floorplans for various building functionalities via latent diffusion model
  6. 2025From Architectural Sketch to Conceptual Representation: Using Structure-Aware Diffusion Model to Generate Renderings of School Buildings
  7. 2024Exploring Gen-AI applications in building research and industry: A review
  8. 2024A Dataset for Mechanical Mechanisms