AI Art in Architecture
Not on the map. Why?
Abstract (arXiv)
Recent diffusion-based AI art platforms are able to create impressive images from simple text descriptions. This makes them powerful tools for concept design in any discipline that requires creativity in visual design tasks. This is also true for early stages of architectural design with multiple stages of ideation, sketching and modelling. In this paper, we investigate how applicable diffusion-based models already are to these tasks. We research the applicability of the platforms Midjourney, DALL-E 2 and StableDiffusion to a series of common use cases in architectural design to determine which are already solvable or might soon be. We also analyze how they are already being used by analyzing a data set of 40 million Midjourney queries with NLP methods to extract common usage patterns. With this insights we derived a workflow to interior and exterior design that combines the strengths of the individual platforms.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 20 of its 23 references that are in the map. First posted on arXiv 19 Dec 2022.
Builds on
20 of 23 references.
References · 20
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2022Video Diffusion Modelscited by 2,280
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
8 more
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
- 2022Human Motion Diffusion Modelcited by 1,062
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2022Generated Faces in the Wild: Quantitative Comparison of Stable Diffusion, Midjourney and DALL-E 2cited by 55
- 2022DALLE-URBAN: Capturing the urban design expertise of large text to image transformerscited by 12
Built on by
Citing papers per year: 2023: 5; 2024: 5; 2025: 2.
12 papers.
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 288
- 2024StableIdentity: Inserting Anybody into Anywhere at First Sightcited by 35
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Modelscited by 24
- 2023Transformation vs Tradition: Artificial General Intelligence (AGI) for Arts and Humanitiescited by 9
- 2024SCAPE: Searching Conceptual Architecture Prompts using Evolutioncited by 4
- 2024From Pampas to Pixels: Fine-Tuning Diffusion Models for Ga'ucho Heritagecited by 3
- 2023Automating Computational Design with Generative AIcited by 2
- 2025Evaluation of Architectural Synthesis Using Generative AIcited by 1
- 2023ArchiGuesser -- AI Art Architecture Educational Gamecited by 0
- 2023Generative AI and the History of Architecturecited by 0
- 2024Empowering Clients -- Transformation of Design Processes Due to Generative AIcited by 0
- 2025ArchShapeNet:An Interpretable 3D-CNN Framework for Evaluating Architectural Shapescited by 0
- 2025ArchShapeNet:An Interpretable 3D-CNN Framework for Evaluating Architectural Shapes14 Jun 2025
- 2025Evaluation of Architectural Synthesis Using Generative AI4 Mar 2025
- 2024Empowering Clients -- Transformation of Design Processes Due to Generative AI22 Nov 2024
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Models24 Apr 2024
- 2024SCAPE: Searching Conceptual Architecture Prompts using Evolution31 Jan 2024
- 2024StableIdentity: Inserting Anybody into Anywhere at First Sight29 Jan 2024
- 2024From Pampas to Pixels: Fine-Tuning Diffusion Models for Ga'ucho Heritage10 Jan 2024
- 2023Generative AI and the History of Architecture22 Dec 2023
- 2023ArchiGuesser -- AI Art Architecture Educational Game14 Dec 2023
- 2023A Survey on Multimodal Large Language Models for Autonomous Driving21 Nov 2023
- 2023Transformation vs Tradition: Artificial General Intelligence (AGI) for Arts and Humanities30 Oct 2023
- 2023Automating Computational Design with Generative AI5 Jul 2023