mlsanityData to 7 Oct 2026

Using Text-to-Image Generation for Architectural Design Ideation

arXiv 2304.10182 ↗First posted 20 Apr 2023cs.HC cs.AI cs.CVcited by 16

Not on the map. Why?

Abstract (arXiv)

The recent progress of text-to-image generation has been recognized in architectural design. Our study is the first to investigate the potential of text-to-image generators in supporting creativity during the early stages of the architectural design process. We conducted a laboratory study with 17 architecture students, who developed a concept for a culture center using three popular text-to-image generators: Midjourney, Stable Diffusion, and DALL-E. Through standardized questionnaires and group interviews, we found that image generation could be a meaningful part of the design process when design constraints are carefully considered. Generative tools support serendipitous discovery of ideas and an imaginative mindset, enriching the design process. We identified several challenges of image generators and provided considerations for software development and educators to support creativity and emphasize designers' imaginative mindset. By understanding the limitations and potential of text-to-image generators, architects and designers can leverage this technology in their design process and education, facilitating innovation and effective communication of concepts.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 17 of its 43 references that are in the map. First posted on arXiv 20 Apr 2023.

Builds on

17 of 43 references.

References · 17

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  4. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  5. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  6. 2022Emergent Abilities of Large Language Modelscited by 2,483
  7. 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 599
  8. 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
  9. 2022The Creativity of Text-to-Image Generationcited by 73
  10. 2022A Taxonomy of Prompt Modifiers for Text-To-Image Generationcited by 54
  11. 2023Prompting AI Art: An Investigation into the Creative Skill of Prompt Engineeringcited by 40
  12. 2023A Prompt Log Analysis of Text-to-Image Generation Systemscited by 24
5 more
  1. 2023The Prompt Artistscited by 21
  2. 2022The Data-Production Dispositifcited by 16
  3. 2022DALLE-URBAN: Capturing the urban design expertise of large text to image transformerscited by 12
  4. 2023A Word is Worth a Thousand Pictures: Prompts as AI Design Materialcited by 8
  5. 2023Architext: Language-Driven Generative Architecture Designcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 7; 2025: 5; 2026: 2.

16 papers.

Sort:

By area:

  1. 2024Generative AI Models for Different Steps in Architectural Design: A Literature Reviewcited by 12
  2. 2026When Safety Collides: Resolving Multi-Category Harmful Conflicts in Text-to-Image Diffusion via Adaptive Safety Guidancecited by 9
  3. 2025POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generationcited by 6
  4. 2023Perceptions and Realities of Text-to-Image Generationcited by 5
  5. 2024SCAPE: Searching Conceptual Architecture Prompts using Evolutioncited by 4
  6. 2023The Cultivated Practices of Text-to-Image Generationcited by 3
  7. 2024CAD-Prompted Generative Models: A Pathway to Feasible and Novel Engineering Designscited by 3
  8. 2025Exploring Language Patterns of Prompts in Text-to-Image Generation and Their Impact on Visual Diversitycited by 3
  9. 2024Automatic Scene Generation: State-of-the-Art Techniques, Models, Datasets, Challenges, and Future Prospectscited by 2
  10. 2024Offline Evaluation of Set-Based Text-to-Image Generationcited by 1
  11. 2025RMLer: Synthesizing Novel Objects across Diverse Categories via Reinforcement Mixing Learningcited by 1
  12. 2026Investigating Social Bias in Narrative Image Generationcited by 1
4 more
  1. 2024Empowering Clients -- Transformation of Design Processes Due to Generative AIcited by 0
  2. 2024Generative Visual Communication in the Era of Vision-Language Modelscited by 0
  3. 2025From Architectural Sketch to Conceptual Representation: Using Structure-Aware Diffusion Model to Generate Renderings of School Buildingscited by 0
  4. 2025ArchShapeNet:An Interpretable 3D-CNN Framework for Evaluating Architectural Shapescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Trash to Treasure: Using text-to-image models to inform the design of physical artefacts
  2. 2023Text Semantics to Image Generation: A method of building facades design base on Stable Diffusion model
  3. 2025DesignDiffusion: High-Quality Text-to-Design Image Generation with Diffusion Models
  4. 2024IDEA-Bench: How Far are Generative Models from Professional Designing?
  5. 2024Inspired by AI? A Novel Generative AI System To Assist Conceptual Automotive Design
  6. 2024Exploring Gen-AI applications in building research and industry: A review
  7. 2026PosterIQ: A Design Perspective Benchmark for Poster Understanding and Generation
  8. 2025Generative AI for Urban Design: A Stepwise Approach Integrating Human Expertise with Multimodal Diffusion Models