mlsanityData to 7 Oct 2026

Sketch-to-Architecture: Generative AI-aided Architectural Design

arXiv 2403.20186 ↗First posted 29 Mar 2024cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Recently, the development of large-scale models has paved the way for various interdisciplinary research, including architecture. By using generative AI, we present a novel workflow that utilizes AI models to generate conceptual floorplans and 3D models from simple sketches, enabling rapid ideation and controlled generation of architectural renderings based on textual descriptions. Our work demonstrates the potential of generative AI in the architectural design process, pointing towards a new direction of computer-aided architectural design. Our project website is available at: https://zrealli.github.io/sketch2arc

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 17 of its 23 references that are in the map. First posted on arXiv 29 Mar 2024.

Builds on

17 of 23 references.

References · 17

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  10. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  11. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  12. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
5 more
  1. 2022Blended Latent Diffusioncited by 430
  2. 2020House-GAN: Relational Generative Adversarial Networks for Graph-constrained House Layout Generationcited by 86
  3. 2023LayerDiffusion: Layered Controlled Image Editing with Diffusion Modelscited by 40
  4. 2022DALLE-URBAN: Capturing the urban design expertise of large text to image transformerscited by 12
  5. 2023Architext: Language-Driven Generative Architecture Designcited by 5

Built on by

Cited by year

Citing papers per year: 2024: 4.

4 papers.

  1. 2024ART3D: 3D Gaussian Splatting for Text-Guided Artistic Scenes Generationcited by 9
  2. 2024Text2BIM: Generating Building Models Using a Large Language Model-based Multi-Agent Frameworkcited by 9
  3. 2024Generating Daylight-driven Architectural Design via Diffusion Modelscited by 2
  4. 2024Challenges and Opportunities in 3D Content Generationcited by 1