Architext: Language-Driven Generative Architecture Design
Not on the map. Why?
Abstract (arXiv)
Architectural design is a highly complex practice that involves a wide diversity of disciplines, technologies, proprietary design software, expertise, and an almost infinite number of constraints, across a vast array of design tasks. Enabling intuitive, accessible, and scalable design processes is an important step towards performance-driven and sustainable design for all. To that end, we introduce Architext, a novel semantic generation assistive tool. Architext enables design generation with only natural language prompts, given to large-scale Language Models, as input. We conduct a thorough quantitative evaluation of Architext's downstream task performance, focusing on semantic accuracy and diversity for a number of pre-trained language models ranging from 120 million to 6 billion parameters. Architext models are able to learn the specific design task, generating valid residential layouts at a near 100% rate. Accuracy shows great improvement when scaling the models, with the largest model (GPT-J) yielding impressive accuracy ranging between 25% to over 80% for different prompt categories. We open source the finetuned Architext models and our synthetic dataset, hoping to inspire experimentation in this exciting area of design research.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 70 of its 94 references that are in the map. First posted on arXiv 13 Mar 2023.
Builds on
70 of 94 references.
References · 70
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
38 more
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
- 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
- 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2022Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learningcited by 886
- 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 871
- 2022Language-driven Semantic Segmentationcited by 711
- 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 636
- 2022GroupViT: Semantic Segmentation Emerges from Text Supervisioncited by 529
- 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
- 2020Scaling Laws for Autoregressive Generative Modelingcited by 510
- 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
- 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 305
- 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
- 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 268
- 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
- 2022Synchromesh: Reliable code generation from pre-trained language modelscited by 156
- 2022CM3: A Causal Masked Multimodal Model of the Internetcited by 142
- 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 130
- 2020ProGen: Language Modeling for Protein Generationcited by 127
- 2019Reinforcement Learning Upside Down: Don't Predict Rewards -- Just Map Them to Actionscited by 124
- 2017Quality and Diversity Optimization: A Unifying Modular Frameworkcited by 111
- 2021CLIP-It! Language-Guided Video Summarizationcited by 99
- 2022Language Models Can See: Plugging Visual Controls in Text Generationcited by 89
- 2020House-GAN: Relational Generative Adversarial Networks for Graph-constrained House Layout Generationcited by 86
- 2021MAGMA -- Multimodal Augmentation of Generative Models through Adapter-based Finetuningcited by 85
- 2021Computer-Aided Design as Languagecited by 82
- 2021SketchGen: Generating Constrained CAD Sketchescited by 68
- 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
- 2022Correcting Robot Plans with Natural Language Feedbackcited by 68
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2023: 2; 2024: 2; 2025: 0; 2026: 1.
5 papers.
- 2023Using Text-to-Image Generation for Architectural Design Ideationcited by 16
- 2023Next Steps for Human-Centered Generative AI: A Technical Perspectivecited by 13
- 2024DStruct2Design: Data and Benchmarks for Data Structure Driven Generative Floor Plan Designcited by 5
- 2024Sketch-to-Architecture: Generative AI-aided Architectural Designcited by 4
- 2026Generative Floor Plan Design with LLMs via Reinforcement Learning with Verifiable Rewardscited by 0
- 2026Generative Floor Plan Design with LLMs via Reinforcement Learning with Verifiable Rewards13 May 2026
- 2024DStruct2Design: Data and Benchmarks for Data Structure Driven Generative Floor Plan Design22 Jul 2024
- 2024Sketch-to-Architecture: Generative AI-aided Architectural Design29 Mar 2024
- 2023Next Steps for Human-Centered Generative AI: A Technical Perspective27 Jun 2023
- 2023Using Text-to-Image Generation for Architectural Design Ideation20 Apr 2023