mlsanityData to 7 Oct 2026

Architext: Language-Driven Generative Architecture Design

arXiv 2303.07519 ↗First posted 13 Mar 2023cs.CL cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

Architectural design is a highly complex practice that involves a wide diversity of disciplines, technologies, proprietary design software, expertise, and an almost infinite number of constraints, across a vast array of design tasks. Enabling intuitive, accessible, and scalable design processes is an important step towards performance-driven and sustainable design for all. To that end, we introduce Architext, a novel semantic generation assistive tool. Architext enables design generation with only natural language prompts, given to large-scale Language Models, as input. We conduct a thorough quantitative evaluation of Architext's downstream task performance, focusing on semantic accuracy and diversity for a number of pre-trained language models ranging from 120 million to 6 billion parameters. Architext models are able to learn the specific design task, generating valid residential layouts at a near 100% rate. Accuracy shows great improvement when scaling the models, with the largest model (GPT-J) yielding impressive accuracy ranging between 25% to over 80% for different prompt categories. We open source the finetuned Architext models and our synthetic dataset, hoping to inspire experimentation in this exciting area of design research.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 70 of its 94 references that are in the map. First posted on arXiv 13 Mar 2023.

Builds on

70 of 94 references.

References · 70

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  8. 2020Scaling Laws for Neural Language Modelscited by 6,411
  9. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  10. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  11. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  12. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
38 more
  1. 2017Deep reinforcement learning from human preferencescited by 3,846
  2. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  3. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  5. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  6. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  7. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
  8. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
  9. 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
  10. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
  11. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
  12. 2022Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learningcited by 886
  13. 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 871
  14. 2022Language-driven Semantic Segmentationcited by 711
  15. 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 636
  16. 2022GroupViT: Semantic Segmentation Emerges from Text Supervisioncited by 529
  17. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
  18. 2020Scaling Laws for Autoregressive Generative Modelingcited by 510
  19. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  20. 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 305
  21. 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
  22. 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 268
  23. 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
  24. 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
  25. 2022Synchromesh: Reliable code generation from pre-trained language modelscited by 156
  26. 2022CM3: A Causal Masked Multimodal Model of the Internetcited by 142
  27. 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 130
  28. 2020ProGen: Language Modeling for Protein Generationcited by 127
  29. 2019Reinforcement Learning Upside Down: Don't Predict Rewards -- Just Map Them to Actionscited by 124
  30. 2017Quality and Diversity Optimization: A Unifying Modular Frameworkcited by 111
  31. 2021CLIP-It! Language-Guided Video Summarizationcited by 99
  32. 2022Language Models Can See: Plugging Visual Controls in Text Generationcited by 89
  33. 2020House-GAN: Relational Generative Adversarial Networks for Graph-constrained House Layout Generationcited by 86
  34. 2021MAGMA -- Multimodal Augmentation of Generative Models through Adapter-based Finetuningcited by 85
  35. 2021Computer-Aided Design as Languagecited by 82
  36. 2021SketchGen: Generating Constrained CAD Sketchescited by 68
  37. 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
  38. 2022Correcting Robot Plans with Natural Language Feedbackcited by 68

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 2; 2025: 0; 2026: 1.

5 papers.