mlsanityData to 7 Oct 2026

Text2BIM: Generating Building Models Using a Large Language Model-based Multi-Agent Framework

arXiv 2408.08054 ↗First posted 15 Aug 2024cs.AI cs.CL cs.SEcited by 9

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

The conventional BIM authoring process typically requires designers to master complex and tedious modeling commands in order to materialize their design intentions within BIM authoring tools. This additional cognitive burden complicates the design process and hinders the adoption of BIM and model-based design in the AEC (Architecture, Engineering, and Construction) industry. To facilitate the expression of design intentions more intuitively, we propose Text2BIM, an LLM-based multi-agent framework that can generate 3D building models from natural language instructions. This framework orchestrates multiple LLM agents to collaborate and reason, transforming textual user input into imperative code that invokes the BIM authoring tool's APIs, thereby generating editable BIM models with internal layouts, external envelopes, and semantic information directly in the software. Furthermore, a rule-based model checker is introduced into the agentic workflow, utilizing predefined domain knowledge to guide the LLM agents in resolving issues within the generated models and iteratively improving model quality. Extensive experiments were conducted to compare and analyze the performance of three different LLMs under the proposed framework. The evaluation results demonstrate that our approach can effectively generate high-quality, structurally rational building models that are aligned with the abstract concepts specified by user input. Finally, an interactive software prototype was developed to integrate the framework into the BIM authoring software Vectorworks, showcasing the potential of modeling by chatting. The code is available at: https://github.com/dcy0577/Text2BIM

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 25 of its 68 references that are in the map. First posted on arXiv 15 Aug 2024.

Builds on

25 of 68 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code2 Mar

Other references · 24

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  5. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  6. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  7. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  8. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  9. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  10. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  11. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  12. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
12 more
  1. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
  2. 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 91
  3. 2024I-Design: Personalized LLM Interior Designercited by 87
  4. 2022HouseDiffusion: Vector Floorplan Generation via a Diffusion Model with Discrete and Continuous Denoisingcited by 72
  5. 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedbackcited by 31
  6. 2021ActFloor-GAN: Activity-Guided Adversarial Networks for Human-Centric Floorplan Designcited by 12
  7. 2024Generative AI Models for Different Steps in Architectural Design: A Literature Reviewcited by 12
  8. 2023Generative AIBIM: An automatic and intelligent structural design pipeline integrating BIM and generative AIcited by 8
  9. 2024Towards a copilot in BIM authoring tool using a large language model-based agent for intelligent human-machine interactioncited by 6
  10. 2022Vitruvio: 3D Building Meshes via Single Perspective Sketchescited by 5
  11. 2024Sketch-to-Architecture: Generative AI-aided Architectural Designcited by 4
  12. 2024Towards commands recommender system in BIM authoring tool using transformerscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 4.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Intelligent Co-Design: An Interactive LLM Framework for Interior Spatial Design via Multi-Modal Agents
  2. 2025Automatic Building Code Review: A Case Study
  3. 2026Agentic Large Language Models for Automated Structural Analysis of 3D Frame Systems
  4. 2026A Novel Multi-Agent Architecture to Reduce Hallucinations of Large Language Models in Multi-Step Structural Modeling
  5. 2024LLM4DESIGN: An Automated Multi-Modal System for Architectural and Environmental Design
  6. 2025From Idea to CAD: A Language Model-Driven Multi-Agent System for Collaborative Design
  7. 2025CADDesigner: Conceptual CAD Model Generation with a General-Purpose Agent
  8. 2025A Lightweight Large Language Model-Based Multi-Agent System for 2D Frame Structural Analysis