Text2BIM: Generating Building Models Using a Large Language Model-based Multi-Agent Framework
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
The conventional BIM authoring process typically requires designers to master complex and tedious modeling commands in order to materialize their design intentions within BIM authoring tools. This additional cognitive burden complicates the design process and hinders the adoption of BIM and model-based design in the AEC (Architecture, Engineering, and Construction) industry. To facilitate the expression of design intentions more intuitively, we propose Text2BIM, an LLM-based multi-agent framework that can generate 3D building models from natural language instructions. This framework orchestrates multiple LLM agents to collaborate and reason, transforming textual user input into imperative code that invokes the BIM authoring tool's APIs, thereby generating editable BIM models with internal layouts, external envelopes, and semantic information directly in the software. Furthermore, a rule-based model checker is introduced into the agentic workflow, utilizing predefined domain knowledge to guide the LLM agents in resolving issues within the generated models and iteratively improving model quality. Extensive experiments were conducted to compare and analyze the performance of three different LLMs under the proposed framework. The evaluation results demonstrate that our approach can effectively generate high-quality, structurally rational building models that are aligned with the abstract concepts specified by user input. Finally, an interactive software prototype was developed to integrate the framework into the BIM authoring software Vectorworks, showcasing the potential of modeling by chatting. The code is available at: https://github.com/dcy0577/Text2BIM
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 25 of its 68 references that are in the map. First posted on arXiv 15 Aug 2024.
Builds on
25 of 68 references.
Closest ancestors · 1
Same direction, newest first
Other references · 24
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
12 more
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
- 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 91
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2022HouseDiffusion: Vector Floorplan Generation via a Diffusion Model with Discrete and Continuous Denoisingcited by 72
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedbackcited by 31
- 2021ActFloor-GAN: Activity-Guided Adversarial Networks for Human-Centric Floorplan Designcited by 12
- 2024Generative AI Models for Different Steps in Architectural Design: A Literature Reviewcited by 12
- 2023Generative AIBIM: An automatic and intelligent structural design pipeline integrating BIM and generative AIcited by 8
- 2024Towards a copilot in BIM authoring tool using a large language model-based agent for intelligent human-machine interactioncited by 6
- 2022Vitruvio: 3D Building Meshes via Single Perspective Sketchescited by 5
- 2024Sketch-to-Architecture: Generative AI-aided Architectural Designcited by 4
- 2024Towards commands recommender system in BIM authoring tool using transformerscited by 2
Built on by
Citing papers per year: 2025: 5; 2026: 4.
9 papers.
- 2025BIMgent: Towards Autonomous Building Modeling via Computer-use Agentscited by 10
- 2025Automating Structural Engineering Workflows with Large Language Model Agentscited by 6
- 2025MCP4IFC: IFC-Based Building Design Using Large Language Modelscited by 2
- 2025A Modular Reference Architecture for MCP-Servers Enabling Agentic BIM Interactioncited by 1
- 2025Sketch2BIM: A Multi-Agent Human-AI Collaborative Pipeline to Convert Hand-Drawn Floor Plans to 3D BIMcited by 0
- 2026TLC-Plan: A Two-Level Codebook Based Network for End-to-End Vector Floorplan Generationcited by 0
- 2026Multi-Agentic Approach for History Matching of Oil Reservoirscited by 0
- 2026A Building as a Repository: KIR, a Typed Intermediate Representation for Agent-Authored Building Information Modelscited by 0
- 2026K-OPSD: Verifiable On-Policy Self-Distillation for Post-Training Vision-Language Models on AEC Drawingscited by 0
- 2026K-OPSD: Verifiable On-Policy Self-Distillation for Post-Training Vision-Language Models on AEC Drawings28 Sep 2026
- 2026A Building as a Repository: KIR, a Typed Intermediate Representation for Agent-Authored Building Information Models13 Sep 2026
- 2026Multi-Agentic Approach for History Matching of Oil Reservoirs14 May 2026
- 2026TLC-Plan: A Two-Level Codebook Based Network for End-to-End Vector Floorplan Generation6 Feb 2026
- 2025A Modular Reference Architecture for MCP-Servers Enabling Agentic BIM Interaction21 Dec 2025
- 2025MCP4IFC: IFC-Based Building Design Using Large Language Models29 Oct 2025
- 2025Sketch2BIM: A Multi-Agent Human-AI Collaborative Pipeline to Convert Hand-Drawn Floor Plans to 3D BIM16 Oct 2025
- 2025Automating Structural Engineering Workflows with Large Language Model Agents13 Oct 2025
- 2025BIMgent: Towards Autonomous Building Modeling via Computer-use Agents8 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2026Intelligent Co-Design: An Interactive LLM Framework for Interior Spatial Design via Multi-Modal Agents
- 2025Automatic Building Code Review: A Case Study
- 2026Agentic Large Language Models for Automated Structural Analysis of 3D Frame Systems
- 2026A Novel Multi-Agent Architecture to Reduce Hallucinations of Large Language Models in Multi-Step Structural Modeling
- 2024LLM4DESIGN: An Automated Multi-Modal System for Architectural and Environmental Design
- 2025From Idea to CAD: A Language Model-Driven Multi-Agent System for Collaborative Design
- 2025CADDesigner: Conceptual CAD Model Generation with a General-Purpose Agent
- 2025A Lightweight Large Language Model-Based Multi-Agent System for 2D Frame Structural Analysis