Intelligent Co-Design: An Interactive LLM Framework for Interior Spatial Design via Multi-Modal Agents
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
In architectural interior design, miscommunication frequently arises as clients lack design knowledge, while designers struggle to explain complex spatial relationships, leading to delayed timelines and financial losses. Recent advancements in generative layout tools narrow the gap by automating 3D visualizations. However, prevailing methodologies exhibit limitations: rule-based systems implement hard-coded spatial constraints that restrict participatory engagement, while data-driven models rely on extensive training datasets. Recent large language models (LLMs) bridge this gap by enabling intuitive reasoning about spatial relationships through natural language. This research presents an LLM-based, multimodal, multi-agent framework that dynamically converts natural language descriptions and imagery into 3D designs. Specialized agents (Reference, Spatial, Interactive, Grader), operating via prompt guidelines, collaboratively address core challenges: the agent system enables real-time user interaction for iterative spatial refinement, while Retrieval-Augmented Generation (RAG) reduces data dependency without requiring task-specific model training. This framework accurately interprets spatial intent and generates optimized 3D indoor design, improving productivity, and encouraging nondesigner participation. Evaluations across diverse floor plans and user questionnaires demonstrate effectiveness. An independent LLM evaluator consistently rated participatory layouts higher in user intent alignment, aesthetic coherence, functionality, and circulation. Questionnaire results indicated 77% satisfaction and a clear preference over traditional design software. These findings suggest the framework enhances user-centric communication and fosters more inclusive, effective, and resilient design processes. Project page: https://rsigktyper.github.io/AICodesign/
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 8 of its 30 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
8 of 30 references.
References · 8
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
- 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 122
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2023SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collectionscited by 72
- 2024Evaluation Agent: Efficient and Promptable Evaluation Framework for Visual Generative Modelscited by 41
- 2022A Literature Survey of Recent Advances in Chatbotscited by 26
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Co-Layout: LLM-driven Co-optimization for Interior Layout
- 2026Agentic Designer: Progressive Multi-Agent Collaboration for Structure-Aware Interior Layout Generation
- 2024LLM4DESIGN: An Automated Multi-Modal System for Architectural and Environmental Design
- 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLM
- 2026CoDesignAI: An AI-Enabled Multi-Agent, Multi-User System for Collaborative Urban Design at the Conceptual Stage
- 2025Text Semantics to Flexible Design: A Residential Layout Generation Method Based on Stable Diffusion Model
- 2026Learning an Interior Layout Policy in a Domain Specific Language Action Space
- 2025DisCo-Layout: Disentangling and Coordinating Semantic and Physical Refinement in a Multi-Agent Framework for 3D Indoor Layout Synthesis