Tokenization Allows Multimodal Large Language Models to Understand, Generate and Edit Architectural Floor Plans
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Architectural floor plan design demands joint reasoning over geometry, semantics, and spatial hierarchy, which remains a major challenge for current AI systems. Although recent diffusion and language models improve visual fidelity, they still struggle with coherent spatial reasoning and controllable generation. We present HouseMind, a multimodal large language model that unifies floor plan understanding, generation, and editing in one framework. We introduce discrete room-instance tokens to construct a unified vocabulary that bridges layouts and symbolic reasoning. With multimodal alignment and instruction tuning, the model synthesizes coherent, controllable layouts from text instructions. Experiments show how the framework achieves superior geometric validity and controllability while remaining efficient and locally deployable.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 17 of its 61 references that are in the map. First posted on arXiv 12 Mar 2026.
Builds on
17 of 61 references.
References · 17
- 2025Qwen3 Technical Reportcited by 8,195
- 2017Neural Discrete Representation Learningcited by 4,650
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2020House-GAN: Relational Generative Adversarial Networks for Graph-constrained House Layout Generationcited by 86
- 2023Graph Transformer GANs for Graph-Constrained House Generationcited by 19
- 2023Tell2Design: A Dataset for Language-Guided Floor Plan Generationcited by 19
- 2024MSD: A Benchmark Dataset for Floor Plan Generation of Building Complexescited by 13
- 2024Constrained Layout Generation with Factor Graphscited by 6
5 more
- 2024DStruct2Design: Data and Benchmarks for Data Structure Driven Generative Floor Plan Designcited by 5
- 2024A hypergraph model shows the carbon reduction potential of effective space use in housingcited by 4
- 2024ChatHouseDiffusion: Prompt-Guided Generation and Editing of Floor Planscited by 4
- 2025Eliminating Rasterization: Direct Vector Floor Plan Generation with DiffPlannercited by 4
- 2025FloorPlan-DeepSeek (FPDS): A multimodal approach to floorplan generation using vector-based next room predictioncited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024HouseTune: Two-Stage Floorplan Generation with LLM Assistance
- 2026MANSION: Multi-floor lANguage-to-3D Scene generatIOn for loNg-horizon tasks
- 2025FloorplanQA: A Benchmark for Spatial Reasoning in LLMs using Structured Representations
- 2026Learning an Interior Layout Policy in a Domain Specific Language Action Space
- 2026Intelligent Co-Design: An Interactive LLM Framework for Interior Spatial Design via Multi-Modal Agents
- 2026Generative Floor Plan Design with LLMs via Reinforcement Learning with Verifiable Rewards
- 2025Sketch2BIM: A Multi-Agent Human-AI Collaborative Pipeline to Convert Hand-Drawn Floor Plans to 3D BIM
- 2026FLOORA: A Human-Aligned Domain-Specific Language Model for Architectural Design