FloorplanVLM: A Vision-Language Model for Floorplan Vectorization
Not on the map. Why?
Abstract (arXiv)
Converting raster floorplans into engineering-grade vector graphics is challenging due to complex topology and strict geometric constraints. To address this, we present FloorplanVLM, a unified framework that reformulates floorplan vectorization as an image-conditioned sequence modeling task. Unlike pixel-based methods that rely on fragile heuristics or query-based transformers that generate fragmented rooms, our model directly outputs structured JSON sequences representing the global topology. This 'pixels-to-sequence' paradigm enables the precise and holistic constraint satisfaction of complex geometries, such as slanted walls and curved arcs. To support this data-hungry approach, we introduce a scalable data engine: we construct a large-scale dataset (Floorplan-2M) and a high-fidelity subset (Floorplan-HQ-300K) to balance geometric diversity and pixel-level precision. We then employ a progressive training strategy, using Supervised Fine-Tuning (SFT) for structural grounding and quality annealing, followed by Group Relative Policy Optimization (GRPO) for strict geometric alignment. To standardize evaluation on complex layouts, we establish and open-source FPBench-2K. Evaluated on this rigorous benchmark, FloorplanVLM demonstrates exceptional structural validity, achieving 92.52% external-wall IoU and robust generalization across non-Manhattan architectures.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 13 of its 18 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
13 of 18 references.
References · 13
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023ChartLlama: A Multimodal LLM for Chart Understanding and Generationcited by 158
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoningcited by 152
- 2019End-to-End Wireframe Parsingcited by 72
- 2019CubiCasa5K: A Dataset and an Improved Multi-Task Model for Floorplan Image Analysiscited by 49
- 2022Connecting the Dots: Floorplan Reconstruction Using Two-Level Queriescited by 48
- 2025A Survey of Multimodal Hallucination Evaluation and Detectioncited by 26
- 2025ReCAD: Reinforcement Learning Enhanced Parametric CAD Model Generation with Vision-Language Modelscited by 10
1 more
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Architect-Ant: Editable Automatic Furnishing of Architectural Floor Planscited by 0
- 2026Towards an automated AI-based framework for floor plan compliance checks for residential buildingscited by 0
- 2026When Should a Network Emit Geometry, and When Should It Detect It? Readout, Reconciliation, and Representation in Floorplan Vectorizationcited by 0
- 2026K-OPSD: Verifiable On-Policy Self-Distillation for Post-Training Vision-Language Models on AEC Drawingscited by 0
- 2026K-OPSD: Verifiable On-Policy Self-Distillation for Post-Training Vision-Language Models on AEC Drawings28 Sep 2026
- 2026When Should a Network Emit Geometry, and When Should It Detect It? Readout, Reconciliation, and Representation in Floorplan Vectorization26 Aug 2026
- 2026Architect-Ant: Editable Automatic Furnishing of Architectural Floor Plans9 Jun 2026
- 2026Towards an automated AI-based framework for floor plan compliance checks for residential buildings26 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025Eliminating Rasterization: Direct Vector Floor Plan Generation with DiffPlanner
- 2026TLC-Plan: A Two-Level Codebook Based Network for End-to-End Vector Floorplan Generation
- 2025ResPlan: A Large-Scale Vector-Graph Dataset of 17,000 Residential Floor Plans
- 2022HouseDiffusion: Vector Floorplan Generation via a Diffusion Model with Discrete and Continuous Denoising
- 2024GSDiff: Synthesizing Vector Floorplans via Geometry-enhanced Structural Graph Generation
- 2025FloorPlan-DeepSeek (FPDS): A multimodal approach to floorplan generation using vector-based next room prediction
- 2026Directly from Alpha to Omega: Controllable End-to-End Vector Floor Plan Generation ↗
- 2026Boundary-Constrained Diffusion Models for Floorplan Generation: Balancing Realism and Diversity