When Should a Network Emit Geometry, and When Should It Detect It? Readout, Reconciliation, and Representation in Floorplan Vectorization
Not on the map. Why?
Abstract (arXiv)
A network trained to recover the walls, openings, and rooms of a rasterized floorplan can produce its output in two ways: by emitting the geometry as an autoregressive coordinate sequence, or by detecting it on dense junction and centerline heatmaps and assembling a graph. We compare the two readouts on the same trained network. On real scans (CubiCasa5K) detection is better on every wall measure (+2.7 wall F1 at tolerance 0.05, +5.1 at 0.015; paired bootstrap intervals exclude zero), and reading an opening heatmap the decoder never used raises opening F1 by 2.6x without retraining. Within real scans the readout's advantage grows with plan size and reverses on small plans; on clean vector renders sequence decoding is better by 5 to 8 points where its training covered the render style, while under full domain shift the readout, given calibrated thresholds, stays ahead; neither ink density nor plan size explains the reversal. With matched data and recipe, a room-centric system with a reconciliation step and a wall-first sequence model reach comparable wall quality, so the output representation matters less than is usually assumed. A prior from the other family helps at the output but not at the input: deterministic fusion of the two outputs raises wall F1 by 7 points, whereas conditioning one model on the other's output gives no gain in three forms, including two ground-truth-content controls. We also provide an edit-cost metric that scores a draft by the human work needed to correct it, corrected CubiCasa5K annotations, and ResPlan-FP, a CC BY 4.0 benchmark of 16,998 plans with frozen splits and three baseline tracks. Code, the benchmark, and the corrected annotations are available at https://github.com/Cyprinus12138/fpvec-lab
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 38 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
28 of 38 references.
References · 28
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2014Show and Tell: A Neural Image Caption Generatorcited by 877
- 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 345
- 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 285
- 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 267
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
- 2022A Unified Sequence Interface for Vision Taskscited by 152
- 2023PolyFormer: Referring Image Segmentation as Sequential Polygon Generationcited by 147
- 2018Efficient Interactive Annotation of Segmentation Datasets with Polygon-RNN++cited by 119
- 2024SceneScript: Reconstructing Scenes With An Autoregressive Structured Language Modelcited by 95
- 2022HouseDiffusion: Vector Floorplan Generation via a Diffusion Model with Discrete and Continuous Denoisingcited by 72
16 more
- 2019CubiCasa5K: A Dataset and an Improved Multi-Task Model for Floorplan Image Analysiscited by 49
- 2022Connecting the Dots: Floorplan Reconstruction Using Two-Level Queriescited by 48
- 2023PolyDiffuse: Polygonal Shape Reconstruction via Guided Set Diffusion Modelscited by 36
- 2018FloorNet: A Unified Framework for Floorplan Reconstruction from 3D Scanscited by 35
- 2019Floor-SP: Inverse CAD for Floorplans by Sequential Room-wise Shortest Pathcited by 35
- 2021HEAT: Holistic Edge Attention Transformer for Structured Reconstructioncited by 29
- 2019Deep Floor Plan Recognition Using a Multi-Task Network with Room-Boundary-Guided Attentioncited by 27
- 2021MonteFloor: Extending MCTS for Reconstructing Accurate Large-Scale Floor Planscited by 26
- 2024PolyRoom: Room-aware Transformer for Floorplan Reconstructioncited by 8
- 2025ResPlan: A Large-Scale Vector-Graph Dataset of 17,000 Residential Floor Planscited by 7
- 2024FRI-Net: Floorplan Reconstruction via Room-wise Implicit Representationcited by 6
- 2024WAFFLE: Multimodal Floorplan Understanding in the Wildcited by 5
- 2026FloorplanVLM: A Vision-Language Model for Floorplan Vectorizationcited by 4
- 2025CAGE: Continuity-Aware edGE Network Unlocks Robust Floorplan Reconstructioncited by 3
- 2026LLM-Guided Agentic Floor Plan Parsing for Accessible Indoor Navigation of Blind and Low-Vision Peoplecited by 3
- 2026Raster2Seq: Polygon Sequence Generation for Floorplan Reconstructioncited by 1
Built on by
Not cited yet.