LoDEOT: Low-Dimensional and Efficient Offset Tokens for Building Footprint Extraction from Off-Nadir Imagery
Not on the map. Why?
Abstract (arXiv)
Instance-level roof-to-footprint offset (RFO) prediction is central to extracting building footprints from off-nadir imagery. Query-based pipelines commonly use high-dimensional instance tokens to predict signed two-dimensional RFOs. We investigate whether RFO prediction can instead use a compact offset token. Under local pinhole projection and vertical-extrusion assumptions, the idealized RFO map admits a five-parameter sufficient descriptor comprising intrinsic shape, composite amplitude, and relative geometry. This factorization provides a structural prior for a five-dimensional offset token, whose channels learn task-relevant latent representations through end-to-end training. Based on this design, we propose LoDEOT, which retains high-dimensional instance tokens for detection and segmentation but maps instance-token, concentration-gated roof, and box-mask evidence to a five-dimensional offset token followed by an independent two-dimensional readout. Known denoising-query target indices further align each supervised decoder-layer estimate with the same clean instance RFO, organizing successive predictions as target-aligned recovery under perturbed query conditions. Experiments on five real-world building datasets demonstrate the effectiveness of LoDEOT for building footprint extraction. Experiments on real-world building datasets demonstrate that a five-dimensional offset token can support accurate RFO prediction. On BONAI, LoDEOT achieves the best roof-detection bAP and bAP50 and leads all five offset-corrected footprint metrics among the evaluated end-to-end methods, with FAP50 of 54.58 and mEPE of 5.23 pixels. Its FAP50 exceeds those of the evaluated end-to-end baselines by 7.56-16.85 percentage points.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 41 references that are in the map. First posted on arXiv 5 Oct 2026.
Builds on
29 of 41 references.
References · 29
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2017Mask R-CNNcited by 7,277
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,152
- 2022DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETRcited by 573
- 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 488
- 2021Conditional DETR for Fast Training Convergencecited by 424
17 more
- 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 344
- 2018DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Imagescited by 277
- 2021Instances as Queriescited by 158
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
- 2018Efficient Interactive Annotation of Segmentation Datasets with Polygon-RNN++cited by 120
- 2021Geometry-Free View Synthesis: Transformers and no 3D Priorscited by 100
- 2021PolyWorld: Polygonal Building Extraction with Graph Neural Networks in Satellite Imagescited by 43
- 2022Learning to Extract Building Footprints from Off-Nadir Aerial Imagescited by 13
- 20243D Building Reconstruction from Monocular Remote Sensing Images with Multi-level Supervisionscited by 13
- 2022BuildMapper: A Fully Learnable Framework for Vectorized Building Contour Extractioncited by 12
- 2024Pix2Poly: A Sequence Prediction Method for End-to-end Polygonal Building Footprint Extraction from Remote Sensing Imagerycited by 8
- 2025IRSAMap:Towards Large-Scale, High-Resolution Land Cover Map Vectorizationcited by 5
- 2023Prompt-Driven Building Footprint Extraction in Aerial Images with Offset-Building Modelcited by 3
- 2024PolyFootNet: Extracting Polygonal Building Footprints in Off-Nadir Remote Sensing Imagescited by 3
- 2025DragOSM: Extract Building Roofs and Footprints from Aerial Images by Aligning Historical Labelscited by 3
- 2026Understanding Geometric Representations in Self-Supervised Vision Transformers via Subspace Interventioncited by 2
- 2026ObliCity: A Benchmark and Baseline for Roof-to-Ground Projection Displacement Correctioncited by 1
Built on by
Not cited yet.