mlsanityData to 14 Oct 2026

Vector Map as Language: Toward Unified Remote Sensing Vector Mapping

arXiv 2606.10701 ↗First posted 9 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Remote sensing vector mapping aims to generate structured maps of geospatial entities, such as buildings, roads, and water bodies, from remote sensing imagery. In practice, vector maps usually contain multiple category layers and heterogeneous entity structures, requiring a unified model for diverse mapping needs. However, existing methods typically represent vector objects as polygons or graphs, making them suitable only for specific categories: polygons poorly capture topological relations, while graphs often blur instance boundaries. We observe that language, as a natural medium for human communication, offers a flexible and expressive representation that can accommodate heterogeneous map elements, including geometry, semantics, and topolog. Motivated by this insight, we propose Vector Map as Language (VecLang), a unified paradigm that reformulates multiclass vector mapping as structured text generation. VecLang encodes the common elements of different geospatial entities into a GeoJSON-like vector language, enabling cross-category modeling within a shared textual format. To generate this language reliably, we design a progressive vision-language mapping framework that first localizes vectorization units and then generates structured map elements. We further introduce Hierarchical Vector Language Optimization, which uses reinforcement learning to improve syntax validity, content fidelity, and map executability. We also build VecMap-Bench with 54K images and 800K instances, supporting training and evaluation across standard and generalization settings. Extensive experiments demonstrate that VecLang handles both single-class and multiclass vector mapping while achieving strong cross-dataset and open-vocabulary generalization. The model and dataset are publicly available at https://github.com/yyyyll0ss/VecLang.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 77 references that are in the map. First posted on arXiv 9 Jun 2026.

Builds on

45 of 77 references.

References · 45

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2023Segment Anythingcited by 8,234
  4. 2017Mask R-CNNcited by 7,277
  5. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  6. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  7. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
  8. 2025SAM 3: Segment Anything with Conceptscited by 906
  9. 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
  10. 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 411
  11. 2022Multimodal Learning with Transformers: A Surveycited by 400
  12. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
33 more
  1. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
  2. 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 271
  3. 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
  4. 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 193
  5. 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 179
  6. 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 159
  7. 2018Land-Cover Classification with High-Resolution Remote Sensing Images Using Transferable Deep Modelscited by 119
  8. 2022Prompting Is Programming: A Query Language for Large Language Modelscited by 110
  9. 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysiscited by 86
  10. 2025SpatialLM: Training Large Language Models for Structured Indoor Modelingcited by 65
  11. 2023A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Futurecited by 61
  12. 2018Topological Map Extraction from Overhead Imagescited by 58
  13. 2020Sat2Graph: Road Graph Extraction through Graph-Tensor Encodingcited by 55
  14. 2023RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Modelcited by 47
  15. 2025GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolutioncited by 44
  16. 2021PolyWorld: Polygonal Building Extraction with Graph Neural Networks in Satellite Imagescited by 43
  17. 2024Segment Anything Model for Road Network Graph Extractioncited by 28
  18. 2025SkySense V2: A Unified Foundation Model for Multi-modal Remote Sensingcited by 26
  19. 2024SegEarth-OV: Towards Training-Free Open-Vocabulary Segmentation for Remote Sensing Imagescited by 25
  20. 2022RNGDet++: Road Network Graph Detection by Transformer with Instance Segmentation and Multi-scale Features Enhancementcited by 24
  21. 2025SegEarth-OV3: Exploring SAM 3 for Open-Vocabulary Semantic Segmentation in Remote Sensing Imagescited by 16
  22. 2022Learning to Extract Building Footprints from Off-Nadir Aerial Imagescited by 13
  23. 2025Look Where It Matters: Training-Free Ultra-HR Remote Sensing VQA via Adaptive Zoom Searchcited by 11
  24. 2024Towards Satellite Image Road Graph Extraction: A Global-Scale Dataset and A Novel Methodcited by 10
  25. 2025UniGeoSeg: Towards Unified Open-World Segmentation for Geospatial Scenescited by 10
  26. 2025OpenRSD: Towards Open-prompts for Object Detection in Remote Sensing Imagescited by 9
  27. 2026RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoningcited by 8
  28. 2024P2PFormer: A Primitive-to-polygon Method for Regular Building Contour Extraction from Remote Sensing Imagescited by 5
  29. 2025IRSAMap:Towards Large-Scale, High-Resolution Land Cover Map Vectorizationcited by 5
  30. 2026Towards Pixel-Level VLM Perception via Simple Points Predictioncited by 5
  31. 2025HoliTracer: Holistic Vectorization of Geographic Objects from Large-Size Remote Sensing Imagerycited by 4
  32. 2026ACPV-Net: All-Class Polygonal Vectorization for Seamless Vector Map Generation from Aerial Imagerycited by 3
  33. 2025UniVector: Unified Vector Extraction via Instance-Geometry Interactioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Advancements in Visual Language Models for Remote Sensing: Datasets, Capabilities, and Enhancement Techniques
  2. 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives
  3. 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensing
  4. 2024RSTeller: Scaling Up Visual Language Modeling in Remote Sensing with Rich Linguistic Semantics from Openly Available Data and Large Language Models
  5. 2026OSMDA: OpenStreetMap-based Domain Adaptation for Remote Sensing VLMs
  6. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmark
  7. 2025VectorSynth: Fine-Grained Satellite Image Synthesis with Structured Semantics
  8. 2024From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing