mlsanityData to 7 Oct 2026

Plan2Map: A Multimodal Benchmark for Document-Grounded Geospatial Boundary Reconstruction from Planning Records

arXiv 2606.02747 ↗First posted 1 Jun 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Planning records define restrictions over geographic areas, but their source documents often provide only indirect spatial evidence rather than machine-readable boundaries. We introduce Plan2Map, a 208-case multimodal benchmark for document-grounded geospatial boundary reconstruction from UK planning records. Given only a source planning document, systems must reconstruct a valid geospatial boundary from notice text, schedules, map plates, map labels, and boundary annotations; the reference GeoJSON is held out for scoring. We propose GeoPlanAgent, a document-grounded, geospatial-tool-in-the-loop system that decomposes the task into evidence extraction, localisation, map registration, boundary segmentation, projection, and verification. On Plan2Map, GeoPlanAgent achieves 0.736 mean IoU and 0.904 median IoU, with 67.8% of predictions at or above 0.8 IoU, substantially outperforming direct VLM-to-GeoJSON baselines. Diagnostic analysis shows that direct VLM prediction remains unreliable, while remaining errors are concentrated in localisation and map registration, and supervised boundary segmentation substantially improves pixel-level mask quality. Plan2Map provides a concrete testbed for multimodal geospatial reconstruction from public planning records. Project page: https://odeb1.github.io/Plan2MapProjectPage/.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 26 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

11 of 26 references.

References · 11

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  5. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
  6. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
  7. 2025SAM 3: Segment Anything with Conceptscited by 835
  8. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
  9. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 320
  10. 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 197
  11. 2024Responsible AI Governance: A Response to UN Interim Report on Governing AI for Humanitycited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026PlanBench-V: A Spatial Planning Map Benchmark for Vision-Language Models
  2. 2025GeoExplain: Multimodal Reasoning based on Hierarchy of Visual Information in Street View
  3. 2026EarthSpatialBench: Benchmarking Spatial Reasoning Capabilities of Multimodal LLMs on Earth Imagery
  4. 2024GEOBench-VLM: Benchmarking Vision-Language Models for Geospatial Tasks
  5. 2025GeoGrid-Bench: Can Foundation Models Understand Multimodal Gridded Geo-Spatial Data?
  6. 2026GeoArbiter: Verifiability-Guided Grounding for Remote-Sensing Multimodal LLMs
  7. 2025Coordinates from Context: Using LLMs to Ground Complex Location References
  8. 2024StreetviewLLM: Extracting Geographic Information Using a Chain-of-Thought Multimodal Large Language Model