Plan2Map: A Multimodal Benchmark for Document-Grounded Geospatial Boundary Reconstruction from Planning Records
Not on the map. Why?
Abstract (arXiv)
Planning records define restrictions over geographic areas, but their source documents often provide only indirect spatial evidence rather than machine-readable boundaries. We introduce Plan2Map, a 208-case multimodal benchmark for document-grounded geospatial boundary reconstruction from UK planning records. Given only a source planning document, systems must reconstruct a valid geospatial boundary from notice text, schedules, map plates, map labels, and boundary annotations; the reference GeoJSON is held out for scoring. We propose GeoPlanAgent, a document-grounded, geospatial-tool-in-the-loop system that decomposes the task into evidence extraction, localisation, map registration, boundary segmentation, projection, and verification. On Plan2Map, GeoPlanAgent achieves 0.736 mean IoU and 0.904 median IoU, with 67.8% of predictions at or above 0.8 IoU, substantially outperforming direct VLM-to-GeoJSON baselines. Diagnostic analysis shows that direct VLM prediction remains unreliable, while remaining errors are concentrated in localisation and map registration, and supervised boundary segmentation substantially improves pixel-level mask quality. Plan2Map provides a concrete testbed for multimodal geospatial reconstruction from public planning records. Project page: https://odeb1.github.io/Plan2MapProjectPage/.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 26 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
11 of 26 references.
References · 11
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 320
- 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 197
- 2024Responsible AI Governance: A Response to UN Interim Report on Governing AI for Humanitycited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026PlanBench-V: A Spatial Planning Map Benchmark for Vision-Language Models
- 2025GeoExplain: Multimodal Reasoning based on Hierarchy of Visual Information in Street View
- 2026EarthSpatialBench: Benchmarking Spatial Reasoning Capabilities of Multimodal LLMs on Earth Imagery
- 2024GEOBench-VLM: Benchmarking Vision-Language Models for Geospatial Tasks
- 2025GeoGrid-Bench: Can Foundation Models Understand Multimodal Gridded Geo-Spatial Data?
- 2026GeoArbiter: Verifiability-Guided Grounding for Remote-Sensing Multimodal LLMs
- 2025Coordinates from Context: Using LLMs to Ground Complex Location References
- 2024StreetviewLLM: Extracting Geographic Information Using a Chain-of-Thought Multimodal Large Language Model