mlsanityData to 14 Oct 2026

SMOL-MapSeg: Show Me One Label as prompt

arXiv 2508.05501 ↗First posted 7 Aug 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Historical maps offer valuable insights into changes on Earth's surface but pose challenges for modern segmentation models due to inconsistent visual styles and symbols. While deep learning models such as UNet and pre-trained foundation models perform well in domains like autonomous driving and medical imaging, they struggle with the variability of historical maps, where similar concepts appear in diverse forms. To address this issue, we propose On-Need Declarative (OND) knowledge-based prompting, a method that provides explicit image-label pair prompts to guide models in linking visual patterns with semantic concepts. This enables users to define and segment target concepts on demand, supporting flexible, concept-aware segmentation. Our approach replaces the prompt encoder of the Segment Anything Model (SAM) with the OND prompting mechanism and fine-tunes it on historical maps, creating SMOL-MapSeg (Show Me One Label). Unlike existing SAM-based fine-tuning methods that are class-agnostic or restricted to fixed classes, SMOL-MapSeg supports class-aware segmentation across arbitrary datasets. Experiments show that SMOL-MapSeg accurately segments user-defined classes and substantially outperforms baseline models. Furthermore, it demonstrates strong generalization even with minimal training data, highlighting its potential for scalable and adaptable historical map analysis.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 7 Aug 2025.

Builds on

20 of 28 references.

References · 20

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  6. 2023Segment Anythingcited by 8,234
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  8. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  9. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  10. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  11. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  12. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
8 more
  1. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
  2. 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 651
  3. 2021Image Segmentation Using Text and Image Promptscited by 512
  4. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 386
  5. 2023SAM-6D: Segment Anything Model Meets Zero-Shot 6D Object Pose Estimationcited by 117
  6. 2024Segment Anything without Supervisioncited by 28
  7. 2018Semantic Segmentation for Urban Planning Maps based on U-Netcited by 8
  8. 2025Semantic Segmentation for Sequential Historical Maps by Learning from Only One Mapcited by 4

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.