mlsanityData to 7 Oct 2026

Few-Shot Open-Vocabulary Remote Sensing Segmentation via Textual Inversion

arXiv 2607.25563 ↗First posted 28 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Open-vocabulary segmentation labels arbitrary categories from a text query without per-class training, yet on remote sensing imagery it underperforms on categories it handles reliably elsewhere. We find that much of this gap traces to the text query rather than to the segmentation model. Because these models are not specialized for overhead imagery, the class name that serves as the query is often a weak address into the vision-language embedding space. We show that a better name repairs part of the gap, while the remaining failures call for an address that the tested natural-language rephrasings do not provide. We recover that address from a few examples through textual inversion on a frozen model, keeping inference text only. On a representative benchmark this raises the mean intersection over union on the affected categories from 3.9 to 39.4, and across eight remote sensing datasets it improves over few-shot methods that instead inject visual prompts at inference.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 34 references that are in the map. First posted on arXiv 28 Jul 2026.

Builds on

28 of 34 references.

References · 28

  1. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  2. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  3. 2021Learning to Prompt for Vision-Language Modelscited by 2,269
  4. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  5. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
  6. 2025DINOv3cited by 1,297
  7. 2022Language-driven Semantic Segmentationcited by 711
  8. 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 560
  9. 2022Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learningcited by 553
  10. 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
  11. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 357
  12. 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 317
16 more
  1. 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 259
  2. 2023Personalize Segment Anything Model with One Shotcited by 250
  3. 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 215
  4. 2019iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Imagescited by 195
  5. 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
  6. 2023Matcher: Segment Anything with One Shot Using All-Purpose Feature Matchingcited by 142
  7. 2022OpenEarthMap: A Benchmark Dataset for Global High-Resolution Land Cover Mappingcited by 80
  8. 2023AD-CLIP: Adapting Domains in Prompt Space Using CLIPcited by 62
  9. 2023VDD: Varied Drone Dataset for Semantic Segmentationcited by 39
  10. 2025SegEarth-OV3: Exploring SAM 3 for Open-Vocabulary Semantic Segmentation in Remote Sensing Imagescited by 14
  11. 2024OpenDAS: Open-Vocabulary Domain Adaptation for 2D and 3D Segmentationcited by 6
  12. 2025Tackling Few-Shot Segmentation in Remote Sensing via Inpainting Diffusion Modelcited by 5
  13. 2025Textual Inversion for Efficient Adaptation of Open-Vocabulary Object Detectors Without Forgettingcited by 3
  14. 2025SeMoBridge: Semantic Modality Bridge for Efficient Few-Shot Adaptation of CLIPcited by 3
  15. 2026Few-Shot Semantic Segmentation Meets SAM3cited by 3
  16. 2026SegRAG: Training-Free Retrieval-Augmented Semantic Segmentationcited by 1

Built on by

Not cited yet.