mlsanityData to 7 Oct 2026

Training-Free Generalized Few-Shot Segmentation through Open-Vocabulary Semantic Arbitration

arXiv 2606.09474 ↗First posted 8 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Generalized Few-Shot Semantic Segmentation (GFSS) has traditionally been approached as a representation-learning problem, requiring task-specific adaptation to incorporate novel classes from limited support examples. Recent foundation models, however, already exhibit strong open-vocabulary recognition and segmentation capabilities, raising a different question: can GFSS be solved through inference-time coordination of frozen semantic priors rather than parameter adaptation? We answer this question with Open-V, a training-free GFSS framework that combines Segment Anything (SAM3) Promptable Concept Segmentation (PCS) with a K-shot CLIP support centroid through calibrated per-pixel semantic arbitration. OpenV introduces no trainable components and supports arbitrary semantic categories at inference time. Beyond segmentation performance, our study contributes three broader findings. First, we show that support information can be incorporated through inference-time semantic grounding, and that its contribution increases as foundation-model text priors weaken on label-disjoint vocabularies. Second, we identify a reproducibility confound in foundationmodel segmentation, demonstrating that preprocessing and evaluation-space mismatches can silently distort reported performance. Finally, we validate Open-V across PASCAL5i, COCO-20i, and ADE-OW, showing that training-free coordination of foundation-model priors generalizes across both conventional GFSS and open-vocabulary evaluation settings. On PASCAL-5i (1-shot), Open-V attains base/novel/harmonic mIoU of 78.4/77.5/77.9, without GFSS-specific training surpassing the strongest trained baseline by +17.7 HM.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 40 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

34 of 40 references.

References · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Segment Anythingcited by 8,158
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  6. 2025SAM 3: Segment Anything with Conceptscited by 835
  7. 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 560
  8. 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
  9. 2023Side Adapter Network for Open-Vocabulary Semantic Segmentationcited by 296
  10. 2020Prior Guided Feature Enrichment Network for Few-Shot Segmentationcited by 271
  11. 2021A Simple Baseline for Open-Vocabulary Semantic Segmentation with Pre-trained Vision-language Modelcited by 223
  12. 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 215
22 more
  1. 2022SegCLIP: Patch Aggregation with Learnable Centers for Open-Vocabulary Semantic Segmentationcited by 162
  2. 2023Matcher: Segment Anything with One Shot Using All-Purpose Feature Matchingcited by 142
  3. 2022Open-Vocabulary Universal Image Segmentation with MaskCLIPcited by 131
  4. 2022Learning to Generate Text-grounded Mask for Open-world Semantic Segmentation from Only Image-Text Pairscited by 130
  5. 2022Learning What Not to Segment: A New Perspective on Few-Shot Segmentationcited by 120
  6. 2022Self-Support Few-Shot Semantic Segmentationcited by 96
  7. 2023Hierarchical Dense Correlation Distillation for Few-Shot Segmentationcited by 84
  8. 2017Open Vocabulary Scene Parsingcited by 76
  9. 2024VRP-SAM: SAM with Visual Reference Promptcited by 75
  10. 2020Generalized Few-shot Semantic Segmentationcited by 59
  11. 2022Feature-Proxy Transformer for Few-Shot Segmentationcited by 58
  12. 2024Training-Free Open-Vocabulary Segmentation with Offline Diffusion-Augmented Prototype Generationcited by 43
  13. 2022Intermediate Prototype Mining Transformer for Few-Shot Semantic Segmentationcited by 37
  14. 2023Self-Calibrated Cross Attention Network for Few-Shot Segmentationcited by 32
  15. 2025LPOSS: Label Propagation Over Patches and Pixels for Open-vocabulary Semantic Segmentationcited by 21
  16. 2024Visual Prompting for Generalized Few-shot Segmentation: A Multi-scale Approachcited by 15
  17. 2023Focus on Query: Adversarial Mining Transformer for Few-Shot Segmentationcited by 13
  18. 2025Unlocking the Power of SAM 2 for Few-Shot Segmentationcited by 11
  19. 2026Few-Shot Semantic Segmentation Meets SAM3cited by 3
  20. 2024Enhancing Generalized Few-Shot Semantic Segmentation via Effective Knowledge Transfercited by 2
  21. 2026Make It Up: Fake Images, Real Gains in Generalized Few-shot Semantic Segmentationcited by 1
  22. 2026Training-Free Fine-Grained Semantic Segmentations in Low Data Regimes: A FungiTastic Baselinecited by 1

Built on by

Not cited yet.