Training-Free Generalized Few-Shot Segmentation through Open-Vocabulary Semantic Arbitration
Not on the map. Why?
Abstract (arXiv)
Generalized Few-Shot Semantic Segmentation (GFSS) has traditionally been approached as a representation-learning problem, requiring task-specific adaptation to incorporate novel classes from limited support examples. Recent foundation models, however, already exhibit strong open-vocabulary recognition and segmentation capabilities, raising a different question: can GFSS be solved through inference-time coordination of frozen semantic priors rather than parameter adaptation? We answer this question with Open-V, a training-free GFSS framework that combines Segment Anything (SAM3) Promptable Concept Segmentation (PCS) with a K-shot CLIP support centroid through calibrated per-pixel semantic arbitration. OpenV introduces no trainable components and supports arbitrary semantic categories at inference time. Beyond segmentation performance, our study contributes three broader findings. First, we show that support information can be incorporated through inference-time semantic grounding, and that its contribution increases as foundation-model text priors weaken on label-disjoint vocabularies. Second, we identify a reproducibility confound in foundationmodel segmentation, demonstrating that preprocessing and evaluation-space mismatches can silently distort reported performance. Finally, we validate Open-V across PASCAL5i, COCO-20i, and ADE-OW, showing that training-free coordination of foundation-model priors generalizes across both conventional GFSS and open-vocabulary evaluation settings. On PASCAL-5i (1-shot), Open-V attains base/novel/harmonic mIoU of 78.4/77.5/77.9, without GFSS-specific training surpassing the strongest trained baseline by +17.7 HM.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 40 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
34 of 40 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 560
- 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
- 2023Side Adapter Network for Open-Vocabulary Semantic Segmentationcited by 296
- 2020Prior Guided Feature Enrichment Network for Few-Shot Segmentationcited by 271
- 2021A Simple Baseline for Open-Vocabulary Semantic Segmentation with Pre-trained Vision-language Modelcited by 223
- 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 215
22 more
- 2022SegCLIP: Patch Aggregation with Learnable Centers for Open-Vocabulary Semantic Segmentationcited by 162
- 2023Matcher: Segment Anything with One Shot Using All-Purpose Feature Matchingcited by 142
- 2022Open-Vocabulary Universal Image Segmentation with MaskCLIPcited by 131
- 2022Learning to Generate Text-grounded Mask for Open-world Semantic Segmentation from Only Image-Text Pairscited by 130
- 2022Learning What Not to Segment: A New Perspective on Few-Shot Segmentationcited by 120
- 2022Self-Support Few-Shot Semantic Segmentationcited by 96
- 2023Hierarchical Dense Correlation Distillation for Few-Shot Segmentationcited by 84
- 2017Open Vocabulary Scene Parsingcited by 76
- 2024VRP-SAM: SAM with Visual Reference Promptcited by 75
- 2020Generalized Few-shot Semantic Segmentationcited by 59
- 2022Feature-Proxy Transformer for Few-Shot Segmentationcited by 58
- 2024Training-Free Open-Vocabulary Segmentation with Offline Diffusion-Augmented Prototype Generationcited by 43
- 2022Intermediate Prototype Mining Transformer for Few-Shot Semantic Segmentationcited by 37
- 2023Self-Calibrated Cross Attention Network for Few-Shot Segmentationcited by 32
- 2025LPOSS: Label Propagation Over Patches and Pixels for Open-vocabulary Semantic Segmentationcited by 21
- 2024Visual Prompting for Generalized Few-shot Segmentation: A Multi-scale Approachcited by 15
- 2023Focus on Query: Adversarial Mining Transformer for Few-Shot Segmentationcited by 13
- 2025Unlocking the Power of SAM 2 for Few-Shot Segmentationcited by 11
- 2026Few-Shot Semantic Segmentation Meets SAM3cited by 3
- 2024Enhancing Generalized Few-Shot Semantic Segmentation via Effective Knowledge Transfercited by 2
- 2026Make It Up: Fake Images, Real Gains in Generalized Few-shot Semantic Segmentationcited by 1
- 2026Training-Free Fine-Grained Semantic Segmentations in Low Data Regimes: A FungiTastic Baselinecited by 1
Built on by
Not cited yet.