mlsanityData to 14 Oct 2026

Multi-Text Guided Few-Shot Semantic Segmentation

arXiv 2511.15515 ↗First posted 19 Nov 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent CLIP-based few-shot semantic segmentation methods introduce class-level textual priors to assist segmentation by typically using a single prompt (e.g., a photo of class). However, these approaches often result in incomplete activation of target regions, as a single textual description cannot fully capture the semantic diversity of complex categories. Moreover, they lack explicit cross-modal interaction and are vulnerable to noisy support features, further degrading visual prior quality. To address these issues, we propose the Multi-Text Guided Few-Shot Semantic Segmentation Network (MTGNet), a dual-branch framework that enhances segmentation performance by fusing diverse textual prompts to refine textual priors and guide the cross-modal optimization of visual priors. Specifically, we design a Multi-Textual Prior Refinement (MTPR) module that suppresses interference and aggregates complementary semantic cues to enhance foreground activation and expand semantic coverage for structurally complex objects. We introduce a Text Anchor Feature Fusion (TAFF) module, which leverages multi-text embeddings as semantic anchors to facilitate the transfer of discriminative local prototypes from support images to query images, thereby improving semantic consistency and alleviating intra-class variations. Furthermore, a Foreground Confidence-Weighted Attention (FCWA) module is presented to enhance visual prior robustness by leveraging internal self-similarity within support foreground features. It adaptively down-weights inconsistent regions and effectively suppresses interference in the query segmentation process. Extensive experiments on standard FSS benchmarks validate the effectiveness of MTGNet. In the 1-shot setting, it achieves 76.8% mIoU on PASCAL-5i and 57.4% on COCO-20i, with notable improvements in folds exhibiting high intra-class variations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 19 Nov 2025.

Builds on

20 of 28 references.

References · 20

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2021Image Segmentation Using Text and Image Promptscited by 512
  4. 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
  5. 2017One-Shot Learning for Semantic Segmentationcited by 337
  6. 2020Prior Guided Feature Enrichment Network for Few-Shot Segmentationcited by 271
  7. 2021Adaptive Prototype Learning and Allocation for Few-Shot Segmentationcited by 207
  8. 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
  9. 2020Prototype Mixture Models for Few-shot Semantic Segmentationcited by 190
  10. 2019Feature Weighting and Boosting for Few-Shot Segmentationcited by 189
  11. 2018SG-One: Similarity Guidance Network for One-Shot Semantic Segmentationcited by 169
  12. 2020Part-aware Prototype Network for Few-shot Semantic Segmentationcited by 162
8 more
  1. 2022CLIP is Also an Efficient Segmenter: A Text-Driven Approach for Weakly Supervised Semantic Segmentationcited by 118
  2. 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
  3. 2022Self-Support Few-Shot Semantic Segmentationcited by 96
  4. 2023Hierarchical Dense Correlation Distillation for Few-Shot Segmentationcited by 84
  5. 2023FECANet: Boosting Few-Shot Semantic Segmentation with Feature-Enhanced Context-Aware Networkcited by 22
  6. 2024Rethinking Prior Information Generation with CLIP for Few-Shot Segmentationcited by 20
  7. 2023Visual and Textual Prior Guided Mask Assemble for Few-Shot Segmentation and Beyondcited by 19
  8. 2024Query-guided Prototype Evolution Network for Few-Shot Segmentationcited by 12

Built on by

Not cited yet.