Iterative Few-shot Semantic Segmentation from Image Label Text
Not on the map. Why?
Abstract (arXiv)
Few-shot semantic segmentation aims to learn to segment unseen class objects with the guidance of only a few support images. Most previous methods rely on the pixel-level label of support images. In this paper, we focus on a more challenging setting, in which only the image-level labels are available. We propose a general framework to firstly generate coarse masks with the help of the powerful vision-language model CLIP, and then iteratively and mutually refine the mask predictions of support and query images. Extensive experiments on PASCAL-5i and COCO-20i datasets demonstrate that our method not only outperforms the state-of-the-art weakly supervised approaches by a significant margin, but also achieves comparable or better results to recent supervised methods. Moreover, our method owns an excellent generalization ability for the images in the wild and uncommon classes. Code will be available at https://github.com/Whileherham/IMR-HSNet.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 25 of its 29 references that are in the map. First posted on arXiv 10 Mar 2023.
Builds on
25 of 29 references.
References · 25
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,021
- 2022Language-driven Semantic Segmentationcited by 711
- 2021DenseCLIP: Language-Guided Dense Prediction with Context-Aware Promptingcited by 530
- 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
- 2017One-Shot Learning for Semantic Segmentationcited by 337
- 2020Prior Guided Feature Enrichment Network for Few-Shot Segmentationcited by 271
- 2019Zero-Shot Semantic Segmentationcited by 245
13 more
- 2019CANet: Class-Agnostic Segmentation Networks with Iterative Refinement and Attentive Few-Shot Learningcited by 217
- 2021Adaptive Prototype Learning and Allocation for Few-Shot Segmentationcited by 207
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2020Prototype Mixture Models for Few-shot Semantic Segmentationcited by 190
- 2020Few-Shot Segmentation Without Meta-Learning: A Good Transductive Inference Is All You Need?cited by 135
- 2021Simpler is Better: Few-shot Semantic Segmentation with Classifier Weight Transformercited by 116
- 2021Self-Guided and Cross-Guided Learning for Few-Shot Segmentationcited by 92
- 2021Mining Latent Classes for Few-shot Segmentationcited by 69
- 2021Learning Meta-class Memory for Few-Shot Semantic Segmentationcited by 56
- 2021Anti-aliasing Semantic Reconstruction for Few-Shot Semantic Segmentationcited by 23
- 2021A Pixel-Level Meta-Learner for Weakly Supervised Few-Shot Semantic Segmentationcited by 10
- 2021Boosting Few-shot Semantic Segmentation with Transformerscited by 6
- 2021Few-shot Semantic Segmentation with Self-supervision from Pseudo-classescited by 6
Built on by
Citing papers per year: 2023: 2; 2024: 7; 2025: 1.
10 papers.
- 2023Visual and Textual Prior Guided Mask Assemble for Few-Shot Segmentation and Beyondcited by 19
- 2024OmniCLIP: Adapting CLIP for Video Recognition with Spatial-Temporal Omni-Scale Feature Learningcited by 14
- 2024Training-Free Semantic Segmentation via LLM-Supervisioncited by 8
- 2024Beyond Mask: Rethinking Guidance Types in Few-shot Segmentationcited by 3
- 2023Language-guided Few-shot Semantic Segmentationcited by 2
- 2024AFANet: Adaptive Frequency-Aware Network for Weakly-Supervised Few-Shot Semantic Segmentationcited by 1
- 2025Textual and Visual Guided Task Adaptation for Source-Free Cross-Domain Few-Shot Segmentationcited by 1
- 2024Learning Robust Correlation with Foundation Model for Weakly-Supervised Few-Shot Segmentationcited by 0
- 2024No Re-Train, More Gain: Upgrading Backbones with Diffusion model for Pixel-Wise and Weakly-Supervised Few-Shot Segmentationcited by 0
- 2024Symmetrical Joint Learning Support-query Prototypes for Few-shot Segmentationcited by 0
- 2025Textual and Visual Guided Task Adaptation for Source-Free Cross-Domain Few-Shot Segmentation7 Aug 2025
- 2024AFANet: Adaptive Frequency-Aware Network for Weakly-Supervised Few-Shot Semantic Segmentation23 Dec 2024
- 2024OmniCLIP: Adapting CLIP for Video Recognition with Spatial-Temporal Omni-Scale Feature Learning12 Aug 2024
- 2024Symmetrical Joint Learning Support-query Prototypes for Few-shot Segmentation27 Jul 2024
- 2024No Re-Train, More Gain: Upgrading Backbones with Diffusion model for Pixel-Wise and Weakly-Supervised Few-Shot Segmentation23 Jul 2024
- 2024Beyond Mask: Rethinking Guidance Types in Few-shot Segmentation16 Jul 2024
- 2024Learning Robust Correlation with Foundation Model for Weakly-Supervised Few-Shot Segmentation30 May 2024
- 2024Training-Free Semantic Segmentation via LLM-Supervision31 Mar 2024
- 2023Language-guided Few-shot Semantic Segmentation23 Nov 2023
- 2023Visual and Textual Prior Guided Mask Assemble for Few-Shot Segmentation and Beyond15 Aug 2023
Similar, not cited
Close in wording, no citation either way
- 2024Unleashing the Potential of the Diffusion Model in Few-shot Semantic Segmentation
- 2023Class Enhancement Losses with Pseudo Labels for Zero-shot Semantic Segmentation
- 2023A Language-Guided Benchmark for Weakly Supervised Open Vocabulary Semantic Segmentation
- 2025Vision and Language Reference Prompt into SAM for Few-shot Segmentation
- 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIP
- 2025DSV-LFS: Unifying LLM-Driven Semantic Cues with Visual Features for Robust Few-Shot Segmentation
- 2026Make It Up: Fake Images, Real Gains in Generalized Few-shot Semantic Segmentation
- 2022Exploiting Category Names for Few-Shot Classification with Vision-Language Models