Generalized Few-Shot Semantic Segmentation: All You Need is Fine-Tuning
Not on the map. Why?
Abstract (arXiv)
Generalized few-shot semantic segmentation was introduced to move beyond only evaluating few-shot segmentation models on novel classes to include testing their ability to remember base classes. While the current state-of-the-art approach is based on meta-learning, it performs poorly and saturates in learning after observing only a few shots. We propose the first fine-tuning solution, and demonstrate that it addresses the saturation problem while achieving state-of-the-art results on two datasets, PASCAL-5i and COCO-20i. We also show that it outperforms existing methods, whether fine-tuning multiple final layers or only the final layer. Finally, we present a triplet loss regularization that shows how to redistribute the balance of performance between novel and base categories so that there is a smaller gap between them.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 38 of its 55 references that are in the map. First posted on arXiv 21 Dec 2021.
Builds on
38 of 55 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2018Dual Attention Network for Scene Segmentationcited by 1,001
- 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
- 2020Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?cited by 435
- 2017One-Shot Learning for Semantic Segmentationcited by 337
26 more
- 2019A Baseline for Few-Shot Image Classificationcited by 298
- 2020Frustratingly Simple Few-Shot Object Detectioncited by 280
- 2020Prior Guided Feature Enrichment Network for Few-Shot Segmentationcited by 271
- 2019CANet: Class-Agnostic Segmentation Networks with Iterative Refinement and Attentive Few-Shot Learningcited by 217
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2020Prototype Mixture Models for Few-shot Semantic Segmentationcited by 190
- 2019Feature Weighting and Boosting for Few-Shot Segmentationcited by 189
- 2015ParseNet: Looking Wider to See Bettercited by 176
- 2018SG-One: Similarity Guidance Network for One-Shot Semantic Segmentationcited by 169
- 2021FSCE: Few-Shot Object Detection via Contrastive Proposal Encodingcited by 168
- 2020Part-aware Prototype Network for Few-shot Semantic Segmentationcited by 162
- 2018OCNet: Object Context Network for Scene Parsingcited by 140
- 2020Few-Shot Segmentation Without Meta-Learning: A Good Transductive Inference Is All You Need?cited by 135
- 2020CRNet: Cross-Reference Networks for Few-Shot Segmentationcited by 101
- 2021Prototypical Cross-domain Self-supervised Learning for Few-shot Unsupervised Domain Adaptationcited by 83
- 2020Generalized Few-shot Semantic Segmentationcited by 59
- 2017Residual Conv-Deconv Grid Network for Semantic Segmentationcited by 57
- 2020Momentum Contrastive Learning for Few-Shot COVID-19 Diagnosis from Chest CT Imagescited by 43
- 2019Revisiting Fine-tuning for Few-shot Learningcited by 29
- 2020SimPropNet: Improved Similarity Propagation for Few-shot Image Segmentationcited by 27
- 2020Spatial Contrastive Learning for Few-Shot Classificationcited by 17
- 2021Few-Shot Segmentation with Global and Local Contrastive Learningcited by 17
- 2021Supervised Momentum Contrastive Learning for Few-Shot Classificationcited by 6
- 2020Few-Shot Image Classification via Contrastive Self-Supervised Learningcited by 5
- 2019The Ethical Dilemma when (not) Setting up Cost-based Decision Rules in Semantic Segmentationcited by 4
- 2021SCNet: Enhancing Few-Shot Semantic Segmentation by Self-Contrastive Background Prototypescited by 4
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 3; 2025: 2.
8 papers.
- 2025Generalized Few-shot 3D Point Cloud Segmentation with Vision-Language Modelcited by 17
- 2022Prediction Calibration for Generalized Few-shot Semantic Segmentationcited by 16
- 2024Generalized Few-Shot Meets Remote Sensing: Discovering Novel Classes in Land Cover Mapping via Hybrid Semantic Segmentation Frameworkcited by 6
- 2023Few-shot 3D LiDAR Semantic Segmentation for Autonomous Drivingcited by 3
- 2025Probabilistic Prototype Calibration of Vision-Language Models for Generalized Few-shot Semantic Segmentationcited by 1
- 2023GMISeg: General Medical Image Segmentation without Re-Trainingcited by 0
- 2024Label-Efficient Semantic Segmentation of LiDAR Point Clouds in Adverse Weather Conditionscited by 0
- 2024TeFF: Tracking-enhanced Forgetting-free Few-shot 3D LiDAR Semantic Segmentationcited by 0
- 2025Probabilistic Prototype Calibration of Vision-Language Models for Generalized Few-shot Semantic Segmentation28 Jun 2025
- 2025Generalized Few-shot 3D Point Cloud Segmentation with Vision-Language Model20 Mar 2025
- 2024TeFF: Tracking-enhanced Forgetting-free Few-shot 3D LiDAR Semantic Segmentation28 Aug 2024
- 2024Label-Efficient Semantic Segmentation of LiDAR Point Clouds in Adverse Weather Conditions14 Jun 2024
- 2024Generalized Few-Shot Meets Remote Sensing: Discovering Novel Classes in Land Cover Mapping via Hybrid Semantic Segmentation Framework19 Apr 2024
- 2023GMISeg: General Medical Image Segmentation without Re-Training21 Nov 2023
- 2023Few-shot 3D LiDAR Semantic Segmentation for Autonomous Driving17 Feb 2023
- 2022Prediction Calibration for Generalized Few-shot Semantic Segmentation15 Oct 2022