Incremental Few-Shot Instance Segmentation
Not on the map. Why?
Abstract (arXiv)
Few-shot instance segmentation methods are promising when labeled training data for novel classes is scarce. However, current approaches do not facilitate flexible addition of novel classes. They also require that examples of each class are provided at train and test time, which is memory intensive. In this paper, we address these limitations by presenting the first incremental approach to few-shot instance segmentation: iMTFA. We learn discriminative embeddings for object instances that are merged into class representatives. Storing embedding vectors rather than images effectively solves the memory overhead problem. We match these class embeddings at the RoI-level using cosine similarity. This allows us to add new classes without the need for further training or access to previous training data. In a series of experiments, we consistently outperform the current state-of-the-art. Moreover, the reduced memory requirements allow us to evaluate, for the first time, few-shot instance segmentation performance on all classes in COCO jointly.
Key facts. Cited by 49 papers in the map (data through 14 Oct 2026). Builds on 29 of its 39 references that are in the map. First posted on arXiv 11 May 2021.
Builds on
29 of 39 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2017Mask R-CNNcited by 7,277
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2016YOLO9000: Better, Faster, Strongercited by 1,431
- 2019Objects as Pointscited by 1,175
17 more
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,143
- 2019A Closer Look at Few-shot Classificationcited by 684
- 2016Learning to learn by gradient descent by gradient descentcited by 620
- 2018Dynamic Few-Shot Visual Learning without Forgettingcited by 385
- 2020Frustratingly Simple Few-Shot Object Detectioncited by 282
- 2018Few-shot Object Detection via Feature Reweightingcited by 265
- 2019Meta R-CNN : Towards General Solver for Instance-level Few-shot Learningcited by 182
- 2017Semantic Instance Segmentation with a Discriminative Loss Functioncited by 118
- 2020Incremental Few-Shot Object Detectioncited by 102
- 2015Learning to Segment Object Candidatescited by 79
- 2016Deep Watershed Transform for Instance Segmentationcited by 78
- 2018Deep Cosine Metric Learning for Person Re-Identificationcited by 73
- 2017Recurrent Pixel Embedding for Instance Groupingcited by 58
- 2017MaskLab: Instance Segmentation by Refining Object Detection with Semantic and Direction Featurescited by 54
- 2020FGN: Fully Guided Network for Few-Shot Instance Segmentationcited by 46
- 2018One-Shot Instance Segmentationcited by 43
- 2019ShapeMask: Learning to Segment Novel Objects by Refining Shape Priorscited by 43
Built on by
Citing papers per year: 2021: 2; 2022: 12; 2023: 20; 2024: 7; 2025: 5; 2026: 3.
49 papers.
Sort:
By area:
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
- 2023Class-Incremental Learning: A Surveycited by 209
- 2023Towards Open Vocabulary Learning: A Surveycited by 166
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 163
- 2021Recent Advances of Continual Learning in Computer Vision: An Overviewcited by 55
- 2023A Survey on Few-Shot Class-Incremental Learningcited by 48
- 2022From Forks to Forceps: A New Framework for Instance Segmentation of Surgical Instrumentscited by 32
- 2022RBC: Rectifying the Biased Context in Continual Semantic Segmentationcited by 27
- 2022Integrative Few-Shot Learning for Classification and Segmentationcited by 25
- 2023Few-shot Class-incremental Learning for Classification and Object Detection: A Surveycited by 25
- 2022iFS-RCNN: An Incremental Few-shot Instance Segmentercited by 19
- 2024A Simple Image Segmentation Framework via In-Context Examplescited by 19
37 more
- 2023MaskDiff: Modeling Mask Distribution with Diffusion Probabilistic Model for Few-Shot Instance Segmentationcited by 18
- 2022Incremental Few-Shot Semantic Segmentation via Embedding Adaptive-Update and Hyper-class Representationcited by 16
- 2023New Insights for the Stability-Plasticity Dilemma in Online Continual Learningcited by 16
- 2024Zero-shot Generalizable Incremental Learning for Vision-Language Object Detectioncited by 15
- 2025DC-SAM: In-Context Segment Anything in Images and Videos via Dual Consistencycited by 15
- 2022Incremental-DETR: Incremental Few-Shot Object Detection via Self-Supervised Learningcited by 14
- 2023Reference Twice: A Simple and Unified Baseline for Few-Shot Instance Segmentationcited by 12
- 2023Continual Learning for Image Segmentation with Dynamic Querycited by 12
- 2025No time to train! Training-Free Reference-Based Instance Segmentationcited by 9
- 2021Towards Generalized and Incremental Few-Shot Object Detectioncited by 7
- 2023Prototypical Kernel Learning and Open-set Foreground Perception for Generalized Few-shot Semantic Segmentationcited by 6
- 2023The Art of Camouflage: Few-Shot Learning for Animal Detection and Segmentationcited by 5
- 2023Instance-level Few-shot Learning with Class Hierarchy Miningcited by 5
- 2023Dense Affinity Matching for Few-Shot Segmentationcited by 5
- 2024Few-shot Online Anomaly Detection and Segmentationcited by 5
- 2024Zero-Shot Automatic Annotation and Instance Segmentation using LLM-Generated Datasets: Eliminating Field Imaging and Manual Annotation for Deep Learning Model Developmentcited by 5
- 2022SupeRGB-D: Zero-shot Instance Segmentation in Cluttered Indoor Environmentscited by 4
- 2023A Survey of Deep Visual Cross-Domain Few-Shot Learningcited by 3
- 2022Incremental Few-Shot Learning via Implanting and Compressingcited by 2
- 2022A New Knowledge Distillation Network for Incremental Few-Shot Surface Defect Detectioncited by 2
- 2023ENInst: Enhancing Weakly-supervised Low-shot Instance Segmentationcited by 2
- 2023Incremental Few-Shot Object Detection via Simple Fine-Tuning Approachcited by 2
- 2023Few-shot Class-Incremental Semantic Segmentation via Pseudo-Labeling and Knowledge Distillationcited by 2
- 2024UniFS: Universal Few-shot Instance Perception with Point Representationscited by 2
- 2024Learning from Exemplars for Interactive Image Segmentationcited by 2
- 2022A Comparative Attention Framework for Better Few-Shot Object Detection on Aerial Imagescited by 1
- 2025Decoupling Classifier for Boosting Few-shot Object Detection and Instance Segmentationcited by 1
- 2026SCOPE: Scene-Contextualized Incremental Few-Shot 3D Segmentationcited by 1
- 2022Expanding continual few-shot learning benchmarks to include recognition of specific instancescited by 0
- 2023A Forward and Backward Compatible Framework for Few-shot Class-incremental Pill Recognitioncited by 0
- 2023Transport-Hub-Aware Spatial-Temporal Adaptive Graph Transformer for Traffic Flow Predictioncited by 0
- 2023SKU-Patch: Towards Efficient Instance Segmentation for Unseen Objects in Auto-Storecited by 0
- 2024Integrated Image-Text Based on Semi-supervised Learning for Small Sample Instance Segmentationcited by 0
- 2025Learning to Upscale 3D Segmentations in Neuroimagingcited by 0
- 2025Task-oriented Learnable Diffusion Timesteps for Universal Few-shot Learning of Dense Taskscited by 0
- 2026Reference-based Category Discovery: Unsupervised Object Detection with Category Awarenesscited by 0
- 2026Boundary-by-Mask: Few-Shot Instance Segmentation with Mask-Conditioned Boundary Learning for Texture-Poor Industrial Partscited by 0
- 2026Boundary-by-Mask: Few-Shot Instance Segmentation with Mask-Conditioned Boundary Learning for Texture-Poor Industrial Parts19 Jun 2026
- 2026Reference-based Category Discovery: Unsupervised Object Detection with Category Awareness6 May 2026
- 2026SCOPE: Scene-Contextualized Incremental Few-Shot 3D Segmentation6 Mar 2026
- 2025Task-oriented Learnable Diffusion Timesteps for Universal Few-shot Learning of Dense Tasks29 Dec 2025
- 2025No time to train! Training-Free Reference-Based Instance Segmentation3 Jul 2025
- 2025Learning to Upscale 3D Segmentations in Neuroimaging27 May 2025
- 2025Decoupling Classifier for Boosting Few-shot Object Detection and Instance Segmentation20 May 2025
- 2025DC-SAM: In-Context Segment Anything in Images and Videos via Dual Consistency16 Apr 2025
- 2024Zero-Shot Automatic Annotation and Instance Segmentation using LLM-Generated Datasets: Eliminating Field Imaging and Manual Annotation for Deep Learning Model Development18 Nov 2024
- 2024Integrated Image-Text Based on Semi-supervised Learning for Small Sample Instance Segmentation21 Oct 2024
- 2024A Simple Image Segmentation Framework via In-Context Examples7 Oct 2024
- 2024Learning from Exemplars for Interactive Image Segmentation17 Jun 2024
37 more
- 2024UniFS: Universal Few-shot Instance Perception with Point Representations30 Apr 2024
- 2024Few-shot Online Anomaly Detection and Segmentation27 Mar 2024
- 2024Zero-shot Generalizable Incremental Learning for Vision-Language Object Detection4 Mar 2024
- 2023Continual Learning for Image Segmentation with Dynamic Query29 Nov 2023
- 2023SKU-Patch: Towards Efficient Instance Segmentation for Unseen Objects in Auto-Store8 Nov 2023
- 2023Transport-Hub-Aware Spatial-Temporal Adaptive Graph Transformer for Traffic Flow Prediction12 Oct 2023
- 2023Few-shot Class-incremental Learning for Classification and Object Detection: A Survey13 Aug 2023
- 2023Prototypical Kernel Learning and Open-set Foreground Perception for Generalized Few-shot Semantic Segmentation9 Aug 2023
- 2023Few-shot Class-Incremental Semantic Segmentation via Pseudo-Labeling and Knowledge Distillation5 Aug 2023
- 2023Dense Affinity Matching for Few-Shot Segmentation17 Jul 2023
- 2023Towards Open Vocabulary Learning: A Survey28 Jun 2023
- 2023A Forward and Backward Compatible Framework for Few-shot Class-incremental Pill Recognition24 Apr 2023
- 2023A Survey on Few-Shot Class-Incremental Learning17 Apr 2023
- 2023Instance-level Few-shot Learning with Class Hierarchy Mining15 Apr 2023
- 2023The Art of Camouflage: Few-Shot Learning for Animal Detection and Segmentation15 Apr 2023
- 2023A Survey of Deep Visual Cross-Domain Few-Shot Learning16 Mar 2023
- 2023MaskDiff: Modeling Mask Distribution with Diffusion Probabilistic Model for Few-Shot Instance Segmentation9 Mar 2023
- 2023Incremental Few-Shot Object Detection via Simple Fine-Tuning Approach20 Feb 2023
- 2023ENInst: Enhancing Weakly-supervised Low-shot Instance Segmentation20 Feb 2023
- 2023New Insights for the Stability-Plasticity Dilemma in Online Continual Learning17 Feb 2023
- 2023Class-Incremental Learning: A Survey7 Feb 2023
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Application31 Jan 2023
- 2023Reference Twice: A Simple and Unified Baseline for Few-Shot Instance Segmentation3 Jan 2023
- 2022SupeRGB-D: Zero-shot Instance Segmentation in Cluttered Indoor Environments22 Dec 2022
- 2022From Forks to Forceps: A New Framework for Instance Segmentation of Surgical Instruments26 Nov 2022
- 2022A Comparative Attention Framework for Better Few-Shot Object Detection on Aerial Images25 Oct 2022
- 2022A New Knowledge Distillation Network for Incremental Few-Shot Surface Defect Detection1 Sep 2022
- 2022Expanding continual few-shot learning benchmarks to include recognition of specific instances26 Aug 2022
- 2022Incremental Few-Shot Semantic Segmentation via Embedding Adaptive-Update and Hyper-class Representation26 Jul 2022
- 2022iFS-RCNN: An Incremental Few-shot Instance Segmenter31 May 2022
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities13 May 2022
- 2022Incremental-DETR: Incremental Few-Shot Object Detection via Self-Supervised Learning9 May 2022
- 2022Integrative Few-Shot Learning for Classification and Segmentation29 Mar 2022
- 2022Incremental Few-Shot Learning via Implanting and Compressing19 Mar 2022
- 2022RBC: Rectifying the Biased Context in Continual Semantic Segmentation16 Mar 2022
- 2021Recent Advances of Continual Learning in Computer Vision: An Overview23 Sep 2021
- 2021Towards Generalized and Incremental Few-Shot Object Detection23 Sep 2021
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
- 2023Class-Incremental Learning: A Surveycited by 209
- 2023Towards Open Vocabulary Learning: A Surveycited by 166
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 163
- 2021Recent Advances of Continual Learning in Computer Vision: An Overviewcited by 55
- 2023A Survey on Few-Shot Class-Incremental Learningcited by 48
- 2022From Forks to Forceps: A New Framework for Instance Segmentation of Surgical Instrumentscited by 32
- 2022RBC: Rectifying the Biased Context in Continual Semantic Segmentationcited by 27
- 2022Integrative Few-Shot Learning for Classification and Segmentationcited by 25
- 2023Few-shot Class-incremental Learning for Classification and Object Detection: A Surveycited by 25
- 2022iFS-RCNN: An Incremental Few-shot Instance Segmentercited by 19
- 2024A Simple Image Segmentation Framework via In-Context Examplescited by 19
12 most cited of 45 All 45 (JSON)
- 2026Boundary-by-Mask: Few-Shot Instance Segmentation with Mask-Conditioned Boundary Learning for Texture-Poor Industrial Parts19 Jun 2026
- 2026Reference-based Category Discovery: Unsupervised Object Detection with Category Awareness6 May 2026
- 2026SCOPE: Scene-Contextualized Incremental Few-Shot 3D Segmentation6 Mar 2026
- 2025No time to train! Training-Free Reference-Based Instance Segmentation3 Jul 2025
- 2025Learning to Upscale 3D Segmentations in Neuroimaging27 May 2025
- 2025Decoupling Classifier for Boosting Few-shot Object Detection and Instance Segmentation20 May 2025
- 2025DC-SAM: In-Context Segment Anything in Images and Videos via Dual Consistency16 Apr 2025
- 2024Zero-Shot Automatic Annotation and Instance Segmentation using LLM-Generated Datasets: Eliminating Field Imaging and Manual Annotation for Deep Learning Model Development18 Nov 2024
- 2024Integrated Image-Text Based on Semi-supervised Learning for Small Sample Instance Segmentation21 Oct 2024
- 2024A Simple Image Segmentation Framework via In-Context Examples7 Oct 2024
- 2024Learning from Exemplars for Interactive Image Segmentation17 Jun 2024
- 2024UniFS: Universal Few-shot Instance Perception with Point Representations30 Apr 2024
12 newest of 45 All 45 (JSON)