One-Shot Instance Segmentation
Not on the map. Why?
Abstract (arXiv)
We tackle the problem of one-shot instance segmentation: Given an example image of a novel, previously unknown object category, find and segment all objects of this category within a complex scene. To address this challenging new task, we propose Siamese Mask R-CNN. It extends Mask R-CNN by a Siamese backbone encoding both reference image and scene, allowing it to target detection and segmentation towards the reference category. We demonstrate empirical results on MS Coco highlighting challenges of the one-shot setting: while transferring knowledge about instance segmentation to novel object categories works very well, targeting the detection network towards the reference category appears to be more difficult. Our work provides a first strong baseline for one-shot instance segmentation and will hopefully inspire further research into more powerful and flexible scene analysis algorithms. Code is available at: https://github.com/bethgelab/siamese-mask-rcnn
Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 12; 2023: 11; 2024: 7; 2025: 2; 2026: 2.
43 papers.
Sort:
By area:
- 2021Image Segmentation Using Text and Image Promptscited by 512
- 2022Simple Open-Vocabulary Object Detection with Vision Transformerscited by 305
- 2023Towards Open Vocabulary Learning: A Surveycited by 166
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 163
- 2021Generalized Few-Shot Object Detection without Forgettingcited by 88
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2022OSOP: A Multi-Stage One Shot Object Pose Estimation Frameworkcited by 81
- 2021Incremental Few-Shot Instance Segmentationcited by 49
- 2022Learning to Count Anything: Reference-less Class-agnostic Counting with Weak Supervisioncited by 41
- 2022One-Shot Transfer of Affordance Regions? AffCorrs!cited by 31
- 2021Few-Shot Object Detection: A Comprehensive Surveycited by 29
- 2023Universal Few-shot Learning of Dense Prediction Tasks with Visual Token Matchingcited by 29
31 more
- 2023Single-Stage Visual Query Localization in Egocentric Videoscited by 20
- 2022iFS-RCNN: An Incremental Few-shot Instance Segmentercited by 19
- 2023MaskDiff: Modeling Mask Distribution with Diffusion Probabilistic Model for Few-Shot Instance Segmentationcited by 18
- 2023Can SAM Count Anything? An Empirical Study on SAM Countingcited by 18
- 2021FAPIS: A Few-shot Anchor-free Part-based Instance Segmentercited by 15
- 2023Detect Everything with Few Examplescited by 14
- 2021Object Counting: You Only Need to Look at Onecited by 13
- 2023Reference Twice: A Simple and Unified Baseline for Few-Shot Instance Segmentationcited by 12
- 2022VizWiz-FewShot: Locating Objects in Images Taken by People With Visual Impairmentscited by 11
- 2022Recent Few-Shot Object Detection Algorithms: A Survey with Performance Comparisoncited by 8
- 2023UniAP: Towards Universal Animal Perception in Vision via Few-shot Learningcited by 7
- 2021A Survey of Deep Learning for Low-Shot Object Detectioncited by 6
- 2023Instance-level Few-shot Learning with Class Hierarchy Miningcited by 5
- 2024Few-shot Online Anomaly Detection and Segmentationcited by 5
- 2024BIV-Priv-Seg: Locating Private Content in Images Taken by People With Visual Impairmentscited by 5
- 2024Unsupervised Pre-training with Language-Vision Prompts for Low-Data Instance Segmentationcited by 4
- 2021CAT: Cross-Attention Transformer for One-Shot Object Detectioncited by 3
- 2021Localizing Infinity-shaped fishes: Sketch-guided object localization in the wildcited by 3
- 2022Geodesic-Former: a Geodesic-Guided Few-shot 3D Point Cloud Instance Segmentercited by 3
- 2023ENInst: Enhancing Weakly-supervised Low-shot Instance Segmentationcited by 2
- 2024UniFS: Universal Few-shot Instance Perception with Point Representationscited by 2
- 2024Learning Gaussian Data Augmentation in Feature Space for One-shot Object Detection in Mangacited by 2
- 2025Decoupling Classifier for Boosting Few-shot Object Detection and Instance Segmentationcited by 1
- 2022Less than Few: Self-Shot Video Instance Segmentationcited by 0
- 2022Expanding continual few-shot learning benchmarks to include recognition of specific instancescited by 0
- 2023SKU-Patch: Towards Efficient Instance Segmentation for Unseen Objects in Auto-Storecited by 0
- 2024Deep ContourFlow: Advancing Active Contours with Deep Learningcited by 0
- 2024UIFormer: A Unified Transformer-based Framework for Incremental Few-Shot Object Detection and Instance Segmentationcited by 0
- 2025Indirect Attention: Turning Context Misalignment into a Featurecited by 0
- 2026From Pixels to Concepts: Do Segmentation Models Understand What They Segment?cited by 0
- 2026Boundary-by-Mask: Few-Shot Instance Segmentation with Mask-Conditioned Boundary Learning for Texture-Poor Industrial Partscited by 0
- 2026Boundary-by-Mask: Few-Shot Instance Segmentation with Mask-Conditioned Boundary Learning for Texture-Poor Industrial Parts19 Jun 2026
- 2026From Pixels to Concepts: Do Segmentation Models Understand What They Segment?10 May 2026
- 2025Indirect Attention: Turning Context Misalignment into a Feature30 Sep 2025
- 2025Decoupling Classifier for Boosting Few-shot Object Detection and Instance Segmentation20 May 2025
- 2024UIFormer: A Unified Transformer-based Framework for Incremental Few-Shot Object Detection and Instance Segmentation13 Nov 2024
- 2024Learning Gaussian Data Augmentation in Feature Space for One-shot Object Detection in Manga8 Oct 2024
- 2024BIV-Priv-Seg: Locating Private Content in Images Taken by People With Visual Impairments25 Jul 2024
- 2024Deep ContourFlow: Advancing Active Contours with Deep Learning15 Jul 2024
- 2024Unsupervised Pre-training with Language-Vision Prompts for Low-Data Instance Segmentation22 May 2024
- 2024UniFS: Universal Few-shot Instance Perception with Point Representations30 Apr 2024
- 2024Few-shot Online Anomaly Detection and Segmentation27 Mar 2024
- 2023SKU-Patch: Towards Efficient Instance Segmentation for Unseen Objects in Auto-Store8 Nov 2023
31 more
- 2023Detect Everything with Few Examples22 Sep 2023
- 2023UniAP: Towards Universal Animal Perception in Vision via Few-shot Learning19 Aug 2023
- 2023Towards Open Vocabulary Learning: A Survey28 Jun 2023
- 2023Single-Stage Visual Query Localization in Egocentric Videos15 Jun 2023
- 2023Can SAM Count Anything? An Empirical Study on SAM Counting21 Apr 2023
- 2023Instance-level Few-shot Learning with Class Hierarchy Mining15 Apr 2023
- 2023Universal Few-shot Learning of Dense Prediction Tasks with Visual Token Matching27 Mar 2023
- 2023MaskDiff: Modeling Mask Distribution with Diffusion Probabilistic Model for Few-Shot Instance Segmentation9 Mar 2023
- 2023ENInst: Enhancing Weakly-supervised Low-shot Instance Segmentation20 Feb 2023
- 2023Reference Twice: A Simple and Unified Baseline for Few-Shot Instance Segmentation3 Jan 2023
- 2022One-Shot Transfer of Affordance Regions? AffCorrs!15 Sep 2022
- 2022Expanding continual few-shot learning benchmarks to include recognition of specific instances26 Aug 2022
- 2022VizWiz-FewShot: Locating Objects in Images Taken by People With Visual Impairments24 Jul 2022
- 2022Geodesic-Former: a Geodesic-Guided Few-shot 3D Point Cloud Instance Segmenter22 Jul 2022
- 2022iFS-RCNN: An Incremental Few-shot Instance Segmenter31 May 2022
- 2022Learning to Count Anything: Reference-less Class-agnostic Counting with Weak Supervision20 May 2022
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities13 May 2022
- 2022Simple Open-Vocabulary Object Detection with Vision Transformers12 May 2022
- 2022Less than Few: Self-Shot Video Instance Segmentation19 Apr 2022
- 2022OSOP: A Multi-Stage One Shot Object Pose Estimation Framework29 Mar 2022
- 2022Recent Few-Shot Object Detection Algorithms: A Survey with Performance Comparison27 Mar 2022
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learning7 Mar 2022
- 2021Few-Shot Object Detection: A Comprehensive Survey22 Dec 2021
- 2021Image Segmentation Using Text and Image Prompts18 Dec 2021
- 2021Object Counting: You Only Need to Look at One11 Dec 2021
- 2021A Survey of Deep Learning for Low-Shot Object Detection6 Dec 2021
- 2021Localizing Infinity-shaped fishes: Sketch-guided object localization in the wild24 Sep 2021
- 2021Generalized Few-Shot Object Detection without Forgetting20 May 2021
- 2021Incremental Few-Shot Instance Segmentation11 May 2021
- 2021CAT: Cross-Attention Transformer for One-Shot Object Detection30 Apr 2021
- 2021FAPIS: A Few-shot Anchor-free Part-based Instance Segmenter31 Mar 2021
- 2021Image Segmentation Using Text and Image Promptscited by 512
- 2022Simple Open-Vocabulary Object Detection with Vision Transformerscited by 305
- 2023Towards Open Vocabulary Learning: A Surveycited by 166
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 163
- 2021Generalized Few-Shot Object Detection without Forgettingcited by 88
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2022OSOP: A Multi-Stage One Shot Object Pose Estimation Frameworkcited by 81
- 2021Incremental Few-Shot Instance Segmentationcited by 49
- 2022Learning to Count Anything: Reference-less Class-agnostic Counting with Weak Supervisioncited by 41
- 2022One-Shot Transfer of Affordance Regions? AffCorrs!cited by 31
- 2021Few-Shot Object Detection: A Comprehensive Surveycited by 29
- 2023Universal Few-shot Learning of Dense Prediction Tasks with Visual Token Matchingcited by 29
12 most cited of 42 All 42 (JSON)
- 2026Boundary-by-Mask: Few-Shot Instance Segmentation with Mask-Conditioned Boundary Learning for Texture-Poor Industrial Parts19 Jun 2026
- 2026From Pixels to Concepts: Do Segmentation Models Understand What They Segment?10 May 2026
- 2025Indirect Attention: Turning Context Misalignment into a Feature30 Sep 2025
- 2025Decoupling Classifier for Boosting Few-shot Object Detection and Instance Segmentation20 May 2025
- 2024UIFormer: A Unified Transformer-based Framework for Incremental Few-Shot Object Detection and Instance Segmentation13 Nov 2024
- 2024Learning Gaussian Data Augmentation in Feature Space for One-shot Object Detection in Manga8 Oct 2024
- 2024BIV-Priv-Seg: Locating Private Content in Images Taken by People With Visual Impairments25 Jul 2024
- 2024Deep ContourFlow: Advancing Active Contours with Deep Learning15 Jul 2024
- 2024Unsupervised Pre-training with Language-Vision Prompts for Low-Data Instance Segmentation22 May 2024
- 2024UniFS: Universal Few-shot Instance Perception with Point Representations30 Apr 2024
- 2024Few-shot Online Anomaly Detection and Segmentation27 Mar 2024
- 2023SKU-Patch: Towards Efficient Instance Segmentation for Unseen Objects in Auto-Store8 Nov 2023
12 newest of 42 All 42 (JSON)