Prototype Mixture Models for Few-shot Semantic Segmentation
Not on the map. Why?
Abstract (arXiv)
Few-shot segmentation is challenging because objects within the support and query images could significantly differ in appearance and pose. Using a single prototype acquired directly from the support image to segment the query image causes semantic ambiguity. In this paper, we propose prototype mixture models (PMMs), which correlate diverse image regions with multiple prototypes to enforce the prototype-based semantic representation. Estimated by an Expectation-Maximization algorithm, PMMs incorporate rich channel-wised and spatial semantics from limited support images. Utilized as representations as well as classifiers, PMMs fully leverage the semantics to activate objects in the query image while depressing background regions in a duplex manner. Extensive experiments on Pascal VOC and MS-COCO datasets show that PMMs significantly improve upon state-of-the-arts. Particularly, PMMs improve 5-shot segmentation performance on MS-COCO by up to 5.82% with only a moderate cost for model size and inference speed.
Key facts. Cited by 190 papers in the map (data through 14 Oct 2026). First posted on arXiv 10 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 39; 2022: 44; 2023: 42; 2024: 34; 2025: 23; 2026: 8.
190 papers.
Sort:
By area:
- 2021Image Segmentation Using Text and Image Promptscited by 512
- 2022Visual Prompting via Image Inpaintingcited by 250
- 2021Adaptive Prototype Learning and Allocation for Few-Shot Segmentationcited by 207
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 163
- 2021Few-Shot Segmentation via Cycle-Consistent Transformercited by 133
- 2022Learning What Not to Segment: A New Perspective on Few-Shot Segmentationcited by 120
- 2021Simpler is Better: Few-shot Semantic Segmentation with Classifier Weight Transformercited by 116
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
- 2022Self-Support Few-Shot Semantic Segmentationcited by 96
- 2021Self-Guided and Cross-Guided Learning for Few-Shot Segmentationcited by 92
- 2023Hierarchical Dense Correlation Distillation for Few-Shot Segmentationcited by 84
38 more
- 2022FS6D: Few-Shot 6D Pose Estimation of Novel Objectscited by 81
- 2021Beyond Max-Margin: Class Margin Equilibrium for Few-shot Object Detectioncited by 80
- 2024VRP-SAM: SAM with Visual Reference Promptcited by 75
- 2021Mining Latent Classes for Few-shot Segmentationcited by 69
- 2022Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentationcited by 65
- 2022Feature-Proxy Transformer for Few-Shot Segmentationcited by 58
- 2022Learning Non-target Knowledge for Few-shot Semantic Segmentationcited by 57
- 2021Learning Meta-class Memory for Few-Shot Semantic Segmentationcited by 56
- 2022Singular Value Fine-tuning: Few-shot Segmentation requires Few-parameters Fine-tuningcited by 50
- 2021Prototypical Cross-Attention Networks for Multiple Object Tracking and Segmentationcited by 43
- 2022Dynamic Prototype Convolution Network for Few-Shot Semantic Segmentationcited by 43
- 2022Open-vocabulary Semantic Segmentation with Frozen Vision-Language Modelscited by 39
- 2022Intermediate Prototype Mining Transformer for Few-Shot Semantic Segmentationcited by 37
- 2021Few-shot Segmentation with Optimal Transport Matching and Message Flowcited by 36
- 2021PFENet++: Boosting Few-shot Semantic Segmentation with the Noise-filtered Context-aware Prior Maskcited by 31
- 2022Unsupervised Video Object Segmentation via Prototype Memory Networkcited by 30
- 2024Cross-Domain Few-Shot Segmentation via Iterative Support-Query Correspondence Miningcited by 30
- 2024Revealing Key Details to See Differences: A Novel Prototypical Perspective for Skeleton-based Action Recognitioncited by 29
- 2023Prototype Adaption and Projection for Few- and Zero-shot 3D Point Cloud Semantic Segmentationcited by 26
- 2024APSeg: Auto-Prompt Network for Cross-Domain Few-Shot Semantic Segmentationcited by 26
- 2021All-Around Real Label Supervision: Cyclic Prototype Consistency Learning for Semi-supervised Medical Image Segmentationcited by 25
- 2022Integrative Few-Shot Learning for Classification and Segmentationcited by 25
- 2022Interclass Prototype Relation for Few-Shot Segmentationcited by 25
- 2023Distilling Self-Supervised Vision Transformers for Weakly-Supervised Few-Shot Classification & Segmentationcited by 24
- 2021Anti-aliasing Semantic Reconstruction for Few-Shot Semantic Segmentationcited by 23
- 2022Doubly Deformable Aggregation of Covariance Matrices for Few-shot Segmentationcited by 23
- 2022A Strong Baseline for Generalized Few-Shot Semantic Segmentationcited by 22
- 2022Mask Matching Transformer for Few-Shot Segmentationcited by 22
- 2023FECANet: Boosting Few-Shot Semantic Segmentation with Feature-Enhanced Context-Aware Networkcited by 22
- 2023DifFSS: Diffusion Model for Few-Shot Semantic Segmentationcited by 22
- 2023UniRef++: Segment Every Reference Object in Spatial and Temporal Spacescited by 22
- 2024Adapt Before Comparison: A New Perspective on Cross-Domain Few-Shot Segmentationcited by 22
- 2022CREAM: Weakly Supervised Object Localization via Class RE-Activation Mappingcited by 21
- 2022MSANet: Multi-Similarity and Attention Guidance for Boosting Few-Shot Segmentationcited by 21
- 2023Learning Expressive Prompting With Residuals for Vision Transformerscited by 21
- 2023Visual and Textual Prior Guided Mask Assemble for Few-Shot Segmentation and Beyondcited by 19
- 2022MSI: Maximize Support-Set Information for Few-Shot Segmentationcited by 18
- 2023CoinSeg: Contrast Inter- and Intra- Class Representations for Incremental Segmentationcited by 18
50 most cited of 190 All 190 (JSON)
- 2026Training-free Cross-domain Few-shot Segmentation via Robust Semantic Representation and Matching23 Jun 2026
- 2026Hierarchical Spatial and Channel Aggregation for Cross-domain Few-shot Segmentation23 Jun 2026
- 2026Selective, Regularized, and Calibrated: Harnessing Vision Foundation Models for Cross-Domain Few-Shot Semantic Segmentation19 May 2026
- 2026Make It Up: Fake Images, Real Gains in Generalized Few-shot Semantic Segmentation28 Mar 2026
- 2026One-Shot Crowd Counting With Density Guidance For Scene Adaptation8 Feb 2026
- 2026Boosting SAM for Cross-Domain Few-Shot Segmentation via Conditional Point Sparsification5 Feb 2026
- 2026Cross-Domain Few-Shot Segmentation via Multi-view Progressive Adaptation5 Feb 2026
- 2026Prototype Learning-Based Few-Shot Segmentation for Low-Light Crack on Concrete Structures19 Jan 2026
- 2025DistillFSS: Synthesizing Few-Shot Knowledge into a Lightweight Segmentation Model5 Dec 2025
- 2025Matching-Based Few-Shot Semantic Segmentation Models Are Interpretable by Design22 Nov 2025
- 2025Multi-Text Guided Few-Shot Semantic Segmentation19 Nov 2025
- 2025Attention-Enhanced Prototypical Learning for Few-Shot Infrastructure Defect Segmentation6 Oct 2025
38 more
- 2025Cross-Domain Few-Shot Segmentation via Ordinary Differential Equations over Time Intervals1 Sep 2025
- 2025Advancing Weakly-Supervised Change Detection in Satellite Images via Adversarial Class Prompting24 Aug 2025
- 2025Correspondence as Video: Test-Time Adaption on SAM2 for Reference Segmentation in the Wild11 Aug 2025
- 2025Balancing Conservatism and Aggressiveness: Prototype-Affinity Hybrid Network for Few-Shot Segmentation25 Jul 2025
- 2025Probabilistic Prototype Calibration of Vision-Language Models for Generalized Few-shot Semantic Segmentation28 Jun 2025
- 2025Tied Prototype Model for Few-Shot Medical Image Segmentation27 Jun 2025
- 2025ProSAM: Enhancing the Robustness of SAM-based Visual Reference Segmentation with Probabilistic Prompts27 Jun 2025
- 2025Adapter Naturally Serves as Decoupler for Cross-Domain Few-Shot Semantic Segmentation9 Jun 2025
- 2025Concentrate on Weakness: Mining Hard Prototypes for Few-Shot Medical Image Segmentation28 May 2025
- 2025GMM-Based Comprehensive Feature Extraction and Relative Distance Preservation For Few-Shot Cross-Modal Retrieval19 May 2025
- 2025ProMi: An Efficient Prototype-Mixture Baseline for Few-Shot Segmentation with Bounding-Box Annotations18 May 2025
- 2025Adapting In-Domain Few-Shot Segmentation to New Domains without Source Domain Retraining30 Apr 2025
- 2025UINO-FSS: Unifying Representation Learning and Few-shot Segmentation via Hierarchical Distillation and Mamba-HyperCorrelation22 Apr 2025
- 2025Few-Shot Referring Video Single- and Multi-Object Segmentation via Cross-Modal Affinity with Instance Sequence Matching18 Apr 2025
- 2025DC-SAM: In-Context Segment Anything in Images and Videos via Dual Consistency16 Apr 2025
- 2025Not All Data Are Unlearned Equally7 Apr 2025
- 2025FSSUWNet: Mitigating the Fragility of Pre-trained Models with Feature Enhancement for Few-Shot Semantic Segmentation in Underwater Images1 Apr 2025
- 2025ProtoDepth: Unsupervised Continual Depth Completion with Prototypes17 Mar 2025
- 2025Interpretable Image Classification via Non-parametric Part Prototype Learning13 Mar 2025
- 2024Multi-Level Correlation Network For Few-Shot Image Classification4 Dec 2024
- 2024Revealing Key Details to See Differences: A Novel Prototypical Perspective for Skeleton-based Action Recognition28 Nov 2024
- 2024FCC: Fully Connected Correlation for One-Shot Segmentation18 Nov 2024
- 2024Lightweight Frequency Masker for Cross-Domain Few-Shot Semantic Segmentation29 Oct 2024
- 2024Improving 3D Few-Shot Segmentation with Inference-Time Pseudo-Labeling13 Oct 2024
- 2024Cognition Transferring and Decoupling for Text-supervised Egocentric Semantic Segmentation2 Oct 2024
- 2024RobustEMD: Domain Robust Matching for Cross-domain Few-shot Medical Image Segmentation1 Oct 2024
- 2024AgMTR: Agent Mining Transformer for Few-shot Segmentation in Remote Sensing26 Sep 2024
- 2024MSDNet: Multi-Scale Decoder for Few-Shot Semantic Segmentation via Transformer-Guided Prototyping17 Sep 2024
- 2024Prompt-and-Transfer: Dynamic Class-aware Enhancement for Few-shot Segmentation16 Sep 2024
- 2024TAVP: Task-Adaptive Visual Prompt for Cross-domain Few-shot Segmentation9 Sep 2024
- 2024Applying ViT in Generalized Few-shot Semantic Segmentation27 Aug 2024
- 2024Correlation Weighted Prototype-based Self-Supervised One-Shot Segmentation of Medical Images12 Aug 2024
- 2024Small Object Few-shot Segmentation for Vision-based Industrial Inspection31 Jul 2024
- 2024Symmetrical Joint Learning Support-query Prototypes for Few-shot Segmentation27 Jul 2024
- 2024Judging from Support-set: A New Way to Utilize Few-Shot Segmentation for Segmentation Refinement Process5 Jul 2024
- 2024Investigating Self-Supervised Methods for Label-Efficient Learning25 Jun 2024
- 2024APSeg: Auto-Prompt Network for Cross-Domain Few-Shot Semantic Segmentation12 Jun 2024
- 2024Prototypical Transformer as Unified Motion Learners3 Jun 2024
50 newest of 190 All 190 (JSON)
- 2022Open-vocabulary Semantic Segmentation with Frozen Vision-Language Modelscited by 39
- 2023Probabilistic Prompt Learning for Dense Predictioncited by 17
- 2023[CLS] Token is All You Need for Zero-Shot Semantic Segmentationcited by 5
- 2025Probabilistic Prototype Calibration of Vision-Language Models for Generalized Few-shot Semantic Segmentationcited by 1
- 2025Probabilistic Prototype Calibration of Vision-Language Models for Generalized Few-shot Semantic Segmentation28 Jun 2025
- 2023[CLS] Token is All You Need for Zero-Shot Semantic Segmentation13 Apr 2023
- 2023Probabilistic Prompt Learning for Dense Prediction3 Apr 2023
- 2022Open-vocabulary Semantic Segmentation with Frozen Vision-Language Models27 Oct 2022
- 2023DifFSS: Diffusion Model for Few-Shot Semantic Segmentationcited by 22
- 2024Explore In-Context Segmentation via Latent Diffusion Modelscited by 12
- 2023Analogy-Forming Transformers for Few-Shot 3D Parsingcited by 1
- 2023Analogy-Forming Transformers for Few-Shot 3D Parsing27 Apr 2023
- 2025Not All Data Are Unlearned Equallycited by 12
- 2025Not All Data Are Unlearned Equally7 Apr 2025
- 2021Image Segmentation Using Text and Image Promptscited by 512
- 2022Visual Prompting via Image Inpaintingcited by 250
- 2021Adaptive Prototype Learning and Allocation for Few-Shot Segmentationcited by 207
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 163
- 2021Few-Shot Segmentation via Cycle-Consistent Transformercited by 133
- 2022Learning What Not to Segment: A New Perspective on Few-Shot Segmentationcited by 120
- 2021Simpler is Better: Few-shot Semantic Segmentation with Classifier Weight Transformercited by 116
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
- 2022Self-Support Few-Shot Semantic Segmentationcited by 96
- 2021Self-Guided and Cross-Guided Learning for Few-Shot Segmentationcited by 92
- 2023Hierarchical Dense Correlation Distillation for Few-Shot Segmentationcited by 84
12 most cited of 179 All 179 (JSON)
- 2026Training-free Cross-domain Few-shot Segmentation via Robust Semantic Representation and Matching23 Jun 2026
- 2026Hierarchical Spatial and Channel Aggregation for Cross-domain Few-shot Segmentation23 Jun 2026
- 2026Selective, Regularized, and Calibrated: Harnessing Vision Foundation Models for Cross-Domain Few-Shot Semantic Segmentation19 May 2026
- 2026Make It Up: Fake Images, Real Gains in Generalized Few-shot Semantic Segmentation28 Mar 2026
- 2026One-Shot Crowd Counting With Density Guidance For Scene Adaptation8 Feb 2026
- 2026Boosting SAM for Cross-Domain Few-Shot Segmentation via Conditional Point Sparsification5 Feb 2026
- 2026Cross-Domain Few-Shot Segmentation via Multi-view Progressive Adaptation5 Feb 2026
- 2026Prototype Learning-Based Few-Shot Segmentation for Low-Light Crack on Concrete Structures19 Jan 2026
- 2025DistillFSS: Synthesizing Few-Shot Knowledge into a Lightweight Segmentation Model5 Dec 2025
- 2025Matching-Based Few-Shot Semantic Segmentation Models Are Interpretable by Design22 Nov 2025
- 2025Multi-Text Guided Few-Shot Semantic Segmentation19 Nov 2025
- 2025Attention-Enhanced Prototypical Learning for Few-Shot Infrastructure Defect Segmentation6 Oct 2025
12 newest of 179 All 179 (JSON)