MFNet: Multi-class Few-shot Segmentation Network with Pixel-wise Metric Learning
Not on the map. Why?
Abstract (arXiv)
In visual recognition tasks, few-shot learning requires the ability to learn object categories with few support examples. Its re-popularity in light of the deep learning development is mainly in image classification. This work focuses on few-shot semantic segmentation, which is still a largely unexplored field. A few recent advances are often restricted to single-class few-shot segmentation. In this paper, we first present a novel multi-way (class) encoding and decoding architecture which effectively fuses multi-scale query information and multi-class support information into one query-support embedding. Multi-class segmentation is directly decoded upon this embedding. For better feature fusion, a multi-level attention mechanism is proposed within the architecture, which includes the attention for support feature modulation and attention for multi-scale combination. Last, to enhance the embedding space learning, an additional pixel-wise metric learning module is introduced with triplet loss formulated on the pixel-level embedding of the input image. Extensive experiments on standard benchmarks PASCAL-5i and COCO-20i show clear benefits of our method over the state of the art in few-shot segmentation
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 54 of its 82 references that are in the map. First posted on arXiv 30 Oct 2021.
Builds on
54 of 82 references.
References · 54
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2017Mask R-CNNcited by 7,277
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
38 more
- 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
- 2017One-Shot Learning for Semantic Segmentationcited by 337
- 2017Relation Networks for Object Detectioncited by 305
- 2018Context Encoding for Semantic Segmentationcited by 290
- 2020Prior Guided Feature Enrichment Network for Few-Shot Segmentationcited by 271
- 2018Few-shot Object Detection via Feature Reweightingcited by 265
- 2020Causal Intervention for Weakly-Supervised Semantic Segmentationcited by 229
- 2019CANet: Class-Agnostic Segmentation Networks with Iterative Refinement and Attentive Few-Shot Learningcited by 217
- 2021Adaptive Prototype Learning and Allocation for Few-Shot Segmentationcited by 207
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2020Prototype Mixture Models for Few-shot Semantic Segmentationcited by 190
- 2019Feature Weighting and Boosting for Few-Shot Segmentationcited by 189
- 2019Meta R-CNN : Towards General Solver for Instance-level Few-shot Learningcited by 182
- 2018Low-Shot Learning from Imaginary Datacited by 181
- 2015Attention to Scale: Scale-aware Semantic Image Segmentationcited by 169
- 2018SG-One: Similarity Guidance Network for One-Shot Semantic Segmentationcited by 169
- 2020Part-aware Prototype Network for Few-shot Semantic Segmentationcited by 162
- 2019Semi-Supervised Semantic Segmentation with High- and Low-level Consistencycited by 147
- 2021Few-Shot Segmentation via Cycle-Consistent Transformercited by 133
- 2021Simpler is Better: Few-shot Semantic Segmentation with Classifier Weight Transformercited by 116
- 2020CRNet: Cross-Reference Networks for Few-Shot Segmentationcited by 101
- 2021Self-Guided and Cross-Guided Learning for Few-Shot Segmentationcited by 92
- 2018RepMet: Representative-based metric learning for classification and one-shot object detectioncited by 85
- 2019Hierarchical Clustering with Hard-batch Triplet Loss for Person Re-identificationcited by 83
- 2018Blazingly Fast Video Object Segmentation with Pixel-Wise Metric Learningcited by 74
- 2021Mining Latent Classes for Few-shot Segmentationcited by 69
- 2020HyperSeg: Patch-wise Hypernetwork for Real-time Semantic Segmentationcited by 66
- 2019Dense Classification and Implanting for Few-Shot Learningcited by 56
- 2021Learning Meta-class Memory for Few-Shot Semantic Segmentationcited by 56
- 2018Learning Compositional Representations for Few-Shot Recognitioncited by 50
- 2015Semantic Image Segmentation via Deep Parsing Networkcited by 44
- 2020On the Texture Bias for Few-Shot CNN Segmentationcited by 38
- 2018Weakly Supervised Scene Parsing with Point-based Distance Metric Learningcited by 33
- 2019Differentiable Meta-learning Model for Few-shot Semantic Segmentationcited by 31
- 2020BriNet: Towards Bridging the Intra-class and Inter-class Gaps in One-Shot Segmentationcited by 28
- 2020Restoring Negative Information in Few-Shot Object Detectioncited by 28
- 2021Anti-aliasing Semantic Reconstruction for Few-Shot Semantic Segmentationcited by 23
- 2019Revisiting Metric Learning for Few-Shot Image Classificationcited by 14
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2024: 6; 2025: 3; 2026: 1.
10 papers.
- 2024Rethinking Prior Information Generation with CLIP for Few-Shot Segmentationcited by 20
- 2024Label Anything: Multi-Class Few-Shot Semantic Segmentation with Visual Promptscited by 9
- 2026Revealing the Semantic Selection Gap in DINOv3 through Training-Free Few-Shot Segmentationcited by 3
- 2024Weighting Pseudo-Labels via High-Activation Feature Index Similarity and Object Detection for Semi-Supervised Segmentationcited by 2
- 2024Enhancing Generalized Few-Shot Semantic Segmentation via Effective Knowledge Transfercited by 2
- 2025Balancing Conservatism and Aggressiveness: Prototype-Affinity Hybrid Network for Few-Shot Segmentationcited by 1
- 2025Take a Peek: Efficient Encoder Adaptation for Few-Shot Semantic Segmentation via LoRAcited by 1
- 2024Boosting Few-Shot Segmentation via Instance-Aware Data Augmentation and Local Consensus Guided Cross Attentioncited by 0
- 2024Memory-guided Network with Uncertainty-based Feature Augmentation for Few-shot Semantic Segmentationcited by 0
- 2025Efficient Masked Attention Transformer for Few-Shot Classification and Segmentationcited by 0
- 2026Revealing the Semantic Selection Gap in DINOv3 through Training-Free Few-Shot Segmentation7 Feb 2026
- 2025Take a Peek: Efficient Encoder Adaptation for Few-Shot Semantic Segmentation via LoRA11 Dec 2025
- 2025Efficient Masked Attention Transformer for Few-Shot Classification and Segmentation31 Jul 2025
- 2025Balancing Conservatism and Aggressiveness: Prototype-Affinity Hybrid Network for Few-Shot Segmentation25 Jul 2025
- 2024Enhancing Generalized Few-Shot Semantic Segmentation via Effective Knowledge Transfer20 Dec 2024
- 2024Weighting Pseudo-Labels via High-Activation Feature Index Similarity and Object Detection for Semi-Supervised Segmentation17 Jul 2024
- 2024Label Anything: Multi-Class Few-Shot Semantic Segmentation with Visual Prompts2 Jul 2024
- 2024Memory-guided Network with Uncertainty-based Feature Augmentation for Few-shot Semantic Segmentation1 Jun 2024
- 2024Rethinking Prior Information Generation with CLIP for Few-Shot Segmentation14 May 2024
- 2024Boosting Few-Shot Segmentation via Instance-Aware Data Augmentation and Local Consensus Guided Cross Attention18 Jan 2024