PANet: Few-Shot Image Semantic Segmentation with Prototype Alignment
Not on the map. Why?
Abstract (arXiv)
Despite the great progress made by deep CNNs in image semantic segmentation, they typically require a large number of densely-annotated images for training and are difficult to generalize to unseen object categories. Few-shot segmentation has thus been developed to learn to perform segmentation from only a few annotated examples. In this paper, we tackle the challenging few-shot segmentation problem from a metric learning perspective and present PANet, a novel prototype alignment network to better utilize the information of the support set. Our PANet learns class-specific prototype representations from a few support images within an embedding space and then performs segmentation over the query images through matching each pixel to the learned prototypes. With non-parametric metric learning, PANet offers high-quality prototypes that are representative for each semantic class and meanwhile discriminative for different classes. Moreover, PANet introduces a prototype alignment regularization between support and query. With this, PANet fully exploits knowledge from the support and provides better generalization on few-shot segmentation. Significantly, our model achieves the mIoU score of 48.1% and 55.7% on PASCAL-5i for 1-shot and 5-shot settings respectively, surpassing the state-of-the-art method by 1.8% and 8.6%.
Key facts. Cited by 449 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 78; 2022: 74; 2023: 98; 2024: 83; 2025: 71; 2026: 45.
449 papers.
Sort:
By area:
- 2022Language-driven Semantic Segmentationcited by 717
- 2021Image Segmentation Using Text and Image Promptscited by 512
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
- 2021Adaptive Prototype Learning and Allocation for Few-Shot Segmentationcited by 207
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 203
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2023Towards Open Vocabulary Learning: A Surveycited by 166
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 163
- 2024Medical SAM 2: Segment medical images as video via Segment Anything Model 2cited by 154
- 2022Rethinking Semantic Segmentation: A Prototype Viewcited by 140
- 2021Few-Shot Segmentation via Cycle-Consistent Transformercited by 133
- 2022Learning What Not to Segment: A New Perspective on Few-Shot Segmentationcited by 120
38 more
- 2021Simpler is Better: Few-shot Semantic Segmentation with Classifier Weight Transformercited by 116
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
- 2021Continual Semantic Segmentation via Repulsion-Attraction of Sparse and Disentangled Latent Representationscited by 96
- 2022Self-Support Few-Shot Semantic Segmentationcited by 96
- 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trendscited by 93
- 2021Self-Guided and Cross-Guided Learning for Few-Shot Segmentationcited by 92
- 2023UniverSeg: Universal Medical Image Segmentationcited by 91
- 2021Repurposing GANs for One-shot Semantic Part Segmentationcited by 88
- 2022Self-supervised Image-specific Prototype Exploration for Weakly Supervised Semantic Segmentationcited by 87
- 2023Hierarchical Dense Correlation Distillation for Few-Shot Segmentationcited by 84
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
- 2023Review of Large Vision Models and Visual Prompt Engineeringcited by 77
- 2024VRP-SAM: SAM with Visual Reference Promptcited by 75
- 2021Mining Latent Classes for Few-shot Segmentationcited by 69
- 2022Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentationcited by 65
- 2021Recurrent Mask Refinement for Few-Shot Medical Image Segmentationcited by 63
- 2023A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Futurecited by 61
- 2022NeRF-Pose: A First-Reconstruct-Then-Regress Approach for Weakly-supervised 6D Object Pose Estimationcited by 58
- 2022Feature-Proxy Transformer for Few-Shot Segmentationcited by 58
- 2021A Closer Look at Self-training for Zero-Label Semantic Segmentationcited by 57
- 2022Learning Non-target Knowledge for Few-shot Semantic Segmentationcited by 57
- 2021Learning Meta-class Memory for Few-Shot Semantic Segmentationcited by 56
- 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
- 2021Factors of Influence for Transfer Learning across Diverse Appearance Domains and Task Typescited by 54
- 2021Exploiting a Joint Embedding Space for Generalized Zero-Shot Semantic Segmentationcited by 53
- 2023Gold-YOLO: Efficient Object Detector via Gather-and-Distribute Mechanismcited by 51
- 2022Singular Value Fine-tuning: Few-shot Segmentation requires Few-parameters Fine-tuningcited by 50
- 2023LLaFS: When Large Language Models Meet Few-Shot Segmentationcited by 48
- 2021Universal-Prototype Enhancing for Few-Shot Object Detectioncited by 43
- 2022Dynamic Prototype Convolution Network for Few-Shot Semantic Segmentationcited by 43
- 2023Exploring Effective Factors for Improving Visual In-Context Learningcited by 43
- 2024Cross-Domain Few-Shot Object Detection via Enhanced Open-Set Object Detectorcited by 43
- 2022Anomaly Detection-Inspired Few-Shot Medical Image Segmentation Through Self-Supervision With Supervoxelscited by 42
- 2022DAMO-YOLO : A Report on Real-Time Object Detection Designcited by 38
- 2023One-Prompt to Segment All Medical Imagescited by 38
- 2024In Defense of Lazy Visual Grounding for Open-Vocabulary Semantic Segmentationcited by 38
- 2022Intermediate Prototype Mining Transformer for Few-Shot Semantic Segmentationcited by 37
- 2021Few-shot Segmentation with Optimal Transport Matching and Message Flowcited by 36
50 most cited of 449 All 449 (JSON)
- 2026FSS-UBrain: Multi-region Few-Shot Brain Tumor MRI Segmentation26 Sep 2026
- 2026From Few-Shot Segmentation to Clinician-in-the-Loop Medical Image Analysis9 Sep 2026
- 2026FoRIS: Progressive Foreground Refinement for Training-Free In-Context Segmentation3 Sep 2026
- 2026Retrieval-Augmented Visual Prompting: Guiding Foundation Models in Two-Photon Imaging22 Aug 2026
- 2026Leveraging existing sparse point annotations for benthic imagery dense segmentation18 Aug 2026
- 2026Bayesian adaptively-weighted ensembles for few-shot abdominal segmentation6 Aug 2026
- 2026PhenoStitch: Training-Free Panoptic Crop Mapping from Satellite Image Time Series1 Aug 2026
- 2026Training-Free Entity-Level Few-Shot Segmentation of Remote Sensing Images with Advection Refinement31 Jul 2026
- 2026Benchmarking Foundation and Large Language Models for Few-Shot Medical Image Segmentation30 Jul 2026
- 2026Few-Shot Open-Vocabulary Remote Sensing Segmentation via Textual Inversion28 Jul 2026
- 2026SADe: Sparse-Atom Support Decontamination for Few-Shot Segmentation with Weak Support Annotations27 Jul 2026
- 2026ESRVS: Extreme Semi-Supervised Retinal Vessel Segmentation with a Single Annotated Image27 Jul 2026
38 more
- 2026DAUPNet: Domain-Aware Uncertainty Modeling for Reliable Prototype Discrimination in Cross-Domain Few-Shot Semantic Segmentation14 Jul 2026
- 2026REBASE: Reference-Background Subspace Elimination for Training-Free In-Context Segmentation10 Jul 2026
- 2026RUFNet: Query-Guided Support Mask Refinement and Uncertainty Fusion based on Hybrid Mamba for Few-Shot Brain Tumor Segmentation6 Jul 2026
- 2026Unsupervised Data-Efficient Cross-Modal Retrieval with Global-Neighborhood Alignment Hashing30 Jun 2026
- 2026Distilling Temporal Coherence into 2D Networks for Transrectal Ultrasound Prostate Video Segmentation30 Jun 2026
- 2026FROST: Training-Free Few-Shot Segmentation with Frozen Features and Nonparametric Statistics30 Jun 2026
- 2026PSP: Harnessing Position and Shape Priors for Cross-Domain Few-Shot Medical Image Segmentation27 Jun 2026
- 2026Hierarchical Spatial and Channel Aggregation for Cross-domain Few-shot Segmentation23 Jun 2026
- 2026Boundary-by-Mask: Few-Shot Instance Segmentation with Mask-Conditioned Boundary Learning for Texture-Poor Industrial Parts19 Jun 2026
- 2026Attention-Based Prototype Calibration for Multi-Rater Few-Shot Medical Image Segmentation15 Jun 2026
- 2026iSAGE: A Human-in-the-Loop Framework for Remote Sensing Semantic Segmentation via Sparse Point Supervision8 Jun 2026
- 2026Training-Free Generalized Few-Shot Segmentation through Open-Vocabulary Semantic Arbitration8 Jun 2026
- 2026GMBFormer: An NDVI-Guided Global Memory Bank Transformer for Urban Green-Space Extraction from Ultra-High-Resolution Imagery4 Jun 2026
- 2026Selective, Regularized, and Calibrated: Harnessing Vision Foundation Models for Cross-Domain Few-Shot Semantic Segmentation19 May 2026
- 2026Beyond Euclidean Prototypes: Spectral Disentanglement and Geodesic Matching for Few-Shot Medical Image Segmentation18 May 2026
- 2026ScribbleDose: Scribble-Guided Dose Prediction in Radiotherapy12 May 2026
- 2026Geometry-aware Prototype Learning for Cross-domain Few-shot Medical Image Segmentation11 May 2026
- 2026DyABD: The Abdominal Muscle Segmentation in Dynamic MRI Benchmark25 Apr 2026
- 2026SD-FSMIS: Adapting Stable Diffusion for Few-Shot Medical Image Segmentation3 Apr 2026
- 2026INSID3: Training-Free In-Context Segmentation with DINOv330 Mar 2026
- 2026RAP: Retrieve, Adapt, and Prompt-Fit for Training-Free Few-Shot Medical Image Segmentation29 Mar 2026
- 2026Make It Up: Fake Images, Real Gains in Generalized Few-shot Semantic Segmentation28 Mar 2026
- 2026PP-OCRv5: A Specialized 5M-Parameter Model Rivaling Billion-Parameter Vision-Language Models on OCR Tasks25 Mar 2026
- 2026Focus on Background: Exploring SAM's Potential in Few-shot Medical Image Segmentation with Background-centric Prompting22 Mar 2026
- 2026LoD-Loc v3: Generalized Aerial Localization in Dense Cities using Instance Silhouette Alignment20 Mar 2026
- 2026Unify the Views: View-Consistent Prototype Learning for Few-Shot Segmentation6 Mar 2026
- 2026CollabOD: Collaborative Multi-Backbone with Cross-scale Vision for UAV Small Object Detection6 Mar 2026
- 2026Retrieve and Segment: Are a Few Examples Enough to Bridge the Supervision Gap in Open-Vocabulary Segmentation?26 Feb 2026
- 2026Free Lunch in Medical Image Foundation Model Pre-training via Randomized Synthesis and Disentanglement12 Feb 2026
- 2026Revealing the Semantic Selection Gap in DINOv3 through Training-Free Few-Shot Segmentation7 Feb 2026
- 2026Boosting SAM for Cross-Domain Few-Shot Segmentation via Conditional Point Sparsification5 Feb 2026
- 2026Cross-Domain Few-Shot Segmentation via Multi-view Progressive Adaptation5 Feb 2026
- 2026Adaptive Attention Distillation for Robust Few-Shot Segmentation under Environmental Perturbations7 Jan 2026
- 2025Task-oriented Learnable Diffusion Timesteps for Universal Few-shot Learning of Dense Tasks29 Dec 2025
- 2025Contrastive Graph Modeling for Cross-Domain Few-Shot Medical Image Segmentation25 Dec 2025
- 2025Prototypical Learning Guided Context-Aware Segmentation Network for Few-Shot Anomaly Detection17 Dec 2025
- 2025Meta-learners for few-shot weakly-supervised optic disc and cup segmentation on fundus images17 Dec 2025
- 2025TCLeaf-Net: a transformer-convolution framework with global-local attention for robust in-field lesion-level plant leaf disease detection13 Dec 2025
50 newest of 449 All 449 (JSON)
- 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trendscited by 93
- 2025Test-Time Adaptation of Vision-Language Models for Open-Vocabulary Semantic Segmentationcited by 10
- 2026PP-OCRv5: A Specialized 5M-Parameter Model Rivaling Billion-Parameter Vision-Language Models on OCR Taskscited by 9
- 2023[CLS] Token is All You Need for Zero-Shot Semantic Segmentationcited by 5
- 2025The Power of One: A Single Example is All it Takes for Segmentation in VLMscited by 4
- 2025Beyond-Labels: Advancing Open-Vocabulary Segmentation With Vision-Language Modelscited by 1
- 2025Probabilistic Prototype Calibration of Vision-Language Models for Generalized Few-shot Semantic Segmentationcited by 1
- 2026Retrieve and Segment: Are a Few Examples Enough to Bridge the Supervision Gap in Open-Vocabulary Segmentation?cited by 0
- 2026PP-OCRv5: A Specialized 5M-Parameter Model Rivaling Billion-Parameter Vision-Language Models on OCR Tasks25 Mar 2026
- 2026Retrieve and Segment: Are a Few Examples Enough to Bridge the Supervision Gap in Open-Vocabulary Segmentation?26 Feb 2026
- 2025Probabilistic Prototype Calibration of Vision-Language Models for Generalized Few-shot Semantic Segmentation28 Jun 2025
- 2025Test-Time Adaptation of Vision-Language Models for Open-Vocabulary Semantic Segmentation28 May 2025
- 2025The Power of One: A Single Example is All it Takes for Segmentation in VLMs13 Mar 2025
- 2025Beyond-Labels: Advancing Open-Vocabulary Segmentation With Vision-Language Models28 Jan 2025
- 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trends9 May 2023
- 2023[CLS] Token is All You Need for Zero-Shot Semantic Segmentation13 Apr 2023
- 2024Explore In-Context Segmentation via Latent Diffusion Modelscited by 12
- 2024No Re-Train, More Gain: Upgrading Backbones with Diffusion model for Pixel-Wise and Weakly-Supervised Few-Shot Segmentationcited by 0
- 2025Task-oriented Learnable Diffusion Timesteps for Universal Few-shot Learning of Dense Taskscited by 0
- 2026SD-FSMIS: Adapting Stable Diffusion for Few-Shot Medical Image Segmentationcited by 0
- 2026SD-FSMIS: Adapting Stable Diffusion for Few-Shot Medical Image Segmentation3 Apr 2026
- 2025Task-oriented Learnable Diffusion Timesteps for Universal Few-shot Learning of Dense Tasks29 Dec 2025
- 2024No Re-Train, More Gain: Upgrading Backbones with Diffusion model for Pixel-Wise and Weakly-Supervised Few-Shot Segmentation23 Jul 2024
- 2024Explore In-Context Segmentation via Latent Diffusion Models14 Mar 2024
- 2024Hybrid Mamba for Few-Shot Segmentationcited by 21
- 2025UINO-FSS: Unifying Representation Learning and Few-shot Segmentation via Hierarchical Distillation and Mamba-HyperCorrelationcited by 1
- 2026RUFNet: Query-Guided Support Mask Refinement and Uncertainty Fusion based on Hybrid Mamba for Few-Shot Brain Tumor Segmentationcited by 0
- 2026RUFNet: Query-Guided Support Mask Refinement and Uncertainty Fusion based on Hybrid Mamba for Few-Shot Brain Tumor Segmentation6 Jul 2026
- 2025UINO-FSS: Unifying Representation Learning and Few-shot Segmentation via Hierarchical Distillation and Mamba-HyperCorrelation22 Apr 2025
- 2024Hybrid Mamba for Few-Shot Segmentation29 Sep 2024
- 2025Not All Data Are Unlearned Equallycited by 12
- 2025Not All Data Are Unlearned Equally7 Apr 2025
- 2022Language-driven Semantic Segmentationcited by 717
- 2021Image Segmentation Using Text and Image Promptscited by 512
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
- 2021Adaptive Prototype Learning and Allocation for Few-Shot Segmentationcited by 207
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 203
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2023Towards Open Vocabulary Learning: A Surveycited by 166
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 163
- 2024Medical SAM 2: Segment medical images as video via Segment Anything Model 2cited by 154
- 2022Rethinking Semantic Segmentation: A Prototype Viewcited by 140
- 2021Few-Shot Segmentation via Cycle-Consistent Transformercited by 133
- 2022Learning What Not to Segment: A New Perspective on Few-Shot Segmentationcited by 120
12 most cited of 428 All 428 (JSON)
- 2026FSS-UBrain: Multi-region Few-Shot Brain Tumor MRI Segmentation26 Sep 2026
- 2026From Few-Shot Segmentation to Clinician-in-the-Loop Medical Image Analysis9 Sep 2026
- 2026FoRIS: Progressive Foreground Refinement for Training-Free In-Context Segmentation3 Sep 2026
- 2026Leveraging existing sparse point annotations for benthic imagery dense segmentation18 Aug 2026
- 2026Bayesian adaptively-weighted ensembles for few-shot abdominal segmentation6 Aug 2026
- 2026PhenoStitch: Training-Free Panoptic Crop Mapping from Satellite Image Time Series1 Aug 2026
- 2026Training-Free Entity-Level Few-Shot Segmentation of Remote Sensing Images with Advection Refinement31 Jul 2026
- 2026Benchmarking Foundation and Large Language Models for Few-Shot Medical Image Segmentation30 Jul 2026
- 2026Few-Shot Open-Vocabulary Remote Sensing Segmentation via Textual Inversion28 Jul 2026
- 2026SADe: Sparse-Atom Support Decontamination for Few-Shot Segmentation with Weak Support Annotations27 Jul 2026
- 2026ESRVS: Extreme Semi-Supervised Retinal Vessel Segmentation with a Single Annotated Image27 Jul 2026
- 2026DAUPNet: Domain-Aware Uncertainty Modeling for Reliable Prototype Discrimination in Cross-Domain Few-Shot Semantic Segmentation14 Jul 2026
12 newest of 428 All 428 (JSON)