# Differentiable Meta-learning Model for Few-shot Semantic Segmentation

arXiv: https://arxiv.org/abs/1911.10371 · HTML: https://mlsanity.com/paper/1911.10371/

## Key facts

- Cited by 31 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 Nov 2019.

## Built on by (most cited first, 30 of 31)

- [Hypercorrelation Squeeze for Few-Shot Segmentation](https://mlsanity.com/paper/2104.01538/) (2021)
- [Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond](https://mlsanity.com/paper/2101.11517/) (2021)
- [Self-Support Few-Shot Semantic Segmentation](https://mlsanity.com/paper/2207.11549/) (2022)
- [Self-Guided and Cross-Guided Learning for Few-Shot Segmentation](https://mlsanity.com/paper/2103.16129/) (2021)
- [Mining Latent Classes for Few-shot Segmentation](https://mlsanity.com/paper/2103.15402/) (2021)
- [Feature-Proxy Transformer for Few-Shot Segmentation](https://mlsanity.com/paper/2210.06908/) (2022)
- [PFENet++: Boosting Few-shot Semantic Segmentation with the Noise-filtered Context-aware Prior Mask](https://mlsanity.com/paper/2109.13788/) (2021)
- [Integrative Few-Shot Learning for Classification and Segmentation](https://mlsanity.com/paper/2203.15712/) (2022)
- [Interclass Prototype Relation for Few-Shot Segmentation](https://mlsanity.com/paper/2211.08681/) (2022)
- [Medical Image Segmentation with Limited Supervision: A Review of Deep Network Models](https://mlsanity.com/paper/2103.00429/) (2021)
- [Learning Expressive Prompting With Residuals for Vision Transformers](https://mlsanity.com/paper/2303.15591/) (2023)
- [Visual Semantic Segmentation Based on Few/Zero-Shot Learning: An Overview](https://mlsanity.com/paper/2211.08352/) (2022)
- [MFNet: Multi-class Few-shot Segmentation Network with Pixel-wise Metric Learning](https://mlsanity.com/paper/2111.00232/) (2021)
- [Adaptive FSS: A Novel Few-Shot Segmentation Framework via Prototype Enhancement](https://mlsanity.com/paper/2312.15731/) (2023)
- [Label Anything: Multi-Class Few-Shot Semantic Segmentation with Visual Prompts](https://mlsanity.com/paper/2407.02075/) (2024)
- [MetaMedSeg: Volumetric Meta-learning for Few-Shot Organ Segmentation](https://mlsanity.com/paper/2109.09734/) (2021)
- [Slide-SAM: Medical SAM Meets Sliding Window](https://mlsanity.com/paper/2311.10121/) (2023)
- [Few-shot Semantic Image Synthesis Using StyleGAN Prior](https://mlsanity.com/paper/2103.14877/) (2021)
- [End-to-end One-shot Human Parsing](https://mlsanity.com/paper/2105.01241/) (2021)
- [Exploring Few-Shot Defect Segmentation in General Industrial Scenarios with Metric Learning and Vision Foundation Models](https://mlsanity.com/paper/2502.01216/) (2025)
- [Meta-Optimization for Higher Model Generalizability in Single-Image Depth Prediction](https://mlsanity.com/paper/2305.07269/) (2023)
- [MetaPix: Domain Transfer for Semantic Segmentation by Meta Pixel Weighting](https://mlsanity.com/paper/2110.01777/) (2021)
- [Stage Conscious Attention Network (SCAN) : A Demonstration-Conditioned Policy for Few-Shot Imitation](https://mlsanity.com/paper/2112.02278/) (2021)
- [The Ikshana Hypothesis of Human Scene Understanding](https://mlsanity.com/paper/2101.10837/) (2021)
- [LERENet: Eliminating Intra-class Differences for Metal Surface Defect Few-shot Semantic Segmentation](https://mlsanity.com/paper/2403.11122/) (2024)
- [PDFNet: Pointwise Dense Flow Network for Urban-Scene Segmentation](https://mlsanity.com/paper/2109.10083/) (2021)
- [Activating the Discriminability of Novel Classes for Few-shot Segmentation](https://mlsanity.com/paper/2212.01131/) (2022)
- [Unsupervised augmentation optimization for few-shot medical image segmentation](https://mlsanity.com/paper/2306.05107/) (2023)
- [Efficient Masked Attention Transformer for Few-Shot Classification and Segmentation](https://mlsanity.com/paper/2507.23642/) (2025)
- [Learning to Sense for Driving: Joint Optics-Sensor-Model Co-Design for Semantic Segmentation](https://mlsanity.com/paper/2512.20815/) (2025)

## Abstract (arXiv)

To address the annotation scarcity issue in some cases of semantic segmentation, there have been a few attempts to develop the segmentation model in the few-shot learning paradigm. However, most existing methods only focus on the traditional 1-way segmentation setting (i.e., one image only contains a single object). This is far away from practical semantic segmentation tasks where the K-way setting (K>1) is usually required by performing the accurate multi-object segmentation. To deal with this issue, we formulate the few-shot semantic segmentation task as a learning-based pixel classification problem and propose a novel framework called MetaSegNet based on meta-learning. In MetaSegNet, an architecture of embedding module consisting of the global and local feature branches is developed to extract the appropriate meta-knowledge for the few-shot segmentation. Moreover, we incorporate a linear model into MetaSegNet as a base learner to directly predict the label of each pixel for the multi-object segmentation. Furthermore, our MetaSegNet can be trained by the episodic training mechanism in an end-to-end manner from scratch. Experiments on two popular semantic segmentation datasets, i.e., PASCAL VOC and COCO, reveal the effectiveness of the proposed MetaSegNet in the K-way few-shot semantic segmentation task.
