A Self-Distillation Embedded Supervised Affinity Attention Model for Few-Shot Segmentation
Not on the map. Why?
Abstract (arXiv)
Few-shot segmentation focuses on the generalization of models to segment unseen object with limited annotated samples. However, existing approaches still face two main challenges. First, huge feature distinction between support and query images causes knowledge transferring barrier, which harms the segmentation performance. Second, limited support prototypes cannot adequately represent features of support objects, hard to guide high-quality query segmentation. To deal with the above two issues, we propose self-distillation embedded supervised affinity attention model to improve the performance of few-shot segmentation task. Specifically, the self-distillation guided prototype module uses self-distillation to align the features of support and query. The supervised affinity attention module generates high-quality query attention map to provide sufficient object information. Extensive experiments prove that our model significantly improves the performance compared to existing methods. Comprehensive ablation experiments and visualization studies also show the significant effect of our method on few-shot segmentation task. On COCO-20i dataset, we achieve new state-of-the-art results. Training code and pretrained models are available at https://github.com/cv516Buaa/SD-AANet.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 42 of its 70 references that are in the map. First posted on arXiv 14 Aug 2021.
Builds on
42 of 70 references.
References · 42
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2016Matching Networks for One Shot Learningcited by 2,246
30 more
- 2016Identity Mappings in Deep Residual Networkscited by 1,960
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
- 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
- 2018Dual Attention Network for Scene Segmentationcited by 1,001
- 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 717
- 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 552
- 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 491
- 2016RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentationcited by 463
- 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
- 2017One-Shot Learning for Semantic Segmentationcited by 337
- 2019Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few Examplescited by 312
- 2020Prior Guided Feature Enrichment Network for Few-Shot Segmentationcited by 271
- 2019CANet: Class-Agnostic Segmentation Networks with Iterative Refinement and Attentive Few-Shot Learningcited by 217
- 2021Adaptive Prototype Learning and Allocation for Few-Shot Segmentationcited by 207
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2020Prototype Mixture Models for Few-shot Semantic Segmentationcited by 190
- 2019Feature Weighting and Boosting for Few-Shot Segmentationcited by 189
- 2018SG-One: Similarity Guidance Network for One-Shot Semantic Segmentationcited by 169
- 2020Part-aware Prototype Network for Few-shot Semantic Segmentationcited by 162
- 2014Simultaneous Detection and Segmentationcited by 158
- 2021Simpler is Better: Few-shot Semantic Segmentation with Classifier Weight Transformercited by 116
- 2019Knowledge Adaptation for Efficient Semantic Segmentationcited by 105
- 2020CRNet: Cross-Reference Networks for Few-Shot Segmentationcited by 101
- 2021Self-Guided and Cross-Guided Learning for Few-Shot Segmentationcited by 92
- 2021Learning Meta-class Memory for Few-Shot Semantic Segmentationcited by 56
- 2020BriNet: Towards Bridging the Intra-class and Inter-class Gaps in One-Shot Segmentationcited by 28
- 2020SimPropNet: Improved Similarity Propagation for Few-shot Image Segmentationcited by 27
- 2021Anti-aliasing Semantic Reconstruction for Few-Shot Semantic Segmentationcited by 23
- 2018Decoupled Spatial Neural Attention for Weakly Supervised Semantic Segmentationcited by 15
- 2021Embedded Knowledge Distillation in Depth-Level Dynamic Neural Networkcited by 2
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 2.
6 papers.
- 2023Hierarchical Dense Correlation Distillation for Few-Shot Segmentationcited by 84
- 2022Dynamic Prototype Convolution Network for Few-Shot Semantic Segmentationcited by 43
- 2023DifFSS: Diffusion Model for Few-Shot Semantic Segmentationcited by 22
- 2024Improve Knowledge Distillation via Label Revision and Data Selectioncited by 5
- 2024Embedding Generalized Semantic Knowledge into Few-Shot Remote Sensing Segmentationcited by 2
- 2023Hierarchical Dense Correlation Distillation for Few-Shot Segmentation-Extended Abstractcited by 0
- 2024Embedding Generalized Semantic Knowledge into Few-Shot Remote Sensing Segmentation22 May 2024
- 2024Improve Knowledge Distillation via Label Revision and Data Selection3 Apr 2024
- 2023DifFSS: Diffusion Model for Few-Shot Semantic Segmentation3 Jul 2023
- 2023Hierarchical Dense Correlation Distillation for Few-Shot Segmentation-Extended Abstract27 Jun 2023
- 2023Hierarchical Dense Correlation Distillation for Few-Shot Segmentation26 Mar 2023
- 2022Dynamic Prototype Convolution Network for Few-Shot Semantic Segmentation22 Apr 2022