mlsanityData to 7 Oct 2026

A Self-Distillation Embedded Supervised Affinity Attention Model for Few-Shot Segmentation

arXiv 2108.06600 ↗First posted 14 Aug 2021cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Few-shot segmentation focuses on the generalization of models to segment unseen object with limited annotated samples. However, existing approaches still face two main challenges. First, huge feature distinction between support and query images causes knowledge transferring barrier, which harms the segmentation performance. Second, limited support prototypes cannot adequately represent features of support objects, hard to guide high-quality query segmentation. To deal with the above two issues, we propose self-distillation embedded supervised affinity attention model to improve the performance of few-shot segmentation task. Specifically, the self-distillation guided prototype module uses self-distillation to align the features of support and query. The supervised affinity attention module generates high-quality query attention map to provide sufficient object information. Extensive experiments prove that our model significantly improves the performance compared to existing methods. Comprehensive ablation experiments and visualization studies also show the significant effect of our method on few-shot segmentation task. On COCO-20i dataset, we achieve new state-of-the-art results. Training code and pretrained models are available at https://github.com/cv516Buaa/SD-AANet.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 42 of its 70 references that are in the map. First posted on arXiv 14 Aug 2021.

Builds on

42 of 70 references.

References · 42

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  5. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  6. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  7. 2017Squeeze-and-Excitation Networkscited by 4,763
  8. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
  9. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  10. 2016Pyramid Scene Parsing Networkcited by 2,472
  11. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  12. 2016Matching Networks for One Shot Learningcited by 2,246
30 more
  1. 2016Identity Mappings in Deep Residual Networkscited by 1,960
  2. 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
  3. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
  4. 2018Dual Attention Network for Scene Segmentationcited by 1,001
  5. 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 717
  6. 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 552
  7. 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 491
  8. 2016RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentationcited by 463
  9. 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
  10. 2017One-Shot Learning for Semantic Segmentationcited by 337
  11. 2019Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few Examplescited by 312
  12. 2020Prior Guided Feature Enrichment Network for Few-Shot Segmentationcited by 271
  13. 2019CANet: Class-Agnostic Segmentation Networks with Iterative Refinement and Attentive Few-Shot Learningcited by 217
  14. 2021Adaptive Prototype Learning and Allocation for Few-Shot Segmentationcited by 207
  15. 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
  16. 2020Prototype Mixture Models for Few-shot Semantic Segmentationcited by 190
  17. 2019Feature Weighting and Boosting for Few-Shot Segmentationcited by 189
  18. 2018SG-One: Similarity Guidance Network for One-Shot Semantic Segmentationcited by 169
  19. 2020Part-aware Prototype Network for Few-shot Semantic Segmentationcited by 162
  20. 2014Simultaneous Detection and Segmentationcited by 158
  21. 2021Simpler is Better: Few-shot Semantic Segmentation with Classifier Weight Transformercited by 116
  22. 2019Knowledge Adaptation for Efficient Semantic Segmentationcited by 105
  23. 2020CRNet: Cross-Reference Networks for Few-Shot Segmentationcited by 101
  24. 2021Self-Guided and Cross-Guided Learning for Few-Shot Segmentationcited by 92
  25. 2021Learning Meta-class Memory for Few-Shot Semantic Segmentationcited by 56
  26. 2020BriNet: Towards Bridging the Intra-class and Inter-class Gaps in One-Shot Segmentationcited by 28
  27. 2020SimPropNet: Improved Similarity Propagation for Few-shot Image Segmentationcited by 27
  28. 2021Anti-aliasing Semantic Reconstruction for Few-Shot Semantic Segmentationcited by 23
  29. 2018Decoupled Spatial Neural Attention for Weakly Supervised Semantic Segmentationcited by 15
  30. 2021Embedded Knowledge Distillation in Depth-Level Dynamic Neural Networkcited by 2

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 3; 2024: 2.

6 papers.