KD-SCFNet: Towards More Accurate and Efficient Salient Object Detection via Knowledge Distillation
Not on the map. Why?
Abstract (arXiv)
Most existing salient object detection (SOD) models are difficult to apply due to the complex and huge model structures. Although some lightweight models are proposed, the accuracy is barely satisfactory. In this paper, we design a novel semantics-guided contextual fusion network (SCFNet) that focuses on the interactive fusion of multi-level features for accurate and efficient salient object detection. Furthermore, we apply knowledge distillation to SOD task and provide a sizeable dataset KD-SOD80K. In detail, we transfer the rich knowledge from a seasoned teacher to the untrained SCFNet through unlabeled images, enabling SCFNet to learn a strong generalization ability to detect salient objects more accurately. The knowledge distillation based SCFNet (KDSCFNet) achieves comparable accuracy to the state-of-the-art heavyweight methods with less than 1M parameters and 174 FPS real-time detection speed. Extensive experiments demonstrate the robustness and effectiveness of the proposed distillation method and SOD framework. Code and data: https://github.com/zhangjinCV/KD-SCFNet.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 27 of its 51 references that are in the map. First posted on arXiv 3 Aug 2022.
Builds on
27 of 51 references.
References · 27
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2019Searching for MobileNetV3cited by 1,984
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 614
- 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 410
- 2018Enhanced-alignment Measure for Binary Foreground Map Evaluationcited by 370
- 2019Cascaded Partial Decoder for Fast and Accurate Salient Object Detectioncited by 216
- 2020Multi-scale Interactive Network for Salient Object Detectioncited by 212
15 more
- 2019A Simple Pooling-Based Design for Real-Time Salient Object Detectioncited by 211
- 2014The Secrets of Salient Object Segmentationcited by 200
- 2015Visual Saliency Based on Multiscale Deep Featurescited by 185
- 2019F3Net: Fusion, Feedback and Focus for Salient Object Detectioncited by 176
- 2021Visual Saliency Transformercited by 175
- 2020Suppress and Balance: A Simple Gated Network for Salient Object Detectioncited by 126
- 2020Label Decoupling Framework for Salient Object Detectioncited by 111
- 2020Global Context-Aware Progressive Aggregation Network for Salient Object Detectioncited by 109
- 2021Non-Salient Region Object Mining for Weakly Supervised Semantic Segmentationcited by 95
- 2020MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Trickscited by 39
- 2020Dynamic Feature Integration for Simultaneous Detection of Salient Object, Edge and Skeletoncited by 34
- 2019Boundary Loss for Remote Sensing Imagery Semantic Segmentationcited by 27
- 2018Non-rigid Object Tracking via Deep Multi-scale Spatial-temporal Discriminative Saliency Mapscited by 26
- 2019DNA: Deeply-supervised Nonlinear Aggregation for Salient Object Detectioncited by 17
- 2019Salient Object Detection with Purificatory Mechanism and Structural Similarity Losscited by 14
Built on by
Citing papers per year: 2024: 1.
1 paper.