Joint Learning of Saliency Detection and Weakly Supervised Semantic Segmentation
Not on the map. Why?
Abstract (arXiv)
Existing weakly supervised semantic segmentation (WSSS) methods usually utilize the results of pre-trained saliency detection (SD) models without explicitly modeling the connections between the two tasks, which is not the most efficient configuration. Here we propose a unified multi-task learning framework to jointly solve WSSS and SD using a single network, ie saliency, and segmentation network (SSNet). SSNet consists of a segmentation network (SN) and a saliency aggregation module (SAM). For an input image, SN generates the segmentation result and, SAM predicts the saliency of each category and aggregating the segmentation masks of all categories into a saliency map. The proposed network is trained end-to-end with image-level category labels and class-agnostic pixel-level saliency labels. Experiments on PASCAL VOC 2012 segmentation dataset and four saliency benchmark datasets show the performance of our method compares favorably against state-of-the-art weakly supervised segmentation methods and fully supervised saliency detection methods.
Key facts. Cited by 57 papers in the map (data through 13 Oct 2026). First posted on arXiv 9 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 21; 2022: 11; 2023: 14; 2024: 7; 2025: 3; 2026: 1.
57 papers.
Sort:
By area:
- 2021Salient Object Detection via Integrity Learningcited by 133
- 2021Railroad is not a Train: Saliency as Pseudo-pixel Supervision for Weakly Supervised Semantic Segmentationcited by 127
- 2021Uncertainty-aware Joint Salient Object and Camouflaged Object Detectioncited by 114
- 2021Large-scale Unsupervised Semantic Segmentationcited by 99
- 2021Weakly Supervised Semantic Segmentation by Pixel-to-Prototype Contrastcited by 85
- 2021Leveraging Auxiliary Tasks with Affinity Learning for Weakly Supervised Semantic Segmentationcited by 77
- 2022Regional Semantic Contrast and Aggregation for Weakly Supervised Semantic Segmentationcited by 64
- 2021Pseudo-mask Matters in Weakly-supervised Semantic Segmentationcited by 48
- 2023Advances in Deep Concealed Scene Understandingcited by 47
- 2023Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspectivecited by 43
- 2021Background-Aware Pooling and Noise-Aware Loss for Weakly-Supervised Semantic Segmentationcited by 41
- 2022Threshold Matters in WSSS: Manipulating the Activation for the Robust and Accurate Segmentation Model Against Thresholdscited by 37
38 more
- 2022Class-Aware Adversarial Transformers for Medical Image Segmentationcited by 33
- 2021Group Collaborative Learning for Co-Salient Object Detectioncited by 32
- 2022Mine yOur owN Anatomy: Revisiting Medical Image Segmentation with Extremely Limited Labelscited by 30
- 2021Unsupervised Foreground Extraction via Deep Region Competitioncited by 26
- 2021Adaptive Affinity Loss and Erroneous Pseudo-Label Refinement for Weakly Supervised Semantic Segmentationcited by 22
- 2022Weakly-supervised segmentation of referring expressionscited by 21
- 2021Weakly-supervised Instance Segmentation via Class-agnostic Learning with Salient Imagescited by 20
- 2021Salient Objects in Cluttercited by 19
- 2022Saliency Guided Inter- and Intra-Class Relation Constraints for Weakly Supervised Semantic Segmentationcited by 19
- 2023Weakly-Supervised Semantic Segmentation with Image-Level Labels: from Traditional Models to Foundation Modelscited by 19
- 2023Sketch2Saliency: Learning to Detect Salient Objects from Human Drawingscited by 17
- 2021BiconNet: An Edge-preserved Connectivity-based Approach for Salient Object Detectioncited by 15
- 2022Online Easy Example Mining for Weakly-supervised Gland Segmentation from Histology Imagescited by 15
- 2022Panoramic Vision Transformer for Saliency Detection in 360deg Videoscited by 15
- 2021Cross-Image Region Mining with Region Prototypical Network for Weakly Supervised Segmentationcited by 13
- 2022GCoNet+: A Stronger Group Collaborative Co-Salient Object Detectorcited by 11
- 2023Memory-aided Contrastive Consensus Learning for Co-salient Object Detectioncited by 9
- 2023Co-Salient Object Detection with Co-Representation Purificationcited by 9
- 2021GETAM: Gradient-weighted Element-wise Transformer Attention Map for Weakly-supervised Semantic segmentationcited by 8
- 2024Quality-aware Selective Fusion Network for V-D-T Salient Object Detectioncited by 8
- 2023Interaction-aware Joint Attention Estimation Using People Attributescited by 6
- 2021Generalized Multi-Task Learning from Substantially Unlabeled Multi-Source Medical Image Datacited by 4
- 2024Multi-Task Label Discovery via Hierarchical Task Tokens for Partially Annotated Dense Predictionscited by 4
- 2023Coupling Global Context and Local Contents for Weakly-Supervised Semantic Segmentationcited by 3
- 2023Joint Salient Object Detection and Camouflaged Object Detection via Uncertainty-aware Learningcited by 3
- 2024Auxiliary Tasks Enhanced Dual-affinity Learning for Weakly Supervised Semantic Segmentationcited by 3
- 2021Weakly Supervised Foreground Learning for Weakly Supervised Localization and Detectioncited by 2
- 2021Multi-scale Edge-based U-shape Network for Salient Object Detectioncited by 2
- 2022Automatic segmentation of meniscus based on MAE self-supervision and point-line weak supervision paradigmcited by 2
- 2024Pixel-Level Domain Adaptation: A New Perspective for Enhancing Weakly Supervised Semantic Segmentationcited by 2
- 2021Simpler Does It: Generating Semantic Labels with Objectness Guidancecited by 1
- 2022Weakly Supervised Faster-RCNN+FPN to classify animals in camera trap imagescited by 1
- 2023MECPformer: Multi-estimations Complementary Patch with CNN-Transformers for Weakly Supervised Semantic Segmentationcited by 1
- 2025Generalized Task-Driven Medical Image Quality Enhancement with Gradient Promotioncited by 1
- 2021Maximize the Exploration of Congeneric Semantics for Weakly Supervised Semantic Segmentationcited by 0
- 2023SILOP: An Automated Framework for Semantic Segmentation Using Image Labels Based on Object Perimeterscited by 0
- 2023A Self-Training Framework Based on Multi-Scale Attention Fusion for Weakly Supervised Semantic Segmentationcited by 0
- 2023Beyond Discriminative Regions: Saliency Maps as Alternatives to CAMs for Weakly Supervised Semantic Segmentationcited by 0
50 most cited of 57 All 57 (JSON)
- 2026ViASNet: A Video Ad Saliency Network for Predicting Dynamic Saliency and Viewer Engagement28 May 2026
- 2025Deep semi-supervised approach based on consistency regularization and similarity learning for weeds classification12 Oct 2025
- 2025SIGN: A Statistically-Informed Gaze Network for Gaze Time Prediction29 Jan 2025
- 2025Generalized Task-Driven Medical Image Quality Enhancement with Gradient Promotion2 Jan 2025
- 2024Concept Guided Co-salient Object Detection21 Dec 2024
- 2024Multi-Task Label Discovery via Hierarchical Task Tokens for Partially Annotated Dense Predictions27 Nov 2024
- 2024Pixel-Level Domain Adaptation: A New Perspective for Enhancing Weakly Supervised Semantic Segmentation4 Aug 2024
- 2024Quality-aware Selective Fusion Network for V-D-T Salient Object Detection13 May 2024
- 2024Enhancing Weakly Supervised Semantic Segmentation with Multi-modal Foundation Models: An End-to-End Approach10 May 2024
- 2024Auxiliary Tasks Enhanced Dual-affinity Learning for Weakly Supervised Semantic Segmentation2 Mar 2024
- 2024Discriminative Consensus Mining with A Thousand Groups for More Accurate Co-Salient Object Detection15 Jan 2024
- 2023Weakly-Supervised Semantic Segmentation with Image-Level Labels: from Traditional Models to Foundation Models19 Oct 2023
38 more
- 2023Towards Open-World Co-Salient Object Detection with Generative Uncertainty-aware Group Selective Exchange-Masking16 Oct 2023
- 2023Beyond Discriminative Regions: Saliency Maps as Alternatives to CAMs for Weakly Supervised Semantic Segmentation21 Aug 2023
- 2023Interaction-aware Joint Attention Estimation Using People Attributes10 Aug 2023
- 2023Joint Salient Object Detection and Camouflaged Object Detection via Uncertainty-aware Learning10 Jul 2023
- 2023A Self-Training Framework Based on Multi-Scale Attention Fusion for Weakly Supervised Semantic Segmentation10 May 2023
- 2023Advances in Deep Concealed Scene Understanding21 Apr 2023
- 2023Coupling Global Context and Local Contents for Weakly-Supervised Semantic Segmentation18 Apr 2023
- 2023Sketch2Saliency: Learning to Detect Salient Objects from Human Drawings20 Mar 2023
- 2023MECPformer: Multi-estimations Complementary Patch with CNN-Transformers for Weakly Supervised Semantic Segmentation19 Mar 2023
- 2023SILOP: An Automated Framework for Semantic Segmentation Using Image Labels Based on Object Perimeters14 Mar 2023
- 2023Co-Salient Object Detection with Co-Representation Purification14 Mar 2023
- 2023Memory-aided Contrastive Consensus Learning for Co-salient Object Detection28 Feb 2023
- 2023Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspective3 Feb 2023
- 2022Mine yOur owN Anatomy: Revisiting Medical Image Segmentation with Extremely Limited Labels27 Sep 2022
- 2022Panoramic Vision Transformer for Saliency Detection in 360deg Videos19 Sep 2022
- 2022Weakly Supervised Faster-RCNN+FPN to classify animals in camera trap images30 Aug 2022
- 2022Saliency Guided Inter- and Intra-Class Relation Constraints for Weakly Supervised Semantic Segmentation20 Jun 2022
- 2022Online Easy Example Mining for Weakly-supervised Gland Segmentation from Histology Images14 Jun 2022
- 2022GCoNet+: A Stronger Group Collaborative Co-Salient Object Detector30 May 2022
- 2022Weakly-supervised segmentation of referring expressions10 May 2022
- 2022Automatic segmentation of meniscus based on MAE self-supervision and point-line weak supervision paradigm7 May 2022
- 2022Threshold Matters in WSSS: Manipulating the Activation for the Robust and Accurate Segmentation Model Against Thresholds30 Mar 2022
- 2022Regional Semantic Contrast and Aggregation for Weakly Supervised Semantic Segmentation17 Mar 2022
- 2022Class-Aware Adversarial Transformers for Medical Image Segmentation26 Jan 2022
- 2021GETAM: Gradient-weighted Element-wise Transformer Attention Map for Weakly-supervised Semantic segmentation6 Dec 2021
- 2021Unsupervised Foreground Extraction via Deep Region Competition29 Oct 2021
- 2021Generalized Multi-Task Learning from Substantially Unlabeled Multi-Source Medical Image Data25 Oct 2021
- 2021Simpler Does It: Generating Semantic Labels with Objectness Guidance20 Oct 2021
- 2021Weakly Supervised Semantic Segmentation by Pixel-to-Prototype Contrast14 Oct 2021
- 2021Maximize the Exploration of Congeneric Semantics for Weakly Supervised Semantic Segmentation8 Oct 2021
- 2021Pseudo-mask Matters in Weakly-supervised Semantic Segmentation30 Aug 2021
- 2021Multi-scale Edge-based U-shape Network for Salient Object Detection21 Aug 2021
- 2021Cross-Image Region Mining with Region Prototypical Network for Weakly Supervised Segmentation17 Aug 2021
- 2021Weakly Supervised Foreground Learning for Weakly Supervised Localization and Detection3 Aug 2021
- 2021Adaptive Affinity Loss and Erroneous Pseudo-Label Refinement for Weakly Supervised Semantic Segmentation3 Aug 2021
- 2021Leveraging Auxiliary Tasks with Affinity Learning for Weakly Supervised Semantic Segmentation25 Jul 2021
- 2021Large-scale Unsupervised Semantic Segmentation6 Jun 2021
- 2021Railroad is not a Train: Saliency as Pseudo-pixel Supervision for Weakly Supervised Semantic Segmentation19 May 2021
50 newest of 57 All 57 (JSON)
- 2021Salient Object Detection via Integrity Learningcited by 133
- 2021Railroad is not a Train: Saliency as Pseudo-pixel Supervision for Weakly Supervised Semantic Segmentationcited by 127
- 2021Uncertainty-aware Joint Salient Object and Camouflaged Object Detectioncited by 114
- 2021Large-scale Unsupervised Semantic Segmentationcited by 99
- 2021Weakly Supervised Semantic Segmentation by Pixel-to-Prototype Contrastcited by 85
- 2021Leveraging Auxiliary Tasks with Affinity Learning for Weakly Supervised Semantic Segmentationcited by 77
- 2022Regional Semantic Contrast and Aggregation for Weakly Supervised Semantic Segmentationcited by 64
- 2021Pseudo-mask Matters in Weakly-supervised Semantic Segmentationcited by 48
- 2023Advances in Deep Concealed Scene Understandingcited by 47
- 2023Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspectivecited by 43
- 2021Background-Aware Pooling and Noise-Aware Loss for Weakly-Supervised Semantic Segmentationcited by 41
- 2022Threshold Matters in WSSS: Manipulating the Activation for the Robust and Accurate Segmentation Model Against Thresholdscited by 37
12 most cited of 56 All 56 (JSON)
- 2026ViASNet: A Video Ad Saliency Network for Predicting Dynamic Saliency and Viewer Engagement28 May 2026
- 2025Deep semi-supervised approach based on consistency regularization and similarity learning for weeds classification12 Oct 2025
- 2025SIGN: A Statistically-Informed Gaze Network for Gaze Time Prediction29 Jan 2025
- 2025Generalized Task-Driven Medical Image Quality Enhancement with Gradient Promotion2 Jan 2025
- 2024Concept Guided Co-salient Object Detection21 Dec 2024
- 2024Multi-Task Label Discovery via Hierarchical Task Tokens for Partially Annotated Dense Predictions27 Nov 2024
- 2024Pixel-Level Domain Adaptation: A New Perspective for Enhancing Weakly Supervised Semantic Segmentation4 Aug 2024
- 2024Quality-aware Selective Fusion Network for V-D-T Salient Object Detection13 May 2024
- 2024Enhancing Weakly Supervised Semantic Segmentation with Multi-modal Foundation Models: An End-to-End Approach10 May 2024
- 2024Auxiliary Tasks Enhanced Dual-affinity Learning for Weakly Supervised Semantic Segmentation2 Mar 2024
- 2024Discriminative Consensus Mining with A Thousand Groups for More Accurate Co-Salient Object Detection15 Jan 2024
- 2023Weakly-Supervised Semantic Segmentation with Image-Level Labels: from Traditional Models to Foundation Models19 Oct 2023
12 newest of 56 All 56 (JSON)