Joint Salient Object Detection and Camouflaged Object Detection via Uncertainty-aware Learning
Not on the map. Why?
Abstract (arXiv)
Salient objects attract human attention and usually stand out clearly from their surroundings. In contrast, camouflaged objects share similar colors or textures with the environment. In this case, salient objects are typically non-camouflaged, and camouflaged objects are usually not salient. Due to this inherent contradictory attribute, we introduce an uncertainty-aware learning pipeline to extensively explore the contradictory information of salient object detection (SOD) and camouflaged object detection (COD) via data-level and task-wise contradiction modeling. We first exploit the dataset correlation of these two tasks and claim that the easy samples in the COD dataset can serve as hard samples for SOD to improve the robustness of the SOD model. Based on the assumption that these two models should lead to activation maps highlighting different regions of the same input image, we further introduce a contrastive module with a joint-task contrastive learning framework to explicitly model the contradictory attributes of these two tasks. Different from conventional intra-task contrastive learning for unsupervised representation learning, our contrastive module is designed to model the task-wise correlation, leading to cross-task representation learning. To better understand the two tasks from the perspective of uncertainty, we extensively investigate the uncertainty estimation techniques for modeling the main uncertainties of the two tasks, namely task uncertainty (for SOD) and data uncertainty (for COD), and aiming to effectively estimate the challenging regions for each task to achieve difficulty-aware learning. Experimental results on benchmark datasets demonstrate that our solution leads to both state-of-the-art performance and informative uncertainty estimation.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 63 of its 115 references that are in the map. First posted on arXiv 10 Jul 2023.
Builds on
63 of 115 references.
References · 63
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2020Supervised Contrastive Learningcited by 2,803
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,053
38 more
- 2016Deep Exploration via Bootstrapped DQNcited by 518
- 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
- 2019Symmetric Cross Entropy for Robust Learning with Noisy Labelscited by 499
- 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
- 2019Res2Net: A New Multi-scale Backbone Architecturecited by 468
- 2018Enhanced-alignment Measure for Binary Foreground Map Evaluationcited by 370
- 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
- 2020Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learningcited by 297
- 2019EGNet:Edge Guidance Network for Salient Object Detectioncited by 237
- 2021Anabranch Network for Camouflaged Object Segmentationcited by 227
- 2019Cascaded Partial Decoder for Fast and Accurate Salient Object Detectioncited by 216
- 2021Concealed Object Detectioncited by 212
- 2019A Simple Pooling-Based Design for Real-Time Salient Object Detectioncited by 211
- 2021DetCo: Unsupervised Contrastive Learning for Object Detectioncited by 205
- 2020Multi-task Collaborative Network for Joint Referring Expression Comprehension and Segmentationcited by 204
- 2014The Secrets of Salient Object Segmentationcited by 200
- 2021Simultaneously Localize, Segment and Rank the Camouflaged Objectscited by 198
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2015Visual Saliency Based on Multiscale Deep Featurescited by 185
- 2019F3Net: Fusion, Feedback and Focus for Salient Object Detectioncited by 176
- 2018Adversarial Learning for Semi-Supervised Semantic Segmentationcited by 173
- 2018Dimensionality-Driven Learning with Noisy Labelscited by 173
- 2021Camouflaged Object Segmentation with Distraction Miningcited by 151
- 2020Unsupervised Learning of Dense Visual Representationscited by 147
- 2022Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detectioncited by 145
- 2020Adversarial Camouflage: Hiding Physical-World Attacks with Natural Stylescited by 126
- 2020Suppress and Balance: A Simple Gated Network for Salient Object Detectioncited by 126
- 2021Uncertainty-aware Joint Salient Object and Camouflaged Object Detectioncited by 114
- 2020Label Decoupling Framework for Salient Object Detectioncited by 111
- 2021Mutual Graph Learning for Camouflaged Object Detectioncited by 103
- 2020UC-Net: Uncertainty Inspired RGB-D Saliency Detection via Conditional Variational Autoencoderscited by 98
- 2021Context-aware Cross-level Fusion Network for Camouflaged Object Detectioncited by 86
- 2020Highly Efficient Salient Object Detection with 100K Parameterscited by 79
- 2020EDN: Salient Object Detection via Extremely-Downsampled Networkcited by 64
- 2019Joint Learning of Saliency Detection and Weakly Supervised Semantic Segmentationcited by 57
- 2020Uncertainty Inspired RGB-D Saliency Detectioncited by 56
- 2017Not All Pixels Are Equal: Difficulty-aware Semantic Segmentation via Deep Layer Cascadecited by 53
- 2020Joint Semantic Segmentation and Boundary Detection using Iterative Pyramid Contextscited by 51
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 1.
3 papers.