mlsanityData to 7 Oct 2026

Joint Salient Object Detection and Camouflaged Object Detection via Uncertainty-aware Learning

arXiv 2307.04651 ↗First posted 10 Jul 2023cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Salient objects attract human attention and usually stand out clearly from their surroundings. In contrast, camouflaged objects share similar colors or textures with the environment. In this case, salient objects are typically non-camouflaged, and camouflaged objects are usually not salient. Due to this inherent contradictory attribute, we introduce an uncertainty-aware learning pipeline to extensively explore the contradictory information of salient object detection (SOD) and camouflaged object detection (COD) via data-level and task-wise contradiction modeling. We first exploit the dataset correlation of these two tasks and claim that the easy samples in the COD dataset can serve as hard samples for SOD to improve the robustness of the SOD model. Based on the assumption that these two models should lead to activation maps highlighting different regions of the same input image, we further introduce a contrastive module with a joint-task contrastive learning framework to explicitly model the contradictory attributes of these two tasks. Different from conventional intra-task contrastive learning for unsupervised representation learning, our contrastive module is designed to model the task-wise correlation, leading to cross-task representation learning. To better understand the two tasks from the perspective of uncertainty, we extensively investigate the uncertainty estimation techniques for modeling the main uncertainties of the two tasks, namely task uncertainty (for SOD) and data uncertainty (for COD), and aiming to effectively estimate the challenging regions for each task to achieve difficulty-aware learning. Experimental results on benchmark datasets demonstrate that our solution leads to both state-of-the-art performance and informative uncertainty estimation.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 63 of its 115 references that are in the map. First posted on arXiv 10 Jul 2023.

Builds on

63 of 115 references.

References · 63

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  4. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  5. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  6. 2020Supervised Contrastive Learningcited by 2,803
  7. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  8. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
  9. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  10. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  11. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  12. 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,053
38 more
  1. 2016Deep Exploration via Bootstrapped DQNcited by 518
  2. 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
  3. 2019Symmetric Cross Entropy for Robust Learning with Noisy Labelscited by 499
  4. 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
  5. 2019Res2Net: A New Multi-scale Backbone Architecturecited by 468
  6. 2018Enhanced-alignment Measure for Binary Foreground Map Evaluationcited by 370
  7. 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
  8. 2020Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learningcited by 297
  9. 2019EGNet:Edge Guidance Network for Salient Object Detectioncited by 237
  10. 2021Anabranch Network for Camouflaged Object Segmentationcited by 227
  11. 2019Cascaded Partial Decoder for Fast and Accurate Salient Object Detectioncited by 216
  12. 2021Concealed Object Detectioncited by 212
  13. 2019A Simple Pooling-Based Design for Real-Time Salient Object Detectioncited by 211
  14. 2021DetCo: Unsupervised Contrastive Learning for Object Detectioncited by 205
  15. 2020Multi-task Collaborative Network for Joint Referring Expression Comprehension and Segmentationcited by 204
  16. 2014The Secrets of Salient Object Segmentationcited by 200
  17. 2021Simultaneously Localize, Segment and Rank the Camouflaged Objectscited by 198
  18. 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
  19. 2015Visual Saliency Based on Multiscale Deep Featurescited by 185
  20. 2019F3Net: Fusion, Feedback and Focus for Salient Object Detectioncited by 176
  21. 2018Adversarial Learning for Semi-Supervised Semantic Segmentationcited by 173
  22. 2018Dimensionality-Driven Learning with Noisy Labelscited by 173
  23. 2021Camouflaged Object Segmentation with Distraction Miningcited by 151
  24. 2020Unsupervised Learning of Dense Visual Representationscited by 147
  25. 2022Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detectioncited by 145
  26. 2020Adversarial Camouflage: Hiding Physical-World Attacks with Natural Stylescited by 126
  27. 2020Suppress and Balance: A Simple Gated Network for Salient Object Detectioncited by 126
  28. 2021Uncertainty-aware Joint Salient Object and Camouflaged Object Detectioncited by 114
  29. 2020Label Decoupling Framework for Salient Object Detectioncited by 111
  30. 2021Mutual Graph Learning for Camouflaged Object Detectioncited by 103
  31. 2020UC-Net: Uncertainty Inspired RGB-D Saliency Detection via Conditional Variational Autoencoderscited by 98
  32. 2021Context-aware Cross-level Fusion Network for Camouflaged Object Detectioncited by 86
  33. 2020Highly Efficient Salient Object Detection with 100K Parameterscited by 79
  34. 2020EDN: Salient Object Detection via Extremely-Downsampled Networkcited by 64
  35. 2019Joint Learning of Saliency Detection and Weakly Supervised Semantic Segmentationcited by 57
  36. 2020Uncertainty Inspired RGB-D Saliency Detectioncited by 56
  37. 2017Not All Pixels Are Equal: Difficulty-aware Semantic Segmentation via Deep Layer Cascadecited by 53
  38. 2020Joint Semantic Segmentation and Boundary Detection using Iterative Pyramid Contextscited by 51

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 1.

3 papers.