mlsanityData to 7 Oct 2026

Unified-modal Salient Object Detection via Adaptive Prompt Learning

arXiv 2311.16835 ↗First posted 28 Nov 2023cs.CVcited by 9

Not on the map. Why?

Abstract (arXiv)

Existing single-modal and multi-modal salient object detection (SOD) methods focus on designing specific architectures tailored for their respective tasks. However, developing completely different models for different tasks leads to labor and time consumption, as well as high computational and practical deployment costs. In this paper, we attempt to address both single-modal and multi-modal SOD in a unified framework called UniSOD, which fully exploits the overlapping prior knowledge between different tasks. Nevertheless, assigning appropriate strategies to modality variable inputs is challenging. To this end, UniSOD learns modality-aware prompts with task-specific hints through adaptive prompt learning, which are plugged into the proposed pre-trained baseline SOD model to handle corresponding tasks, while only requiring few learnable parameters compared to training the entire model. Each modality-aware prompt is generated from a switchable prompt generation block, which adaptively performs structural switching based on single-modal and multi-modal inputs without human intervention. Through end-to-end joint training, UniSOD achieves overall performance improvement on 14 benchmark datasets for RGB, RGB-D, and RGB-T SOD, which demonstrates that our method effectively and efficiently unifies single-modal and multi-modal SOD tasks.The code and results are available at https://github.com/Angknpng/UniSOD.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 68 of its 144 references that are in the map. First posted on arXiv 28 Nov 2023.

Builds on

68 of 144 references.

References · 68

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  7. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
  8. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  9. 2022Visual Prompt Tuningcited by 1,674
  10. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
  11. 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 657
  12. 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
38 more
  1. 2019Res2Net: A New Multi-scale Backbone Architecturecited by 468
  2. 2018Enhanced-alignment Measure for Binary Foreground Map Evaluationcited by 370
  3. 2019EGNet:Edge Guidance Network for Salient Object Detectioncited by 237
  4. 2019Cascaded Partial Decoder for Fast and Accurate Salient Object Detectioncited by 216
  5. 2020Multi-scale Interactive Network for Salient Object Detectioncited by 212
  6. 2019A Simple Pooling-Based Design for Real-Time Salient Object Detectioncited by 211
  7. 2014The Secrets of Salient Object Segmentationcited by 200
  8. 2021Simultaneously Localize, Segment and Rank the Camouflaged Objectscited by 198
  9. 2015Visual Saliency Based on Multiscale Deep Featurescited by 185
  10. 2021Visual Saliency Transformercited by 175
  11. 2019Salient Object Detection in the Deep Learning Era: An In-Depth Surveycited by 163
  12. 2018Depth Prediction Without the Sensors: Leveraging Structure for Unsupervised Learning from Monocular Videoscited by 155
  13. 2023Visual Prompt Multi-Modal Trackingcited by 141
  14. 2019Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarkscited by 133
  15. 2021Salient Object Detection via Integrity Learningcited by 133
  16. 2020Suppress and Balance: A Simple Gated Network for Salient Object Detectioncited by 126
  17. 2023Multimodal Prompting with Missing Modalities for Visual Recognitioncited by 121
  18. 2021Uncertainty-aware Joint Salient Object and Camouflaged Object Detectioncited by 114
  19. 2020Label Decoupling Framework for Salient Object Detectioncited by 111
  20. 2020UC-Net: Uncertainty Inspired RGB-D Saliency Detection via Conditional Variational Autoencoderscited by 98
  21. 2020JL-DCF: Joint Learning and Densely-Cooperative Fusion Framework for RGB-D Salient Object Detectioncited by 79
  22. 2019Biometric Face Presentation Attack Detection with Multi-Channel Convolutional Neural Networkcited by 78
  23. 2021Specificity-preserving RGB-D Saliency Detectioncited by 70
  24. 2020RGBT Salient Object Detection: A Large-scale Dataset and Benchmarkcited by 69
  25. 2022LPT: Long-tailed Prompt Tuning for Image Classificationcited by 69
  26. 2020EDN: Salient Object Detection via Extremely-Downsampled Networkcited by 64
  27. 2022Pyramid Grafting Network for One-Stage High Resolution Saliency Detectioncited by 63
  28. 2022CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusioncited by 63
  29. 2022SwinNet: Swin Transformer drives edge-aware RGB-D and RGB-T salient object detectioncited by 59
  30. 2019RGB-T Image Saliency Detection via Collaborative Graph Learningcited by 58
  31. 2023VSCode: General Visual Salient and Camouflaged Object Detection with 2D Prompt Learningcited by 58
  32. 2022Visual Query Tuning: Towards Effective Usage of Intermediate Representations for Parameter and Memory Efficient Transfer Learningcited by 57
  33. 2020Uncertainty Inspired RGB-D Saliency Detectioncited by 56
  34. 2021Deep RGB-D Saliency Detection with Depth-Sensitive Attention and Automatic Multi-Modal Fusioncited by 56
  35. 2022Pro-tuning: Unified Prompt Tuning for Vision Taskscited by 53
  36. 2021CAVER: Cross-Modal View-Mixed Transformer for Bi-Modal Salient Object Detectioncited by 47
  37. 2020Multi-interactive Dual-decoder for RGB-thermal Salient Object Detectioncited by 44
  38. 2022CIR-Net: Cross-modality Interaction and Refinement for RGB-D Salient Object Detectioncited by 38

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 3; 2026: 4.

9 papers.

  1. 2024SSFam: Scribble Supervised Salient Object Detection Familycited by 6
  2. 2026DifferSeg: Towards Diverse Multimodal Binary Segmentation via Differential Perception and Frequency Guidancecited by 6
  3. 2024Unified Unsupervised Salient Object Detection via Knowledge Transfercited by 5
  4. 2025WXSOD: A Benchmark for Robust Salient Object Detection in Adverse Weather Conditionscited by 3
  5. 2025LSP-ST: Ladder Shape-Biased Side-Tuning for Robust Infrared Small Target Detectioncited by 0
  6. 2025Salient Object Detection in Complex Weather Conditions via Noise Indicatorscited by 0
  7. 2026Modality-Agnostic Prompt Learning for Multi-Modal Camouflaged Object Detectioncited by 0
  8. 2026VCP-DCN: Beyond Visual Concealed Property via Depth Collaborative Network for Camouflaged Object Detectioncited by 0
  9. 2026S2A:Semantic-to-Spatial Alignment for Alignment-Free RGB-T Salient Object Detectioncited by 0