Modality-Agnostic Prompt Learning for Multi-Modal Camouflaged Object Detection
Not on the map. Why?
Abstract (arXiv)
Camouflaged Object Detection (COD) aims to segment objects that blend seamlessly into complex backgrounds, with growing interest in exploiting additional visual modalities to enhance robustness through complementary information. However, most existing approaches generally rely on modality-specific architectures or customized fusion strategies, which limit scalability and cross-modal generalization. To address this, we propose a novel framework that generates modality-agnostic multi-modal prompts for the Segment Anything Model (SAM), enabling parameter-efficient adaptation to arbitrary auxiliary modalities and significantly improving overall performance on COD tasks. Specifically, we model multi-modal learning through interactions between a data-driven content domain and a knowledge-driven prompt domain, distilling task-relevant cues into unified prompts for SAM decoding. We further introduce a lightweight Mask Refine Module to calibrate coarse predictions by incorporating fine-grained prompt cues, leading to more accurate camouflaged object boundaries. Extensive experiments on RGB-Depth, RGB-Thermal, and RGB-Polarization benchmarks validate the effectiveness and generalization of our modality-agnostic framework.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 52 references that are in the map. First posted on arXiv 14 Apr 2026.
Builds on
33 of 52 references.
References · 33
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Segment Anythingcited by 8,158
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2023Segment Anything in High Qualitycited by 373
- 2021Camouflaged Object Segmentation with Distraction Miningcited by 151
- 2022Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detectioncited by 145
- 2023Explicit Visual Prompting for Low-Level Structure Segmentationscited by 113
- 2023Feature Shrinkage Pyramid for Camouflaged Object Detection with Transformerscited by 87
- 2022High-resolution Iterative Feedback Network for Camouflaged Object Detectioncited by 78
- 2021Specificity-preserving RGB-D Saliency Detectioncited by 70
- 2022Boundary-Guided Camouflaged Object Detectioncited by 68
21 more
- 2024SAM2-UNet: Segment Anything 2 Makes Strong Encoder for Natural and Medical Image Segmentationcited by 63
- 2023VSCode: General Visual Salient and Camouflaged Object Detection with 2D Prompt Learningcited by 58
- 2024SAM2-Adapter: Evaluating & Adapting Segment Anything 2 in Downstream Tasks: Camouflage, Shadow, Medical Image Segmentation, and Morecited by 58
- 2022Source-free Depth for Object Pop-outcited by 52
- 2023ZoomNeXt: A Unified Collaborative Pyramid Network for Camouflaged Object Detectioncited by 48
- 2024Frequency-Spatial Entanglement Learning for Camouflaged Object Detectioncited by 46
- 2023Relax Image-Specific Prompt Requirement in SAM: A Single Generic Prompt for Segmenting Camouflaged Objectscited by 40
- 2023Frequency Perception Network for Camouflaged Object Detectioncited by 37
- 2023HRTransNet: HRFormer-Driven Two-Modality Salient Object Detectioncited by 27
- 2022SPSN: Superpixel Prototype Sampling Network for RGB-D Salient Object Detectioncited by 26
- 2024Alignment-Free RGBT Salient Object Detection: Semantics-guided Asymmetric Correlation Network and A Unified Benchmarkcited by 19
- 2024Hierarchical Graph Interaction Transformer with Dynamic Token Clustering for Camouflaged Object Detectioncited by 18
- 2024FocusDiffuser: Perceiving Local Disparities for Camouflaged Object Detectioncited by 14
- 2025Improving SAM for Camouflaged Object Detection via Dual Stream Adapterscited by 13
- 2025FOCUS: Towards Universal Foreground Segmentationcited by 10
- 2023Unified-modal Salient Object Detection via Adaptive Prompt Learningcited by 9
- 2024Alignment-Free RGB-T Salient Object Detection: A Large-scale Dataset and Progressive Correlation Networkcited by 9
- 2024PlantCamo: Plant Camouflage Detectioncited by 5
- 2025ST-SAM: SAM-Driven Self-Training Framework for Semi-Supervised Camouflaged Object Detectioncited by 4
- 2025SAM-TTT: Segment Anything Model via Reverse Parameter Configuration and Test-Time Training for Camouflaged Object Detectioncited by 3
- 2026Boosting Segment Anything Model to Generalize Visually Non-Salient Scenarioscited by 3
Built on by
Not cited yet.