Integrating Extra Modality Helps Segmentor Find Camouflaged Objects Well
Not on the map. Why?
Abstract (arXiv)
Camouflaged Object Segmentation (COS) remains challenging because camouflaged objects exhibit only subtle visual differences from their backgrounds and single-modality RGB methods provide limited cues, leading researchers to explore multimodal data to improve segmentation accuracy. In this work, we presenet MultiCOS, a novel framework that effectively leverages diverse data modalities to improve segmentation performance. MultiCOS comprises two modules: Bi-space Fusion Segmentor (BFSer), which employs a state space and a latent space fusion mechanism to integrate cross-modal features within a shared representation and employs a fusion-feedback mechanism to refine context-specific features, and Cross-modal Knowledge Learner (CKLer), which leverages external multimodal datasets to generate pseudo-modal inputs and establish cross-modal semantic associations, transferring knowledge to COS models when real multimodal pairs are missing. When real multimodal COS data are unavailable, CKLer yields additional segmentation gains using only non-COS multimodal sources. Experiments on standard COS benchmarks show that BFSer outperforms existing multimodal baselines with both real and pseudo-modal data. Code will be released at hrefhttps://github.com/cnyvfang/MultiCOSGitHub.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 47 of its 67 references that are in the map. First posted on arXiv 20 Feb 2025.
Builds on
47 of 67 references.
References · 47
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 751
- 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 352
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 317
- 2024SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentationcited by 266
- 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 231
- 2021Anabranch Network for Camouflaged Object Segmentationcited by 227
- 2021Concealed Object Detectioncited by 212
- 2024Taming Rectified Flow for Inversion and Editingcited by 204
- 2021Simultaneously Localize, Segment and Rank the Camouflaged Objectscited by 198
35 more
- 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 153
- 2022Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detectioncited by 145
- 2024Mamba-UNet: UNet-Like Pure Visual Mamba for Medical Image Segmentationcited by 133
- 2024FusionMamba: Dynamic Feature Enhancement for Multimodal Image Fusion with Mambacited by 81
- 2022High-resolution Iterative Feedback Network for Camouflaged Object Detectioncited by 78
- 2024State Space Models for Event Camerascited by 75
- 2024Diffusion Models in Low-Level Vision: A Surveycited by 74
- 2021Specificity-preserving RGB-D Saliency Detectioncited by 70
- 2023Reti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Modelcited by 69
- 2022Implicit Motion Handling for Video Camouflaged Object Detectioncited by 60
- 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editingcited by 59
- 2023Strategic Preys Make Acute Predators: Enhancing Camouflaged Object Detectors by Generating Camouflaged Objectscited by 56
- 2022Source-free Depth for Object Pop-outcited by 52
- 2021RGB-D Saliency Detection via Cascaded Mutual Information Minimizationcited by 50
- 2023ZoomNeXt: A Unified Collaborative Pyramid Network for Camouflaged Object Detectioncited by 48
- 2024Frequency-Spatial Entanglement Learning for Camouflaged Object Detectioncited by 46
- 2024MultiBooth: Towards Generating All Your Concepts in an Image from Textcited by 45
- 2021Fast Camouflaged Object Detection via Edge-based Reversible Re-calibration Networkcited by 42
- 2024U-shaped Vision Mamba for Single Image Dehazingcited by 40
- 2024A Survey of Camouflaged Object Detection and Beyondcited by 37
- 2024MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusioncited by 35
- 2021Cross-modality Discrepant Interaction Network for RGB-D Salient Object Detectioncited by 34
- 2024InstantSwap: Fast Customized Concept Swapping across Sharp Shape Differencescited by 34
- 2024FourierMamba: Fourier Learning Integration with State Space Models for Image Derainingcited by 33
- 2022Camouflaged Object Detection via Context-aware Cross-level Fusioncited by 32
- 2022OSFormer: One-Stage Camouflaged Instance Segmentation with Transformerscited by 30
- 2022SPSN: Superpixel Prototype Sampling Network for RGB-D Salient Object Detectioncited by 26
- 2024Real-world Image Dehazing with Coherence-based Pseudo Labeling and Cooperative Unfolding Networkcited by 26
- 2024Exploring Deeper! Segment Anything Model with Depth Perception for Camouflaged Object Detectioncited by 20
- 2022Is my Depth Ground-Truth Good Enough? HAMMER -- Highly Accurate Multi-Modal Dataset for DEnse 3D Scene Regressioncited by 19
- 2021Exploring Depth Contribution for Camouflaged Object Detectioncited by 14
- 2024FD-Vision Mamba for Endoscopic Exposure Correctioncited by 13
- 2024A Unified Framework for Microscopy Defocus Deblur with Multi-Pyramid Transformer and Contrastive Learningcited by 13
- 2022Joint Geometric-Semantic Driven Character Line Drawing Generationcited by 4
- 2024Learning Adaptive Lighting via Channel-Aware Guidancecited by 4
Built on by
Citing papers per year: 2025: 5; 2026: 9.
14 papers.
Sort:
By area:
- 2025Stochastic Self-Guidance for Training-Free Enhancement of Diffusion Modelscited by 36
- 2025Reversible Unfolding Network for Concealed Visual Perception with Generative Refinementcited by 11
- 2026UniFusion: A Unified Image Fusion Framework with Robust Representation and Source-Aware Preservationcited by 6
- 2026Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Modelscited by 6
- 2026Refining Context-Entangled Content Segmentation via Curriculum Selection and Anti-Curriculum Promotioncited by 5
- 2026Embedding-perturbed Exploration Preference Optimization for Flow Modelscited by 5
- 2025Segment Concealed Objects with Incomplete Supervisioncited by 4
- 2025Uncertainty-Masked Bernoulli Diffusion for Camouflaged Object Detection Refinementcited by 4
- 2026Bridging Human Evaluation to Infrared and Visible Image Fusioncited by 4
- 2025Exploiting Discriminative Codebook Prior for Autoregressive Image Generationcited by 2
- 2026Toward Real-world Infrared Image Super-Resolution: A Unified Autoregressive Framework and Benchmark Datasetcited by 2
- 2026Unpaired Image Deraining Using Reward-Guided Self-Reinforcement Strategycited by 2
- 2026Embedding-perturbed Exploration Preference Optimization for Flow Models15 May 2026
- 2026Unpaired Image Deraining Using Reward-Guided Self-Reinforcement Strategy1 May 2026
- 2026Modality-Specific Hierarchical Enhancement for RGB-D Camouflaged Object Detection3 Apr 2026
- 2026Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Models26 Mar 2026
- 2026UniFusion: A Unified Image Fusion Framework with Robust Representation and Source-Aware Preservation15 Mar 2026
- 2026MoKus: Leveraging Cross-Modal Knowledge Transfer for Knowledge-Aware Concept Customization13 Mar 2026
- 2026Toward Real-world Infrared Image Super-Resolution: A Unified Autoregressive Framework and Benchmark Dataset5 Mar 2026
- 2026Bridging Human Evaluation to Infrared and Visible Image Fusion4 Mar 2026
- 2026Refining Context-Entangled Content Segmentation via Curriculum Selection and Anti-Curriculum Promotion1 Feb 2026
- 2025Reversible Unfolding Network for Concealed Visual Perception with Generative Refinement20 Aug 2025
- 2025Stochastic Self-Guidance for Training-Free Enhancement of Diffusion Models18 Aug 2025
- 2025Exploiting Discriminative Codebook Prior for Autoregressive Image Generation14 Aug 2025
2 more
- 2026UniFusion: A Unified Image Fusion Framework with Robust Representation and Source-Aware Preservationcited by 6
- 2026Refining Context-Entangled Content Segmentation via Curriculum Selection and Anti-Curriculum Promotioncited by 5
- 2025Segment Concealed Objects with Incomplete Supervisioncited by 4
- 2025Uncertainty-Masked Bernoulli Diffusion for Camouflaged Object Detection Refinementcited by 4
- 2026Bridging Human Evaluation to Infrared and Visible Image Fusioncited by 4
- 2025Exploiting Discriminative Codebook Prior for Autoregressive Image Generationcited by 2
- 2026Toward Real-world Infrared Image Super-Resolution: A Unified Autoregressive Framework and Benchmark Datasetcited by 2
- 2026Unpaired Image Deraining Using Reward-Guided Self-Reinforcement Strategycited by 2
- 2026MoKus: Leveraging Cross-Modal Knowledge Transfer for Knowledge-Aware Concept Customizationcited by 1
- 2026Modality-Specific Hierarchical Enhancement for RGB-D Camouflaged Object Detectioncited by 0
- 2026Unpaired Image Deraining Using Reward-Guided Self-Reinforcement Strategy1 May 2026
- 2026Modality-Specific Hierarchical Enhancement for RGB-D Camouflaged Object Detection3 Apr 2026
- 2026UniFusion: A Unified Image Fusion Framework with Robust Representation and Source-Aware Preservation15 Mar 2026
- 2026MoKus: Leveraging Cross-Modal Knowledge Transfer for Knowledge-Aware Concept Customization13 Mar 2026
- 2026Toward Real-world Infrared Image Super-Resolution: A Unified Autoregressive Framework and Benchmark Dataset5 Mar 2026
- 2026Bridging Human Evaluation to Infrared and Visible Image Fusion4 Mar 2026
- 2026Refining Context-Entangled Content Segmentation via Curriculum Selection and Anti-Curriculum Promotion1 Feb 2026
- 2025Exploiting Discriminative Codebook Prior for Autoregressive Image Generation14 Aug 2025
- 2025Uncertainty-Masked Bernoulli Diffusion for Camouflaged Object Detection Refinement12 Jun 2025
- 2025Segment Concealed Objects with Incomplete Supervision10 Jun 2025