Phantom-Insight: Adaptive Multi-cue Fusion for Video Camouflaged Object Detection with Multimodal LLM
Not on the map. Why?
Abstract (arXiv)
Video camouflaged object detection (VCOD) is challenging due to dynamic environments. Existing methods face two main issues: (1) SAM-based methods struggle to separate camouflaged object edges due to model freezing, and (2) MLLM-based methods suffer from poor object separability as large language models merge foreground and background. To address these issues, we propose a novel VCOD method based on SAM and MLLM, called Phantom-Insight. To enhance the separability of object edge details, we represent video sequences with temporal and spatial clues and perform feature fusion via LLM to increase information density. Next, multiple cues are generated through the dynamic foreground visual token scoring module and the prompt network to adaptively guide and fine-tune the SAM model, enabling it to adapt to subtle textures. To enhance the separability of objects and background, we propose a decoupled foreground-background learning strategy. By generating foreground and background cues separately and performing decoupled training, the visual token can effectively integrate foreground and background information independently, enabling SAM to more accurately segment camouflaged objects in the video. Experiments on the MoCA-Mask dataset show that Phantom-Insight achieves state-of-the-art performance across various metrics. Additionally, its ability to detect unseen camouflaged objects on the CAD2016 dataset highlights its strong generalization ability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 30 references that are in the map. First posted on arXiv 8 Sep 2025.
Builds on
16 of 30 references.
References · 16
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2019Object Detection in 20 Years: A Surveycited by 531
- 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
- 2020PraNet: Parallel Reverse Attention Network for Polyp Segmentationcited by 460
- 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 455
- 2023PixelLM: Pixel Reasoning with Large Multimodal Modelcited by 222
- 2021Concealed Object Detectioncited by 212
- 2021Self-supervised Video Object Segmentation by Motion Groupingcited by 147
- 2023Feature Shrinkage Pyramid for Camouflaged Object Detection with Transformerscited by 87
- 2016It's Moving! A Probabilistic Model for Causal Motion Segmentation in Moving Camera Videoscited by 71
- 2020Betrayed by Motion: Camouflaged Object Discovery via Motion Segmentationcited by 62
4 more
- 2023Advances in Deep Concealed Scene Understandingcited by 47
- 2023Chain of Visual Perception: Harnessing Multimodal Large Language Models for Zero-shot Camouflaged Object Detectioncited by 22
- 2024SAM-PM: Enhancing Video Camouflaged Object Detection using Spatio-Temporal Attentioncited by 11
- 2019Search and Rescue in the Face of Uncertain Threatscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024When SAM2 Meets Video Camouflaged Object Segmentation: A Comprehensive Evaluation and Adaptation
- 2026LAD-COD: Language-Aligned Dense Perception for Camouflaged Object Detection
- 2025First RAG, Second SEG: A Training-Free Paradigm for Camouflaged Object Detection
- 2024SAM-COD: SAM-guided Unified Framework for Weakly-Supervised Camouflaged Object Detection
- 2026EReCu: Pseudo-label Evolution Fusion and Refinement with Multi-Cue Learning for Unsupervised Camouflage Detection
- 2023Large Model Based Referring Camouflaged Object Detection
- 2023CamDiff: Camouflage Image Augmentation via Diffusion Model
- 2026Discover, Segment, and Select: A Progressive Mechanism for Zero-shot Camouflaged Object Segmentation