SAM3-Adapter: Efficient Adaptation of Segment Anything 3 for Camouflage Object Segmentation, Shadow Detection, and Medical Image Segmentation
Not on the map. Why?
Abstract (arXiv)
The rapid rise of large-scale foundation models has reshaped the landscape of image segmentation, with models such as Segment Anything achieving unprecedented versatility across diverse vision tasks. However, previous generations-including SAM and its successor-still struggle with fine-grained, low-level segmentation challenges such as camouflaged object detection, medical image segmentation, cell image segmentation, and shadow detection. To address these limitations, we originally proposed SAM-Adapter in 2023, demonstrating substantial gains on these difficult scenarios. With the emergence of Segment Anything 3 (SAM3)-a more efficient and higher-performing evolution with a redesigned architecture and improved training pipeline-we revisit these long-standing challenges. In this work, we present SAM3-Adapter, the first adapter framework tailored for SAM3 that unlocks its full segmentation capability. SAM3-Adapter not only reduces computational overhead but also consistently surpasses both SAM and SAM2-based solutions, establishing new state-of-the-art results across multiple downstream tasks, including medical imaging, camouflaged (concealed) object segmentation, and shadow detection. Built upon the modular and composable design philosophy of the original SAM-Adapter, SAM3-Adapter provides stronger generalizability, richer task adaptability, and significantly improved segmentation precision. Extensive experiments confirm that integrating SAM3 with our adapter yields superior accuracy, robustness, and efficiency compared to all prior SAM-based adaptations. We hope SAM3-Adapter can serve as a foundation for future research and practical segmentation applications. Code, pre-trained models, and data processing pipelines are available.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 63 of its 95 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
63 of 95 references.
References · 63
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2023Segment Anythingcited by 8,234
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
38 more
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,487
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
- 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 724
- 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 589
- 2022Vision Transformer Adapter for Dense Predictionscited by 565
- 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 490
- 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 419
- 2023Faster Segment Anything: Towards Lightweight SAM for Mobile Applicationscited by 352
- 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
- 2021Anabranch Network for Camouflaged Object Segmentationcited by 227
- 2021Simultaneously Localize, Segment and Rank the Camouflaged Objectscited by 198
- 2019Asymmetric Non-local Neural Networks for Semantic Segmentationcited by 196
- 2023EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anythingcited by 188
- 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 181
- 2017Stacked Conditional Generative Adversarial Networks for Jointly Learning Shadow Detection and Shadow Removalcited by 161
- 2023Segment Anything Model (SAM) for Digital Pathology: Assess Zero-shot Segmentation on Whole Slide Imagingcited by 161
- 2022Panoptic NeRF: 3D-to-2D Label Transfer for Panoptic Urban Scene Segmentationcited by 152
- 2021Camouflaged Object Segmentation with Distraction Miningcited by 151
- 2024IBD: Alleviating Hallucinations in Large Vision-Language Models via Image-Biased Decodingcited by 118
- 2021Uncertainty-aware Joint Salient Object and Camouflaged Object Detectioncited by 114
- 2023Explicit Visual Prompting for Low-Level Structure Segmentationscited by 114
- 2019Towards Ghost-free Shadow Removal via Dual Hierarchical Aggregation Network and Shadow Matting GANcited by 103
- 2023Can SAM Segment Anything? When SAM Meets Camouflaged Object Detectioncited by 100
- 2019Rendering Synthetic Objects into Legacy Photographscited by 72
- 2024SAM2-Adapter: Evaluating & Adapting Segment Anything 2 in Downstream Tasks: Camouflage, Shadow, Medical Image Segmentation, and Morecited by 60
- 2017Direction-aware Spatial Context Features for Shadow Detectioncited by 56
- 2021Learning Statistical Texture for Semantic Segmentationcited by 51
- 2023LLaFS: When Large Language Models Meet Few-Shot Segmentationcited by 48
- 2020Class-wise Dynamic Graph Convolution for Semantic Segmentationcited by 44
- 2024Segment Anything in Medical Images and Videos: Benchmark and Deploymentcited by 42
- 2017A+D Net: Training a Shadow Detector with Adversarial Shadow Attenuationcited by 39
- 2023Continual Semantic Segmentation with Automatic Memory Sample Selectioncited by 39
- 2023The Multi-modality Cell Segmentation Challenge: Towards Universal Solutionscited by 39
- 2023Structural and Statistical Texture Knowledge Distillation for Semantic Segmentationcited by 36
- 2019Psi-Net: Shape and boundary aware joint multi-task deep network for medical image segmentationcited by 30
- 2023Ultra-High Resolution Segmentation with Ultra-Rich Context: A Novel Benchmarkcited by 22
- 2020Context-Aware Graph Convolution Network for Target Re-identificationcited by 21
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Refining Context-Entangled Content Segmentation via Curriculum Selection and Anti-Curriculum Promotioncited by 5
- 2026Semantic Manipulation Localizationcited by 1
- 2026B-GRTO: Bootstrapped Group Relative Tool Optimization for Referring Segmentationcited by 1
- 2026Is SAM3 ready for pathology segmentation?cited by 0
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipecited by 0
- 2026CoRe-SAM3: Conditional Semantic--Visual Reconciliation for SAM3 Crack Segmentationcited by 0
- 2026LeCor: Learning to Be Corrected by Meta-Learned Test-Time Training for Interactive 3D Lung-Tumour Segmentationcited by 0
- 2026LeCor: Learning to Be Corrected by Meta-Learned Test-Time Training for Interactive 3D Lung-Tumour Segmentation8 Sep 2026
- 2026CoRe-SAM3: Conditional Semantic--Visual Reconciliation for SAM3 Crack Segmentation5 Sep 2026
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe17 Jul 2026
- 2026B-GRTO: Bootstrapped Group Relative Tool Optimization for Referring Segmentation22 May 2026
- 2026Is SAM3 ready for pathology segmentation?20 Apr 2026
- 2026Semantic Manipulation Localization11 Apr 2026
- 2026Refining Context-Entangled Content Segmentation via Curriculum Selection and Anti-Curriculum Promotion1 Feb 2026