mlsanityData to 14 Oct 2026

SAM3-Adapter: Efficient Adaptation of Segment Anything 3 for Camouflage Object Segmentation, Shadow Detection, and Medical Image Segmentation

arXiv 2511.19425 ↗First posted 24 Nov 2025cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

The rapid rise of large-scale foundation models has reshaped the landscape of image segmentation, with models such as Segment Anything achieving unprecedented versatility across diverse vision tasks. However, previous generations-including SAM and its successor-still struggle with fine-grained, low-level segmentation challenges such as camouflaged object detection, medical image segmentation, cell image segmentation, and shadow detection. To address these limitations, we originally proposed SAM-Adapter in 2023, demonstrating substantial gains on these difficult scenarios. With the emergence of Segment Anything 3 (SAM3)-a more efficient and higher-performing evolution with a redesigned architecture and improved training pipeline-we revisit these long-standing challenges. In this work, we present SAM3-Adapter, the first adapter framework tailored for SAM3 that unlocks its full segmentation capability. SAM3-Adapter not only reduces computational overhead but also consistently surpasses both SAM and SAM2-based solutions, establishing new state-of-the-art results across multiple downstream tasks, including medical imaging, camouflaged (concealed) object segmentation, and shadow detection. Built upon the modular and composable design philosophy of the original SAM-Adapter, SAM3-Adapter provides stronger generalizability, richer task adaptability, and significantly improved segmentation precision. Extensive experiments confirm that integrating SAM3 with our adapter yields superior accuracy, robustness, and efficiency compared to all prior SAM-based adaptations. We hope SAM3-Adapter can serve as a foundation for future research and practical segmentation applications. Code, pre-trained models, and data processing pipelines are available.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 63 of its 95 references that are in the map. First posted on arXiv 24 Nov 2025.

Builds on

63 of 95 references.

References · 63

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2023Segment Anythingcited by 8,234
  4. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  5. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  6. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  7. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  8. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  9. 2016Pyramid Scene Parsing Networkcited by 2,479
  10. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  11. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
  12. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
38 more
  1. 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,487
  2. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
  3. 2021Segmenter: Transformer for Semantic Segmentationcited by 855
  4. 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 724
  5. 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 589
  6. 2022Vision Transformer Adapter for Dense Predictionscited by 565
  7. 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 490
  8. 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 419
  9. 2023Faster Segment Anything: Towards Lightweight SAM for Mobile Applicationscited by 352
  10. 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
  11. 2021Anabranch Network for Camouflaged Object Segmentationcited by 227
  12. 2021Simultaneously Localize, Segment and Rank the Camouflaged Objectscited by 198
  13. 2019Asymmetric Non-local Neural Networks for Semantic Segmentationcited by 196
  14. 2023EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anythingcited by 188
  15. 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 181
  16. 2017Stacked Conditional Generative Adversarial Networks for Jointly Learning Shadow Detection and Shadow Removalcited by 161
  17. 2023Segment Anything Model (SAM) for Digital Pathology: Assess Zero-shot Segmentation on Whole Slide Imagingcited by 161
  18. 2022Panoptic NeRF: 3D-to-2D Label Transfer for Panoptic Urban Scene Segmentationcited by 152
  19. 2021Camouflaged Object Segmentation with Distraction Miningcited by 151
  20. 2024IBD: Alleviating Hallucinations in Large Vision-Language Models via Image-Biased Decodingcited by 118
  21. 2021Uncertainty-aware Joint Salient Object and Camouflaged Object Detectioncited by 114
  22. 2023Explicit Visual Prompting for Low-Level Structure Segmentationscited by 114
  23. 2019Towards Ghost-free Shadow Removal via Dual Hierarchical Aggregation Network and Shadow Matting GANcited by 103
  24. 2023Can SAM Segment Anything? When SAM Meets Camouflaged Object Detectioncited by 100
  25. 2019Rendering Synthetic Objects into Legacy Photographscited by 72
  26. 2024SAM2-Adapter: Evaluating & Adapting Segment Anything 2 in Downstream Tasks: Camouflage, Shadow, Medical Image Segmentation, and Morecited by 60
  27. 2017Direction-aware Spatial Context Features for Shadow Detectioncited by 56
  28. 2021Learning Statistical Texture for Semantic Segmentationcited by 51
  29. 2023LLaFS: When Large Language Models Meet Few-Shot Segmentationcited by 48
  30. 2020Class-wise Dynamic Graph Convolution for Semantic Segmentationcited by 44
  31. 2024Segment Anything in Medical Images and Videos: Benchmark and Deploymentcited by 42
  32. 2017A+D Net: Training a Shadow Detector with Adversarial Shadow Attenuationcited by 39
  33. 2023Continual Semantic Segmentation with Automatic Memory Sample Selectioncited by 39
  34. 2023The Multi-modality Cell Segmentation Challenge: Towards Universal Solutionscited by 39
  35. 2023Structural and Statistical Texture Knowledge Distillation for Semantic Segmentationcited by 36
  36. 2019Psi-Net: Shape and boundary aware joint multi-task deep network for medical image segmentationcited by 30
  37. 2023Ultra-High Resolution Segmentation with Ultra-Rich Context: A Novel Benchmarkcited by 22
  38. 2020Context-Aware Graph Convolution Network for Target Re-identificationcited by 21

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.