SGP-SAM: Self-Gated Prompting for Transferring 3D Segment Anything Models to Lesion Segmentation
Not on the map. Why?
Abstract (arXiv)
Large segmentation foundation models such as the Segment Anything Model (SAM) have reshaped promptable segmentation in natural images, and recent efforts have extended these models to medical images and volumetric settings. However, directly transferring a 3D SAM-style model to lesion segmentation remains challenging due to (i) weak spatial representational capacity for small, irregular targets in intermediate features, and (ii) extreme foreground-background imbalance in 3D volumes.We propose SGP-SAM, a self-gated prompting framework for efficient and effective transfer to 3D lesion segmentation. Our key component, the Self-Gated Prompting Module (SGPM), performs conditional multi-scale spatial enhancement: a lightweight multi-channel gating unit predicts whether the current features require additional multi-scale fusion, and only then activates a Multi-Scale Feature Fusion Block to enrich spatial context. To further address small-lesion learning, we design a Zoom Loss that up-weights lesion-focused supervision by combining Dice and a voxel-balanced focal term.Experiments on MSD Liver Tumor and MSD Brain Tumor (enhancing tumor) show consistent gains over strong transfer baselines based on SAM-Med3D. On MSD Liver Tumor, SGP-SAM improves mDice by 7.3% over fine-tuning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 27 references that are in the map. First posted on arXiv 19 Apr 2026.
Builds on
15 of 27 references.
References · 15
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 830
- 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 509
- 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 490
- 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 373
- 2024Medical SAM 2: Segment medical images as video via Segment Anything Model 2cited by 154
- 2025MedSAM2: Segment Anything in 3D Medical Images and Videoscited by 96
- 2023SegVol: Universal and Interactive Volumetric Medical Image Segmentationcited by 87
- 20233DSAM-adapter: Holistic adaptation of SAM from 2D to 3D for promptable tumor segmentationcited by 70
3 more
- 2024VISTA3D: A Unified Segmentation Foundation Model For 3D Medical Imagingcited by 64
- 2024Learnable Prompting SAM-induced Knowledge Distillation for Semi-supervised Medical Image Segmentationcited by 23
- 2024S-SAM: SVD-based Fine-Tuning of Segment Anything Model for Medical Image Segmentationcited by 11
Built on by
Not cited yet.