Towards Better Ultrasound Video Segmentation Foundation Model: An Empirical study on SAM2 Finetuning from Data Perspective
Not on the map. Why?
Abstract (arXiv)
Ultrasound (US) video segmentation remains a challenging problem due to strong inter- and intra-dataset variability, motion artifacts, and limited annotated data. Although foundation models such as Segment Anything Model 2 (SAM2) demonstrate strong zero-shot and prompt-guided segmentation capabilities, their performance deteriorates substantially when transferred to medical imaging domains. Current adaptation studies mainly emphasize architectural modifications, while the influence of data characteristics and training regimes has not been systematically examined. In this study, we present a comprehensive, data-centric investigation of SAM2 adaptation for ultrasound video segmentation. We analyze how training-set size, video duration, and augmentation schemes affect adaptation performance under three paradigms: task-specific fine-tuning, intermediate adaptation, and multi-task joint training, across five SAM2 variants and multiple prompting modes. We further design six ultrasound-specific augmentations, assessing their effect relative to generic strategies. Experiments on three representative ultrasound datasets reveal that data scale and temporal context play a more decisive role than model architecture or initialization. Moreover, joint training offers an efficient compromise between modality alignment and task specialization. This work aims to provide empirical insights for developing efficient, data-aware adaptation pipelines for SAM2 in ultrasound video analysis.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 57 references that are in the map. First posted on arXiv 7 Nov 2025.
Builds on
39 of 57 references.
References · 39
- 2023Segment Anythingcited by 8,234
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2023Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistlescited by 290
- 2019Deep Learning for Segmentation using an Open Large-Scale Dataset in 2D Echocardiographycited by 244
- 2024Medical SAM 2: Segment medical images as video via Segment Anything Model 2cited by 154
- 2024SAM2-UNet: Segment Anything 2 Makes Strong Encoder for Natural and Medical Image Segmentationcited by 64
- 2024SAM2-Adapter: Evaluating & Adapting Segment Anything 2 in Downstream Tasks: Camouflage, Shadow, Medical Image Segmentation, and Morecited by 60
- 2024Segment Anything in Medical Images and Videos: Benchmark and Deploymentcited by 42
- 2024How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Modelcited by 32
- 2024Segment anything model 2: an application to 2D and 3D medical imagescited by 28
- 2024SAM 2 in Robotic Surgery: An Empirical Evaluation for Robustness and Generalization in Surgical Video Segmentationcited by 21
- 2024Efficient Track Anythingcited by 21
27 more
- 2024Retrieval-augmented Few-shot Medical Image Segmentation with Foundation Modelscited by 20
- 2024Interactive 3D Medical Image Segmentation with SAM 2cited by 17
- 2024Is SAM 2 Better than SAM in Medical Image Segmentation?cited by 16
- 2019Fetal Ultrasound Image Segmentation for Measuring Biometric Parameters Using Multi-Task Deep Learningcited by 13
- 2024Performance and Non-adversarial Robustness of the Segment Anything Model 2 in Surgical Video Segmentationcited by 13
- 2025SAM2 for Image and Video Segmentation: A Comprehensive Surveycited by 13
- 2025CRISP-SAM2: SAM2 with Cross-Modal Interaction and Semantic Prompting for Multi-Organ Segmentationcited by 12
- 2022Label-free segmentation from cardiac ultrasound using self-supervised learningcited by 8
- 2024Novel adaptation of video segmentation to 3D MRI: efficient zero-shot knee segmentation with SAM2cited by 8
- 2024Polyp SAM 2: Advancing Zero shot Polyp Segmentation in Colorectal Cancer Detectioncited by 8
- 2024Sam2Rad: A Segmentation Model for Medical Images with Learnable Promptscited by 6
- 2024Self-Prompting Polyp Segmentation in Colonoscopy using Hybrid Yolo-SAM 2 Modelcited by 6
- 2024A Short Review and Evaluation of SAM2's Performance in 3D CT Image Segmentationcited by 5
- 2025Few-Shot Adaptation of Training-Free Foundation Model for 3D Medical Image Segmentationcited by 5
- 2025Accelerating Volumetric Medical Image Annotation via Short-Long Memory SAM 2cited by 5
- 2024Path-SAM2: Transfer SAM2 for digital pathology semantic segmentationcited by 4
- 2025Rethinking Few-Shot Medical Image Segmentation by SAM2: A Training-Free Framework with Augmentative Prompting and Dynamic Matchingcited by 4
- 2024SAM & SAM 2 in 3D Slicer: SegmentWithSAM Extension for Annotating Medical Imagescited by 3
- 2024SAM-OCTA2: Layer Sequence OCTA Segmentation with Fine-tuned Segment Anything Model 2cited by 3
- 2025Clinical utility of foundation models in musculoskeletal MRI for biomarker fidelity and predictive outcomescited by 2
- 2025RFMedSAM 2: Automatic Prompt Refinement for Enhanced Volumetric Medical Image Segmentation with SAM 2cited by 2
- 2025Depthwise-Dilated Convolutional Adapters for Medical Object Tracking and Segmentation Using the Segment Anything Model 2cited by 2
- 2025Resolution scaling governs DINOv3 transfer performance in chest radiograph classificationcited by 2
- 2024SynStitch: a Self-Supervised Learning Network for Ultrasound Image Stitching Using Synthetic Training Pairs and Indirect Supervisioncited by 1
- 2025Proxy Prompt: Endowing SAM and SAM 2 with Auto-Interactive-Prompt for Medical Segmentationcited by 1
- 2025Advancements in Medical Image Classification through Fine-Tuning Natural Domain Foundation Modelscited by 1
- 2025SAM2-SGP: Enhancing SAM2 for Medical Image Segmentation via Support-Set Guided Promptingcited by 1
Built on by
Not cited yet.