mlsanityData to 7 Oct 2026

Dynamic Gradient Sparsification Training for Few-Shot Fine-tuning of CT Lymph Node Segmentation Foundation Model

arXiv 2503.00748 ↗First posted 2 Mar 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate lymph node (LN) segmentation is critical in radiotherapy treatment and prognosis analysis, but is limited by the need for large annotated datasets. While deep learning-based segmentation foundation models show potential in developing high-performing models with fewer samples, their medical adaptation faces LN domain-specific prior deficiencies and inefficient few-shot fine-tuning for complex clinical practices, highlighting the necessity of an LN segmentation foundation model. In this work, we annotated 36,106 visible LNs from 3,346 publicly available head-and-neck CT scans to establish a robust LN segmentation model (nnUNetv2). Building on this, we propose Dynamic Gradient Sparsification Training (DGST), a few-shot fine-tuning approach that preserves foundational knowledge while dynamically updating the most critical parameters of the LN segmentation model with few annotations. We validate it on two publicly available LN segmentation datasets: SegRap2023 and LNQ2023. The results show that DGST outperforms existing few-shot fine-tuning methods, achieving satisfactory performance with limited labeled data. We release the dataset, models and all implementations to facilitate relevant research: https://github.com/Zihaoluoh/LN-Seg-FM.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 27 references that are in the map. First posted on arXiv 2 Mar 2025.

Builds on

19 of 27 references.

References · 19

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023Segment Anythingcited by 8,158
  3. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  4. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
  5. 2022Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learningcited by 886
  6. 2019A Closer Look at Few-shot Classificationcited by 679
  7. 2024nnU-Net Revisited: A Call for Rigorous Validation in 3D Medical Image Segmentationcited by 235
  8. 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
  9. 2020AbdomenCT-1K: Is Abdominal Organ Segmentation A Solved Problem?cited by 222
  10. 2022On the Effectiveness of Parameter-Efficient Fine-Tuningcited by 140
  11. 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
  12. 2023Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluationcited by 134
7 more
  1. 2020Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNscited by 103
  2. 2023MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentationcited by 82
  3. 2023UniSeg: A Prompt-driven Universal Segmentation Model as well as A Strong Representation Learnercited by 46
  4. 2023Gradient-based Parameter Selection for Efficient Fine-Tuningcited by 40
  5. 2023SegRap2023: A Benchmark of Organs-at-Risk and Gross Tumor Volume Segmentation for Radiotherapy Planning of Nasopharyngeal Carcinomacited by 28
  6. 2024LNQ 2023 challenge: Benchmark of weakly-supervised techniques for mediastinal lymph node quantificationcited by 6
  7. 2024Effective Lymph Nodes Detection in CT Scans Using Location Debiased Query Selection and Contrastive Query Representation in Transformercited by 3

Built on by

Not cited yet.