mlsanityData to 14 Oct 2026

Distillation Learning Guided by Image Reconstruction for One-Shot Medical Image Segmentation

arXiv 2408.03616 ↗First posted 7 Aug 2024eess.IV cs.CVcited by 1

On the map: Knowledge distillation → Distillation for medical imaging

Abstract (arXiv)

Traditional one-shot medical image segmentation (MIS) methods use registration networks to propagate labels from a reference atlas or rely on comprehensive sampling strategies to generate synthetic labeled data for training. However, these methods often struggle with registration errors and low-quality synthetic images, leading to poor performance and generalization. To overcome this, we introduce a novel one-shot MIS framework based on knowledge distillation, which allows the network to directly 'see' real images through a distillation process guided by image reconstruction. It focuses on anatomical structures in a single labeled image and a few unlabeled ones. A registration-based data augmentation network creates realistic, labeled samples, while a feature distillation module helps the student network learn segmentation from these samples, guided by the teacher network. During inference, the streamlined student network accurately segments new images. Evaluations on three public datasets (OASIS for T1 brain MRI, BCV for abdomen CT, and VerSe for vertebrae CT) show superior segmentation performance and generalization across different medical image datasets and modalities compared to leading methods. Our code is available at https://github.com/NoviceFodder/OS-MedSeg.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Distillation for medical imaging, one of 12 directions in Knowledge distillation. Builds on 37 of its 56 references that are in the map. First posted on arXiv 7 Aug 2024.

Builds on

37 of 56 references.

References · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  4. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  5. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
  6. 2015Spatial Transformer Networkscited by 1,429
  7. 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 662
  8. 2020Image Segmentation Using Deep Learning: A Surveycited by 660
  9. 2021The Medical Segmentation Decathloncited by 628
  10. 2023Segment Everything Everywhere All at Oncecited by 548
  11. 2018Born Again Neural Networkscited by 546
  12. 2016RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentationcited by 465
25 more
  1. 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
  2. 2020Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentationcited by 300
  3. 2019ResUNet-a: a deep learning framework for semantic segmentation of remotely sensed datacited by 261
  4. 2019Unsupervised Learning of Probabilistic Diffeomorphic Registration for Images and Surfacescited by 186
  5. 2018An Unsupervised Learning Model for Deformable Medical Image Registrationcited by 150
  6. 2019Data augmentation using learned transformations for one-shot medical image segmentationcited by 138
  7. 2021Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learningcited by 125
  8. 2020VerSe: A Vertebrae Labelling and Segmentation Benchmark for Multi-detector CT Imagescited by 111
  9. 2018Snapshot Distillation: Teacher-Student Optimization in One Generationcited by 99
  10. 2020Unpaired Multi-modal Segmentation via Knowledge Distillationcited by 81
  11. 2018Collaborative Learning for Deep Neural Networkscited by 69
  12. 2019DeepAtlas: Joint Semi-Supervised Learning of Image Registration and Segmentationcited by 66
  13. 2019Unsupervised 3D End-to-End Medical Image Registration with Volume Tweening Networkcited by 62
  14. 2014Multi-Atlas Segmentation of Biomedical Images: A Surveycited by 56
  15. 2019Dual-Stream Pyramid Registration Networkcited by 52
  16. 2020Towards Cross-modality Medical Image Segmentation with Online Mutual Knowledge Distillationcited by 38
  17. 2022Learning the Effect of Registration Hyperparameters with HyperMorphcited by 35
  18. 2020LT-Net: Label Transfer by Learning Reversible Voxel-wise Correspondence for One-shot Medical Image Segmentationcited by 28
  19. 2021Joint Progressive and Coarse-to-fine Registration of Brain MRI via Deformation Field Integration and Non-Rigid Feature Fusioncited by 22
  20. 2020Contrastive Registration for Unsupervised Medical Image Segmentationcited by 19
  21. 2020Deep Complementary Joint Model for Complex Scene Registration and Few-shot Segmentation on Medical Imagescited by 17
  22. 2021Modeling the Probabilistic Distribution of Unlabeled Data forOne-shot Medical Image Segmentationcited by 17
  23. 2021Self-Supervised Generative Style Transfer for One-Shot Medical Image Segmentationcited by 10
  24. 2022One shot PACS: Patient specific Anatomic Context and Shape prior aware recurrent registration-segmentation of longitudinal thoracic cone beam CTscited by 8
  25. 20203D deformable registration of longitudinal abdominopelvic CT images using unsupervised deep learningcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2021Efficient Medical Image Segmentation Based on Knowledge Distillation
  2. 2024Multi-Task Multi-Scale Contrastive Knowledge Distillation for Efficient Medical Image Segmentation
  3. 2024Shape-intensity knowledge distillation for robust medical image segmentation
  4. 2021Knowledge distillation from multi-modal to mono-modal segmentation networks
  5. 2024Adaptive Affinity-Based Generalization For MRI Imaging Segmentation Across Resource-Limited Settings
  6. 2025Task-Specific Knowledge Distillation from the Vision Foundation Model for Enhanced Medical Image Segmentation
  7. 2026ReCo-KD: Region- and Context-Aware Knowledge Distillation for Efficient 3D Medical Image Segmentation
  8. 2022Graph Flow: Cross-layer Graph Flow Distillation for Dual Efficient Medical Image Segmentation