Distillation Learning Guided by Image Reconstruction for One-Shot Medical Image Segmentation
On the map: Knowledge distillation → Distillation for medical imaging
Abstract (arXiv)
Traditional one-shot medical image segmentation (MIS) methods use registration networks to propagate labels from a reference atlas or rely on comprehensive sampling strategies to generate synthetic labeled data for training. However, these methods often struggle with registration errors and low-quality synthetic images, leading to poor performance and generalization. To overcome this, we introduce a novel one-shot MIS framework based on knowledge distillation, which allows the network to directly 'see' real images through a distillation process guided by image reconstruction. It focuses on anatomical structures in a single labeled image and a few unlabeled ones. A registration-based data augmentation network creates realistic, labeled samples, while a feature distillation module helps the student network learn segmentation from these samples, guided by the teacher network. During inference, the streamlined student network accurately segments new images. Evaluations on three public datasets (OASIS for T1 brain MRI, BCV for abdomen CT, and VerSe for vertebrae CT) show superior segmentation performance and generalization across different medical image datasets and modalities compared to leading methods. Our code is available at https://github.com/NoviceFodder/OS-MedSeg.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Distillation for medical imaging, one of 12 directions in Knowledge distillation. Builds on 37 of its 56 references that are in the map. First posted on arXiv 7 Aug 2024.
Builds on
37 of 56 references.
References · 37
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
- 2015Spatial Transformer Networkscited by 1,429
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 662
- 2020Image Segmentation Using Deep Learning: A Surveycited by 660
- 2021The Medical Segmentation Decathloncited by 628
- 2023Segment Everything Everywhere All at Oncecited by 548
- 2018Born Again Neural Networkscited by 546
- 2016RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentationcited by 465
25 more
- 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
- 2020Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentationcited by 300
- 2019ResUNet-a: a deep learning framework for semantic segmentation of remotely sensed datacited by 261
- 2019Unsupervised Learning of Probabilistic Diffeomorphic Registration for Images and Surfacescited by 186
- 2018An Unsupervised Learning Model for Deformable Medical Image Registrationcited by 150
- 2019Data augmentation using learned transformations for one-shot medical image segmentationcited by 138
- 2021Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learningcited by 125
- 2020VerSe: A Vertebrae Labelling and Segmentation Benchmark for Multi-detector CT Imagescited by 111
- 2018Snapshot Distillation: Teacher-Student Optimization in One Generationcited by 99
- 2020Unpaired Multi-modal Segmentation via Knowledge Distillationcited by 81
- 2018Collaborative Learning for Deep Neural Networkscited by 69
- 2019DeepAtlas: Joint Semi-Supervised Learning of Image Registration and Segmentationcited by 66
- 2019Unsupervised 3D End-to-End Medical Image Registration with Volume Tweening Networkcited by 62
- 2014Multi-Atlas Segmentation of Biomedical Images: A Surveycited by 56
- 2019Dual-Stream Pyramid Registration Networkcited by 52
- 2020Towards Cross-modality Medical Image Segmentation with Online Mutual Knowledge Distillationcited by 38
- 2022Learning the Effect of Registration Hyperparameters with HyperMorphcited by 35
- 2020LT-Net: Label Transfer by Learning Reversible Voxel-wise Correspondence for One-shot Medical Image Segmentationcited by 28
- 2021Joint Progressive and Coarse-to-fine Registration of Brain MRI via Deformation Field Integration and Non-Rigid Feature Fusioncited by 22
- 2020Contrastive Registration for Unsupervised Medical Image Segmentationcited by 19
- 2020Deep Complementary Joint Model for Complex Scene Registration and Few-shot Segmentation on Medical Imagescited by 17
- 2021Modeling the Probabilistic Distribution of Unlabeled Data forOne-shot Medical Image Segmentationcited by 17
- 2021Self-Supervised Generative Style Transfer for One-Shot Medical Image Segmentationcited by 10
- 2022One shot PACS: Patient specific Anatomic Context and Shape prior aware recurrent registration-segmentation of longitudinal thoracic cone beam CTscited by 8
- 20203D deformable registration of longitudinal abdominopelvic CT images using unsupervised deep learningcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2021Efficient Medical Image Segmentation Based on Knowledge Distillation
- 2024Multi-Task Multi-Scale Contrastive Knowledge Distillation for Efficient Medical Image Segmentation
- 2024Shape-intensity knowledge distillation for robust medical image segmentation
- 2021Knowledge distillation from multi-modal to mono-modal segmentation networks
- 2024Adaptive Affinity-Based Generalization For MRI Imaging Segmentation Across Resource-Limited Settings
- 2025Task-Specific Knowledge Distillation from the Vision Foundation Model for Enhanced Medical Image Segmentation
- 2026ReCo-KD: Region- and Context-Aware Knowledge Distillation for Efficient 3D Medical Image Segmentation
- 2022Graph Flow: Cross-layer Graph Flow Distillation for Dual Efficient Medical Image Segmentation