Rethinking Transfer Learning for Medical Image Classification
Not on the map. Why?
Abstract (arXiv)
Transfer learning (TL) from pretrained deep models is a standard practice in modern medical image classification (MIC). However, what levels of features to be reused are problem-dependent, and uniformly finetuning all layers of pretrained models may be suboptimal. This insight has partly motivated the recent differential TL strategies, such as TransFusion (TF) and layer-wise finetuning (LWFT), which treat the layers in the pretrained models differentially. In this paper, we add one more strategy into this family, called TruncatedTL, which reuses and finetunes appropriate bottom layers and directly discards the remaining layers. This yields not only superior MIC performance but also compact models for efficient inference, compared to other differential TL methods. Our code is available at: https://github.com/sun-umn/TTL
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 50 references that are in the map. First posted on arXiv 9 Jun 2021.
Builds on
23 of 50 references.
References · 23
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2014How transferable are features in deep neural networks?cited by 1,216
- 2019A Comprehensive Survey on Transfer Learningcited by 1,154
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2018Quantizing deep convolutional networks for efficient inference: A whitepapercited by 507
- 2013DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognitioncited by 422
- 2018A Survey on Deep Transfer Learningcited by 417
11 more
- 2019Transfusion: Understanding Transfer Learning for Medical Imagingcited by 366
- 2018A Short Note about Kinetics-600cited by 331
- 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 319
- 2014CNN Features off-the-shelf: an Astounding Baseline for Recognitioncited by 316
- 2018Model compression via distillation and quantizationcited by 287
- 2017Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?cited by 220
- 2016Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learningcited by 209
- 2020BIMCV COVID-19+: a large annotated dataset of RX and CT images from COVID-19 patientscited by 81
- 2017Transfer Learning for Domain Adaptation in MRI: Application in Brain Lesion Segmentationcited by 66
- 2018Direct Uncertainty Prediction for Medical Second Opinionscited by 61
- 2017A Tutorial on Canonical Correlation Methodscited by 14
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.