Recent advances and clinical applications of deep learning in medical image analysis
Not on the map. Why?
Abstract (arXiv)
Deep learning has received extensive research interest in developing new medical image processing algorithms, and deep learning based models have been remarkably successful in a variety of medical imaging tasks to support disease detection and diagnosis. Despite the success, the further improvement of deep learning models in medical image analysis is majorly bottlenecked by the lack of large-sized and well-annotated datasets. In the past five years, many studies have focused on addressing this challenge. In this paper, we reviewed and summarized these recent studies to provide a comprehensive overview of applying deep learning methods in various medical image analysis tasks. Especially, we emphasize the latest progress and contributions of state-of-the-art unsupervised and semi-supervised deep learning in medical image analysis, which are summarized based on different application scenarios, including classification, segmentation, detection, and image registration. We also discuss the major technical challenges and suggest the possible solutions in future research efforts.
Key facts. Cited by 104 papers in the map (data through 7 Oct 2026). Builds on 225 of its 359 references that are in the map. First posted on arXiv 27 May 2021.
Builds on
225 of 359 references.
References · 225
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
38 more
- 2017Mask R-CNNcited by 7,259
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2014Going Deeper with Convolutionscited by 4,231
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2016Improved Techniques for Training GANscited by 2,938
- 2015Fast R-CNNcited by 2,930
- 2020Supervised Contrastive Learningcited by 2,803
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2017Non-local Neural Networkscited by 2,290
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
- 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,531
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
- 2016Neural Architecture Search with Reinforcement Learningcited by 1,489
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2016YOLO9000: Better, Faster, Strongercited by 1,429
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2015Spatial Transformer Networkscited by 1,423
50 most cited of 225 All 225 (JSON)
Built on by
Citing papers per year: 2021: 1; 2022: 7; 2023: 17; 2024: 48; 2025: 19; 2026: 12.
104 papers.
Sort:
By area:
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
- 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 192
- 2024CT2Rep: Automated Radiology Report Generation for 3D Medical Imagingcited by 96
- 2024MedMamba: Vision Mamba for Medical Image Classificationcited by 86
- 2023A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervisioncited by 78
- 2021Self-supervised learning methods and applications in medical imaging analysis: A surveycited by 76
- 2024AbdomenAtlas: A Large-Scale, Detailed-Annotated, & Multi-Center Dataset for Efficient Transfer Learning and Open Algorithmic Benchmarkingcited by 64
- 2023ICICLE: Interpretable Class Incremental Continual Learningcited by 24
- 2024Out-of-distribution Detection in Medical Image Analysis: A surveycited by 22
- 2024Few-shot Adaptation of Medical Vision-Language Modelscited by 22
- 2022Swin MAE: Masked Autoencoders for Small Datasetscited by 17
- 2023Towards Foundation Models and Few-Shot Parameter-Efficient Fine-Tuning for Volumetric Organ Segmentationcited by 17
38 more
- 2024SDR-Former: A Siamese Dual-Resolution Transformer for Liver Lesion Classification Using 3D Multi-Phase Imagingcited by 17
- 2024HC-Mamba: Vision MAMBA with Hybrid Convolutional Techniques for Medical Image Segmentationcited by 15
- 2023Rethinking Data Distillation: Do Not Overlook Calibrationcited by 13
- 2023Is attention all you need in medical image analysis? A reviewcited by 12
- 2022Transformers Improve Breast Cancer Diagnosis from Unregistered Multi-View Mammogramscited by 11
- 2023Virtual histological staining of unlabeled autopsy tissuecited by 11
- 2025CLOC: Contrastive Learning for Ordinal Classification with Multi-Margin N-pair Losscited by 11
- 2024Discovering Mathematical Formulas from Data via GPT-guided Monte Carlo Tree Searchcited by 10
- 2024Exploring Low-Resource Medical Image Classification with Weakly Supervised Prompt Learningcited by 10
- 2024D-Net: Dynamic Large Kernel with Dynamic Feature Fusion for Volumetric Medical Image Segmentationcited by 9
- 2024Mammo-CLIP: Leveraging Contrastive Language-Image Pre-training (CLIP) for Enhanced Breast Cancer Diagnosis with Multi-view Mammographycited by 9
- 2024Boosting Vision-Language Models for Histopathology Classification: Predict all at oncecited by 8
- 2024Gaze-directed Vision GNN for Mitigating Shortcut Learning in Medical Imagecited by 7
- 2024Cost-effective Instruction Learning for Pathology Vision and Language Analysiscited by 7
- 2025Few-Shot, Now for Real: Medical VLMs Adaptation without Balanced Sets or Validationcited by 7
- 2023Data efficient deep learning for medical image analysis: A surveycited by 6
- 2024A Unified Model for Longitudinal Multi-Modal Multi-View Prediction with Missingnesscited by 6
- 2024SPIRONet: Spatial-Frequency Learning and Graph-based Channel Interaction Network for Vessel Segmentationcited by 6
- 2024Language-guided Medical Image Segmentation with Target-informed Multi-level Contrastive Alignmentscited by 6
- 2025IMPACT: A Generic Semantic Loss for Multimodal Medical Image Registrationcited by 5
- 2024Self-Supervised Representation Learning for Nerve Fiber Distribution Patterns in 3D-PLIcited by 4
- 2024VIS-MAE: An Efficient Self-supervised Learning Approach on Medical Image Segmentation and Classificationcited by 4
- 2024Semantics-Aware Attention Guidance for Diagnosing Whole Slide Imagescited by 4
- 2024Leveraging Task-Specific Knowledge from LLM for Semi-Supervised 3D Medical Image Segmentationcited by 4
- 2024Deep Learning for Pancreas Segmentation: a Systematic Reviewcited by 4
- 2025Ordinal Label-Distribution Learning with Constrained Asymmetric Priors for Imbalanced Retinal Gradingcited by 4
- 2022Semi-Supervised and Self-Supervised Collaborative Learning for Prostate 3D MR Image Segmentationcited by 3
- 2022Med-Query: Steerable Parsing of 9-DoF Medical Anatomies with Query Embeddingcited by 3
- 2023A Deep Registration Method for Accurate Quantification of Joint Space Narrowing Progression in Rheumatoid Arthritiscited by 3
- 2024ADAPT: Alzheimer Diagnosis through Adaptive Profiling Transformerscited by 3
- 2024Few-shot learning for COVID-19 Chest X-Ray Classification with Imbalanced Data: An Inter vs. Intra Domain Studycited by 3
- 2024Adversarially Robust Feature Learning for Breast Cancer Diagnosiscited by 3
- 2024MLVICX: Multi-Level Variance-Covariance Exploration for Chest X-ray Self-Supervised Representation Learningcited by 3
- 2024Unified Multi-modal Diagnostic Framework with Reconstruction Pre-training and Heterogeneity-combat Tuningcited by 3
- 2024Key Patches Are All You Need: A Multiple Instance Learning Framework For Robust Medical Diagnosiscited by 3
- 2024Are Vision xLSTM Embedded UNet More Reliable in Medical 3D Image Segmentation?cited by 3
- 2024Contour-weighted loss for class-imbalanced image segmentationcited by 3
- 2024Med-TTT: Vision Test-Time Training model for Medical Image Segmentationcited by 3
50 most cited of 104 All 104 (JSON)
- 2026FreqDINO++: A Frequency-Guided Multi-Task Routing Vision Foundation Model for Universal Ultrasound Analysis17 Sep 2026
- 2026Prompt-Conditioned Channel Attention for Hierarchical Feature Modulation toward Anatomy-Agnostic Segmentation20 Aug 2026
- 2026CFR-Net:Collaborative Feature Refinement Network for Medical Image Anomaly Detection13 Jul 2026
- 2026MSA-DCNN: A Data-Efficient Multi-Scale Attention Deformable CNN for Medical Image Classification7 Jul 2026
- 2026A Clinician-Centered Pipeline for Annotation and Evaluation in Ultrasound AI Studies17 Jun 2026
- 2026Learning Label-Efficient Interpretable Medical Image Diagnosis via Semi-supervised Hypergraph Concept Bottleneck Model1 Jun 2026
- 2026ASAP: Advancing Medical Volumetric Representation Learning with Anatomy-aware Semantically-adaptive Pre-training30 May 2026
- 2026Calibrating Probabilistic Object Detectors with Annotator Disagreement23 May 2026
- 2026A Computer-aided Framework for Detecting Osteosarcoma in Computed Tomography Scans10 Mar 2026
- 2026Diffeomorphism-Equivariant Neural Networks6 Feb 2026
- 2026Partial Decoder Attention Network with Contour-weighted Loss Function for Data-Imbalance Medical Image Segmentation20 Jan 2026
- 2026Trustworthy Data-driven Chronological Age Estimation from Panoramic Dental Images19 Jan 2026
38 more
- 2025REASON: Probability map-guided dual-branch fusion framework for gastric content assessment3 Nov 2025
- 2025Fine-tuning Segment Anything for Real-Time Tumor Tracking in Cine-MRI29 Oct 2025
- 2025TreeNet: Layered Decision Ensembles7 Oct 2025
- 2025Ordinal Label-Distribution Learning with Constrained Asymmetric Priors for Imbalanced Retinal Grading30 Sep 2025
- 2025Comprehensive Benchmarking of YOLOv11 Architectures for Scalable and Granular Peripheral Blood Cell Detection29 Sep 2025
- 2025Evaluating the Impact of Radiographic Noise on Chest X-ray Semantic Segmentation and Disease Classification Using a Scalable Noise Injection Framework28 Sep 2025
- 2025SimCroP: Radiograph Representation Learning with Similarity-driven Cross-granularity Pre-training10 Sep 2025
- 2025SPARSE Data, Rich Results: Few-Shot Semi-Supervised Learning via Class-Conditioned Image Translation8 Aug 2025
- 2025UGPL: Uncertainty-Guided Progressive Learning for Evidence-Based Classification in Computed Tomography18 Jul 2025
- 2025Semi-supervised learning and integration of multi-sequence MR-images for carotid vessel wall and plaque segmentation10 Jul 2025
- 2025EnLVAM: Enhanced Left Ventricle Linear Measurements Utilizing Anatomical Motion Mode27 Jun 2025
- 2025Few-Shot, Now for Real: Medical VLMs Adaptation without Balanced Sets or Validation20 Jun 2025
- 2025MedVKAN: Efficient Feature Extraction with Mamba and KAN for Medical Image Segmentation17 May 2025
- 2025CLOC: Contrastive Learning for Ordinal Classification with Multi-Margin N-pair Loss22 Apr 2025
- 2025Performance Estimation for Supervised Medical Image Segmentation Models on Unlabeled Data Using UniverSeg22 Apr 2025
- 2025IMPACT: A Generic Semantic Loss for Multimodal Medical Image Registration31 Mar 2025
- 2025Imitating Radiological Scrolling: A Global-Local Attention Model for 3D Chest CT Volumes Multi-Label Anomaly Classification26 Mar 2025
- 2025Bridging Synthetic-to-Real Gaps: Frequency-Aware Perturbation and Selection for Single-shot Multi-Parametric Mapping Reconstruction5 Mar 2025
- 2025EPEE: Towards Efficient and Effective Foundation Models in Biomedicine3 Mar 2025
- 2024Language-guided Medical Image Segmentation with Target-informed Multi-level Contrastive Alignments18 Dec 2024
- 2024Denoising Diffusion Models for Anomaly Localization in Medical Images31 Oct 2024
- 2024Advancing Histopathology with Deep Learning Under Data Scarcity: A Decade in Review18 Oct 2024
- 2024Med-TTT: Vision Test-Time Training model for Medical Image Segmentation3 Oct 2024
- 2024Seeing Through the Mask: Rethinking Adversarial Examples for CAPTCHAs9 Sep 2024
- 2024Label-free evaluation of lung and heart transplant biopsies using tissue autofluorescence-based virtual staining9 Sep 2024
- 2024Few-shot Adaptation of Medical Vision-Language Models5 Sep 2024
- 2024Boosting Vision-Language Models for Histopathology Classification: Predict all at once3 Sep 2024
- 2024LCE: A Framework for Explainability of DNNs for Ultrasound Image Based on Concept Discovery19 Aug 2024
- 2024A Novel Momentum-Based Deep Learning Techniques for Medical Image Classification and Segmentation11 Aug 2024
- 2024Cost-effective Instruction Learning for Pathology Vision and Language Analysis25 Jul 2024
- 2024AbdomenAtlas: A Large-Scale, Detailed-Annotated, & Multi-Center Dataset for Efficient Transfer Learning and Open Algorithmic Benchmarking23 Jul 2024
- 2024Deep Learning for Pancreas Segmentation: a Systematic Review23 Jul 2024
- 2024Robust and Explainable Framework to Address Data Scarcity in Diagnostic Imaging9 Jul 2024
- 2024Leveraging Task-Specific Knowledge from LLM for Semi-Supervised 3D Medical Image Segmentation6 Jul 2024
- 2024SPIRONet: Spatial-Frequency Learning and Graph-based Channel Interaction Network for Vessel Segmentation28 Jun 2024
- 2024Are Vision xLSTM Embedded UNet More Reliable in Medical 3D Image Segmentation?24 Jun 2024
- 2024Gaze-directed Vision GNN for Mitigating Shortcut Learning in Medical Image20 Jun 2024
- 2024Unleashing the Potential of Open-set Noisy Samples Against Label Noise for Medical Image Classification18 Jun 2024
50 newest of 104 All 104 (JSON)
- 2023A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervisioncited by 78
- 2024Few-shot Adaptation of Medical Vision-Language Modelscited by 22
- 2024Exploring Low-Resource Medical Image Classification with Weakly Supervised Prompt Learningcited by 10
- 2024Boosting Vision-Language Models for Histopathology Classification: Predict all at oncecited by 8
- 2024Cost-effective Instruction Learning for Pathology Vision and Language Analysiscited by 7
- 2025Few-Shot, Now for Real: Medical VLMs Adaptation without Balanced Sets or Validationcited by 7
- 2025SimCroP: Radiograph Representation Learning with Similarity-driven Cross-granularity Pre-trainingcited by 3
- 2026ASAP: Advancing Medical Volumetric Representation Learning with Anatomy-aware Semantically-adaptive Pre-trainingcited by 1
- 2026ASAP: Advancing Medical Volumetric Representation Learning with Anatomy-aware Semantically-adaptive Pre-training30 May 2026
- 2025SimCroP: Radiograph Representation Learning with Similarity-driven Cross-granularity Pre-training10 Sep 2025
- 2025Few-Shot, Now for Real: Medical VLMs Adaptation without Balanced Sets or Validation20 Jun 2025
- 2024Few-shot Adaptation of Medical Vision-Language Models5 Sep 2024
- 2024Boosting Vision-Language Models for Histopathology Classification: Predict all at once3 Sep 2024
- 2024Cost-effective Instruction Learning for Pathology Vision and Language Analysis25 Jul 2024
- 2024Exploring Low-Resource Medical Image Classification with Weakly Supervised Prompt Learning6 Feb 2024
- 2023A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervision15 Aug 2023
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
- 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 192
- 2024CT2Rep: Automated Radiology Report Generation for 3D Medical Imagingcited by 96
- 2021Self-supervised learning methods and applications in medical imaging analysis: A surveycited by 76
- 2024AbdomenAtlas: A Large-Scale, Detailed-Annotated, & Multi-Center Dataset for Efficient Transfer Learning and Open Algorithmic Benchmarkingcited by 64
- 2023ICICLE: Interpretable Class Incremental Continual Learningcited by 24
- 2024Out-of-distribution Detection in Medical Image Analysis: A surveycited by 22
- 2022Swin MAE: Masked Autoencoders for Small Datasetscited by 17
- 2023Towards Foundation Models and Few-Shot Parameter-Efficient Fine-Tuning for Volumetric Organ Segmentationcited by 17
- 2024SDR-Former: A Siamese Dual-Resolution Transformer for Liver Lesion Classification Using 3D Multi-Phase Imagingcited by 17
- 2023Rethinking Data Distillation: Do Not Overlook Calibrationcited by 13
- 2023Is attention all you need in medical image analysis? A reviewcited by 12
12 most cited of 91 All 91 (JSON)
- 2026FreqDINO++: A Frequency-Guided Multi-Task Routing Vision Foundation Model for Universal Ultrasound Analysis17 Sep 2026
- 2026Prompt-Conditioned Channel Attention for Hierarchical Feature Modulation toward Anatomy-Agnostic Segmentation20 Aug 2026
- 2026CFR-Net:Collaborative Feature Refinement Network for Medical Image Anomaly Detection13 Jul 2026
- 2026MSA-DCNN: A Data-Efficient Multi-Scale Attention Deformable CNN for Medical Image Classification7 Jul 2026
- 2026A Clinician-Centered Pipeline for Annotation and Evaluation in Ultrasound AI Studies17 Jun 2026
- 2026Learning Label-Efficient Interpretable Medical Image Diagnosis via Semi-supervised Hypergraph Concept Bottleneck Model1 Jun 2026
- 2026Calibrating Probabilistic Object Detectors with Annotator Disagreement23 May 2026
- 2026A Computer-aided Framework for Detecting Osteosarcoma in Computed Tomography Scans10 Mar 2026
- 2026Diffeomorphism-Equivariant Neural Networks6 Feb 2026
- 2026Partial Decoder Attention Network with Contour-weighted Loss Function for Data-Imbalance Medical Image Segmentation20 Jan 2026
- 2026Trustworthy Data-driven Chronological Age Estimation from Panoramic Dental Images19 Jan 2026
- 2025REASON: Probability map-guided dual-branch fusion framework for gastric content assessment3 Nov 2025
12 newest of 91 All 91 (JSON)