Med3D: Transfer Learning for 3D Medical Image Analysis
Not on the map. Why?
Cited by 35 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
The performance on deep learning is significantly affected by volume of training data. Models pre-trained from massive dataset such as ImageNet become a powerful weapon for speeding up training convergence and improving accuracy. Similarly, models based on large dataset are important for the development of deep learning in 3D medical images. However, it is extremely challenging to build a sufficiently large dataset due to difficulty of data acquisition and annotation in 3D medical imaging. We aggregate the dataset from several medical challenges to build 3DSeg-8 dataset with diverse modalities, target organs, and pathologies. To extract general medical three-dimension (3D) features, we design a heterogeneous 3D network called Med3D to co-train multi-domain 3DSeg-8 so as to make a series of pre-trained models. We transfer Med3D pre-trained models to lung segmentation in LIDC dataset, pulmonary nodule classification in LIDC dataset and liver segmentation on LiTS challenge. Experiments show that the Med3D can accelerate the training convergence speed of target 3D medical tasks 2 times compared with model pre-trained on Kinetics dataset, and 10 times compared with training from scratch as well as improve accuracy ranging from 3% to 20%. Transferring our Med3D model on state-the-of-art DenseASPP segmentation network, in case of single model, we achieve 94.6% Dice coefficient which approaches the result of top-ranged algorithms on the LiTS challenge.
Key facts. Cited by 282 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 27; 2023: 53; 2024: 52; 2025: 71; 2026: 56.
282 papers.
Sort:
By area:
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
- 2021Big Self-Supervised Models Advance Medical Image Classificationcited by 320
- 2022Brain Imaging Generation with Latent Diffusion Modelscited by 267
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
- 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
- 2023MedSegDiff-V2: Diffusion based Medical Image Segmentation with Transformercited by 124
- 2022LViT: Language meets Vision Transformer in Medical Image Segmentationcited by 110
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2021On the Role of Neural Collapse in Transfer Learningcited by 100
- 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesiscited by 85
- 2022Masked Image Modeling Advances 3D Medical Image Analysiscited by 71
- 2021Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learningcited by 68
38 more
- 2023Generative AI for Medical Imaging: extending the MONAI Frameworkcited by 68
- 2022Delving into Masked Autoencoders for Multi-Label Thorax Disease Classificationcited by 65
- 2024AbdomenAtlas: A Large-Scale, Detailed-Annotated, & Multi-Center Dataset for Efficient Transfer Learning and Open Algorithmic Benchmarkingcited by 64
- 2023Large AI Models in Health Informatics: Applications, Challenges, and the Futurecited by 61
- 2023LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matchingcited by 60
- 2024WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesiscited by 56
- 2022Transfer Learning with Deep Tabular Modelscited by 52
- 2023UniSeg: A Prompt-driven Universal Segmentation Model as well as A Strong Representation Learnercited by 46
- 2023MultiTalent: A Multi-Dataset Approach to Medical Image Segmentationcited by 45
- 2023MedSyn: Text-guided Anatomy-aware Synthesis of High-Fidelity 3D CT Imagescited by 41
- 2023CLIP in Medical Imaging: A Surveycited by 40
- 2023A Deep Neural Architecture for Harmonizing 3-D Input Data Analysis and Decision Making in Medical Imagingcited by 39
- 2021Supervised Transfer Learning at Scale for Medical Imagingcited by 38
- 20243D MedDiffusion: A 3D Medical Latent Diffusion Model for Controllable and High-quality Medical Image Generationcited by 37
- 2023Training Like a Medical Resident: Context-Prior Learning Toward Universal Medical Image Segmentationcited by 32
- 2024Universal and Extensible Language-Vision Models for Organ Segmentation and Tumor Detection from Abdominal Computed Tomographycited by 31
- 2024Learning General-Purpose Biomedical Volume Representations using Randomized Synthesiscited by 27
- 2023DeSAM: Decoupled Segment Anything Model for Generalizable Medical Image Segmentationcited by 26
- 2024M4oE: A Foundation Model for Medical Multimodal Image Segmentation with Mixture of Expertscited by 26
- 2023Neuralizer: General Neuroimage Analysis without Re-Trainingcited by 24
- 2025Pillar-0: A New Frontier for Radiology Foundation Modelscited by 24
- 2022Prompt Tuning for Parameter-efficient Medical Image Segmentationcited by 21
- 2021Label-Assemble: Leveraging Multiple Datasets with Partial Labelscited by 20
- 2025How Well Do Supervised 3D Models Transfer to Medical Imaging Tasks?cited by 19
- 2022Uni4Eye: Unified 2D and 3D Self-supervised Pre-training via Masked Image Modeling Transformer for Ophthalmic Image Classificationcited by 18
- 2022Learning from partially labeled data for multi-organ and tumor segmentationcited by 18
- 2023Guided Reconstruction with Conditioned Diffusion Models for Unsupervised Anomaly Detection in Brain MRIscited by 18
- 2023Towards Foundation Models and Few-Shot Parameter-Efficient Fine-Tuning for Volumetric Organ Segmentationcited by 17
- 2021Free-form tumor synthesis in computed tomography images via richer generative adversarial networkcited by 16
- 2021Medical Transformer: Universal Brain Encoder for 3D MRI Analysiscited by 16
- 2021Medical Image Segmentation with 3D Convolutional Neural Networks: A Surveycited by 16
- 2022Omni-Seg: A Scale-aware Dynamic Network for Renal Pathological Image Segmentationcited by 16
- 2022Joint Self-Supervised Image-Volume Representation Learning with Intra-Inter Contrastive Clusteringcited by 16
- 2024CMViM: Contrastive Masked Vim Autoencoder for 3D Multi-modal Representation Learning for AD classificationcited by 15
- 2024Med-2E3: A 2D-Enhanced 3D Medical Multimodal Large Language Modelcited by 15
- 2024Deep Rib Fracture Instance Segmentation and Classification from CT on the RibFrac Challengecited by 14
- 2024PrPSeg: Universal Proposition Learning for Panoramic Renal Pathology Segmentationcited by 14
- 2024Deep Generative Models for 3D Medical Image Synthesiscited by 14
50 most cited of 282 All 282 (JSON)
- 2026FD-AA: A Lightweight Focal-Diffuse And Attenuation-Aware Head for Incidental Abdominal Abnormality Detection in Chest CT28 Sep 2026
- 2026Reduce, Then Encode: Multiscale Volumetric Reduction for 2D Foundation Models in Brain MRI28 Sep 2026
- 2026Latent Space Is Not Flat: Rethinking Latent Structure for 3D Medical Image Synthesis26 Sep 2026
- 2026M2PFN: End-to-End Disentangled Alignment for Generalizable Multimodal In-Context Learning in Alzheimer's Disease23 Sep 2026
- 2026Radiomics--Foundation Fusion for Interpretable RCC Classification: Internal Benchmarking and Exploratory External Transfer22 Sep 2026
- 2026Complementary Roles of Radiomics and Foundation Representations in Renal Cell Carcinoma Classification: A Comparative Study of 2D and 3D CT Encodings22 Sep 2026
- 2026Mammography Foundation Models for Opportunistic Prediction of Major Adverse Cardiovascular Events16 Sep 2026
- 2026Weakly-supervised Kidney Tumor Classification from CT Scans with Multi-Instance Learning and Anatomical Filtering7 Sep 2026
- 2026Real-World Multi-Modal and Longitudinal Lung Cancer Dataset4 Sep 2026
- 2026Beyond Representation Learning: A Systematic Study of Joint-Embedding Predictive Generation for 3D Brain MRI28 Aug 2026
- 2026PANDA - Prototype-Anchored Alignment for Partially Unpaired Multimodal Learning, with Applications to Alzheimers MRI and TCGA Pathology26 Aug 2026
- 2026THA-Flow Generative Model: Prosthesis Geometry Prediction from Preoperative CT26 Aug 2026
38 more
- 2026Predicting Radiologist Expertise from 3D Gaze Patterns During CT Interpretation24 Aug 2026
- 2026AnaDiffusion: Anatomically CompositionalLatent Diffusion for Controllable 3D Brain MRI Generation24 Aug 2026
- 2026Volumetric Radiology AI in the Era of Multimodal Large Language Models20 Aug 2026
- 2026BrainNorm: A Foundation Model that knows Normal via Semantic Atlas Pretraining18 Aug 2026
- 2026Less Annotation, More Interpretation: Prior-Guided Concept Bottleneck Models for Interpretable Cancer Imaging Diagnosis13 Aug 2026
- 2026VoxStruct3D: Structure-Leading Flow Matching for Voxel-Space 3D MRI Synthesis5 Aug 2026
- 2026Multimodal Semantic-Aware Contrastive Learning For False Negative Mitigation in 3D Medical Imaging16 Jul 2026
- 2026TCAM-Diff: Triplane-Aware Cross-Attention Medical Diffusion Model15 Jul 2026
- 2026CHM-Net: Center Heatmap-driven Macro-Micro Modeling Network for MRI-based Microbial Density Stratification10 Jul 2026
- 2026AT-Attn: Temporal-Aware Cross-Attention for Longitudinal Multimodal Alzheimer's Disease Diagnosis8 Jul 2026
- 2026Trust the Prior (or Not): Uncertainty-Aware Abdominal Aortic Aneurysm Segmentation30 Jun 2026
- 2026TRACE: A Concept Bottleneck Model for Longitudinal 3D Glioblastoma Response Assessment29 Jun 2026
- 2026Pixel-Level Residual Diffusion Transformer: Scalable 3D CT Volume Generation18 Jun 2026
- 2026BrainG3N: A Dual-Purpose Tokenizer for Controllable 3D Brain MRI Generation17 Jun 2026
- 2026To forget is to preserve: Machine Unlearning for 3D medical image segmentation15 Jun 2026
- 2026WaveDiT: Distribution-Aware Wavelet Flow Matching for Efficient 3D Brain MRI Synthesis7 Jun 2026
- 2026How Much MRI Preprocessing Is Enough? A Cost-Utility Study for Brain MRI Foundation Models6 Jun 2026
- 2026LiFT: Lifted Inter-slice Feature Trajectories for 3D Image Generation from 2D Generators18 May 2026
- 2026Knowledge Transfer Scaling Laws for 3D Medical Imaging7 May 2026
- 2026Tumor-aware augmentation with task-guided attention analysis improves rectal cancer segmentation from magnetic resonance images6 May 2026
- 2026Vol-Mark: A Watermark for 3D Medical Volume Data Via Cubic Difference Expansion and Contrastive Learning6 May 2026
- 2026Learning Coarse-to-Fine Osteoarthritis Representations under Noisy Hierarchical Labels1 May 2026
- 20264DLoG: Generative Modeling of Neurodegenerative Brain Anatomy with 4D Longitudinal Diffusion Model24 Apr 2026
- 2026Co-distilled attention guided masked image modeling with noisy teacher for self-supervised learning on medical images16 Apr 2026
- 2026LoGo-MR: Screening Breast MRI for Cancer Risk Prediction by Efficient Omni-Slice Modeling13 Apr 2026
- 2026Distilling Photon-Counting CT into Routine Chest CT through Clinically Validated Degradation Modeling8 Apr 2026
- 2026NEMESIS: Noise-suppressed Efficient MAE with Enhanced Superpatch Integration Strategy2 Apr 2026
- 2026Brain MR Image Synthesis with 3D Multi-Contrast Self-Attention GAN31 Mar 2026
- 2026Trimodal Deep Learning for Glioma Survival Prediction: A Feasibility Study Integrating Histopathology, Gene Expression, and MRI31 Mar 2026
- 2026VolDiT: Controllable Volumetric Medical Image Synthesis with Diffusion Transformers26 Mar 2026
- 20263D-LLDM: Label-Guided 3D Latent Diffusion Model for Improving High-Resolution Synthetic MR Imaging in Hepatic Structure Segmentation25 Mar 2026
- 2026Single-Subject Multi-View MRI Super-Resolution via Implicit Neural Representations23 Mar 2026
- 2026A practical artificial intelligence framework for legal age estimation using clavicle computed tomography scans18 Mar 2026
- 2026LoV3D: Grounding Cognitive Prognosis Reasoning in Longitudinal 3D Brain MRI via Regional Volume Assessments12 Mar 2026
- 2026ICHOR: A Robust Representation Learning Approach for ASL CBF Maps with Self-Supervised Masked Autoencoders5 Mar 2026
- 2026MeDUET: Disentangled Unified Pretraining for 3D Medical Image Synthesis and Analysis19 Feb 2026
- 2026Generative Latent Representations of 3D Brain MRI for Multi-Task Downstream Analysis in Down Syndrome14 Feb 2026
- 2026KidMesh: Computational Mesh Reconstruction for Pediatric Congenital Hydronephrosis Using Deep Neural Networks9 Feb 2026
50 newest of 282 All 282 (JSON)
- 2022Brain Imaging Generation with Latent Diffusion Modelscited by 267
- 2023MedSegDiff-V2: Diffusion based Medical Image Segmentation with Transformercited by 124
- 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesiscited by 85
- 2024WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesiscited by 56
- 20243D MedDiffusion: A 3D Medical Latent Diffusion Model for Controllable and High-quality Medical Image Generationcited by 37
- 2023Guided Reconstruction with Conditioned Diffusion Models for Unsupervised Anomaly Detection in Brain MRIscited by 18
- 2024Unconditional Latent Diffusion Models Memorize Patient Imaging Data: Implications for Openly Sharing Synthetic Datacited by 9
- 2024MedDiff-FM: A Diffusion-based Foundation Model for Versatile Medical Image Applicationscited by 7
- 2025Lung-DDPM: Semantic Layout-guided Diffusion Models for Thoracic CT Image Synthesiscited by 7
- 2025From Alignment to Synthesis: Contrastive Volumetric Grounding for Text-to-CT Generationcited by 6
- 2024CT Synthesis with Conditional Diffusion Models for Abdominal Lymph Node Segmentationcited by 5
- 2026FlowLet: Conditional 3D Brain MRI Synthesis using Wavelet Flow Matchingcited by 5
12 most cited of 34 All 34 (JSON)
- 2026THA-Flow Generative Model: Prosthesis Geometry Prediction from Preoperative CT26 Aug 2026
- 2026AnaDiffusion: Anatomically CompositionalLatent Diffusion for Controllable 3D Brain MRI Generation24 Aug 2026
- 2026VoxStruct3D: Structure-Leading Flow Matching for Voxel-Space 3D MRI Synthesis5 Aug 2026
- 2026TCAM-Diff: Triplane-Aware Cross-Attention Medical Diffusion Model15 Jul 2026
- 2026Pixel-Level Residual Diffusion Transformer: Scalable 3D CT Volume Generation18 Jun 2026
- 2026BrainG3N: A Dual-Purpose Tokenizer for Controllable 3D Brain MRI Generation17 Jun 2026
- 2026WaveDiT: Distribution-Aware Wavelet Flow Matching for Efficient 3D Brain MRI Synthesis7 Jun 2026
- 20264DLoG: Generative Modeling of Neurodegenerative Brain Anatomy with 4D Longitudinal Diffusion Model24 Apr 2026
- 2026VolDiT: Controllable Volumetric Medical Image Synthesis with Diffusion Transformers26 Mar 2026
- 20263D-LLDM: Label-Guided 3D Latent Diffusion Model for Improving High-Resolution Synthetic MR Imaging in Hepatic Structure Segmentation25 Mar 2026
- 2026MeDUET: Disentangled Unified Pretraining for 3D Medical Image Synthesis and Analysis19 Feb 2026
- 2026POWDR: Pathology-preserving Outpainting with Wavelet Diffusion for 3D MRI14 Jan 2026
12 newest of 34 All 34 (JSON)
- 2023LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matchingcited by 60
- 2024Med-2E3: A 2D-Enhanced 3D Medical Multimodal Large Language Modelcited by 15
- 2024Med3DInsight: Enhancing 3D Medical Image Understanding with 2D Multi-Modal Large Language Modelscited by 5
- 2024MOSMOS: Multi-organ segmentation facilitated by medical report supervisioncited by 1
- 2025Enhancing 3D Medical Image Understanding with Pretraining Aided by 2D Multimodal Large Language Modelscited by 1
- 2025Imagining Alternatives: Towards High-Resolution 3D Counterfactual Medical Image Generation via Language Guidancecited by 0
- 2026Volumetric Radiology AI in the Era of Multimodal Large Language Modelscited by 0
- 2026Volumetric Radiology AI in the Era of Multimodal Large Language Models20 Aug 2026
- 2025Enhancing 3D Medical Image Understanding with Pretraining Aided by 2D Multimodal Large Language Models11 Sep 2025
- 2025Imagining Alternatives: Towards High-Resolution 3D Counterfactual Medical Image Generation via Language Guidance7 Sep 2025
- 2024Med-2E3: A 2D-Enhanced 3D Medical Multimodal Large Language Model19 Nov 2024
- 2024MOSMOS: Multi-organ segmentation facilitated by medical report supervision4 Sep 2024
- 2024Med3DInsight: Enhancing 3D Medical Image Understanding with 2D Multi-Modal Large Language Models8 Mar 2024
- 2023LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matching20 Jun 2023
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
- 2021Big Self-Supervised Models Advance Medical Image Classificationcited by 320
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
- 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
- 2022LViT: Language meets Vision Transformer in Medical Image Segmentationcited by 110
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2021On the Role of Neural Collapse in Transfer Learningcited by 100
- 2022Masked Image Modeling Advances 3D Medical Image Analysiscited by 71
- 2021Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learningcited by 68
- 2023Generative AI for Medical Imaging: extending the MONAI Frameworkcited by 68
- 2022Delving into Masked Autoencoders for Multi-Label Thorax Disease Classificationcited by 65
- 2024AbdomenAtlas: A Large-Scale, Detailed-Annotated, & Multi-Center Dataset for Efficient Transfer Learning and Open Algorithmic Benchmarkingcited by 64
12 most cited of 233 All 233 (JSON)
- 2026FD-AA: A Lightweight Focal-Diffuse And Attenuation-Aware Head for Incidental Abdominal Abnormality Detection in Chest CT28 Sep 2026
- 2026Reduce, Then Encode: Multiscale Volumetric Reduction for 2D Foundation Models in Brain MRI28 Sep 2026
- 2026Latent Space Is Not Flat: Rethinking Latent Structure for 3D Medical Image Synthesis26 Sep 2026
- 2026M2PFN: End-to-End Disentangled Alignment for Generalizable Multimodal In-Context Learning in Alzheimer's Disease23 Sep 2026
- 2026Radiomics--Foundation Fusion for Interpretable RCC Classification: Internal Benchmarking and Exploratory External Transfer22 Sep 2026
- 2026Complementary Roles of Radiomics and Foundation Representations in Renal Cell Carcinoma Classification: A Comparative Study of 2D and 3D CT Encodings22 Sep 2026
- 2026Mammography Foundation Models for Opportunistic Prediction of Major Adverse Cardiovascular Events16 Sep 2026
- 2026Weakly-supervised Kidney Tumor Classification from CT Scans with Multi-Instance Learning and Anatomical Filtering7 Sep 2026
- 2026Real-World Multi-Modal and Longitudinal Lung Cancer Dataset4 Sep 2026
- 2026Beyond Representation Learning: A Systematic Study of Joint-Embedding Predictive Generation for 3D Brain MRI28 Aug 2026
- 2026PANDA - Prototype-Anchored Alignment for Partially Unpaired Multimodal Learning, with Applications to Alzheimers MRI and TCGA Pathology26 Aug 2026
- 2026Predicting Radiologist Expertise from 3D Gaze Patterns During CT Interpretation24 Aug 2026
12 newest of 233 All 233 (JSON)