A large annotated medical image dataset for the development and evaluation of segmentation algorithms
Not on the map. Why?
Abstract (arXiv)
Semantic segmentation of medical images aims to associate a pixel with a label in a medical image without human initialization. The success of semantic segmentation algorithms is contingent on the availability of high-quality imaging data with corresponding labels provided by experts. We sought to create a large collection of annotated medical image datasets of various clinically relevant anatomies available under open source license to facilitate the development of semantic segmentation algorithms. Such a resource would allow: 1) objective assessment of general-purpose segmentation methods through comprehensive benchmarking and 2) open and free access to medical image data for any researcher interested in the problem domain. Through a multi-institutional effort, we generated a large, curated dataset representative of several highly variable segmentation tasks that was used in a crowd-sourced challenge - the Medical Segmentation Decathlon held during the 2018 Medical Image Computing and Computer Aided Interventions Conference in Granada, Spain. Here, we describe these ten labeled image datasets so that these data may be effectively reused by the research community.
Key facts. Cited by 371 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 82; 2022: 71; 2023: 75; 2024: 63; 2025: 56; 2026: 24.
371 papers.
Sort:
By area:
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
- 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 682
- 2021The Medical Segmentation Decathloncited by 620
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 444
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
- 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 412
- 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
- 2021TransFuse: Fusing Transformers and CNNs for Medical Image Segmentationcited by 258
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2022Metrics reloaded: Recommendations for image analysis validationcited by 190
- 2022Medical Image Segmentation Review: The success of U-Netcited by 190
38 more
- 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Modelscited by 154
- 2022UNETR++: Delving into Efficient and Accurate 3D Medical Image Segmentationcited by 112
- 2024GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AIcited by 96
- 2021Medical Visual Question Answering: A Surveycited by 93
- 2023UniverSeg: Universal Medical Image Segmentationcited by 90
- 2023SegVol: Universal and Interactive Volumetric Medical Image Segmentationcited by 86
- 2023Federated Learning for Medical Image Analysis: A Surveycited by 77
- 2022Learning with Limited Annotations: A Survey on Deep Semi-Supervised Learning for Medical Image Segmentationcited by 74
- 2022Masked Image Modeling Advances 3D Medical Image Analysiscited by 71
- 2021Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learningcited by 68
- 2021Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Futurecited by 67
- 2021nnDetection: A Self-configuring Method for Medical Object Detectioncited by 60
- 2023LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matchingcited by 60
- 2023SA-Med2D-20M Dataset: Segment Anything in 2D Medical Imaging with 20 Million maskscited by 54
- 2023AbdomenAtlas-8K: Annotating 8,000 CT Volumes for Multi-Organ Segmentation in Three Weekscited by 52
- 2021AFTer-UNet: Axial Fusion Transformer UNet for Medical Image Segmentationcited by 48
- 2021DiNTS: Differentiable Neural Network Topology Search for 3D Medical Image Segmentationcited by 47
- 2023ScribblePrompt: Fast and Flexible Interactive Segmentation for Any Biomedical Imagecited by 47
- 2021CTSpine1K: A Large-Scale Dataset for Spinal Vertebrae Segmentation in Computed Tomographycited by 45
- 2021Diminishing Uncertainty within the Training Pool: Active Learning for Medical Image Segmentationcited by 44
- 2021MetaCorrection: Domain-aware Meta Loss Correction for Unsupervised Domain Adaptation in Semantic Segmentationcited by 43
- 2022Transformers in Medical Image Analysis: A Reviewcited by 41
- 2023CLIP in Medical Imaging: A Surveycited by 40
- 2023Segment Anything Model for Medical Images?cited by 39
- 2025nnInteractive: Redefining 3D Promptable Segmentationcited by 39
- 2023One-Prompt to Segment All Medical Imagescited by 38
- 2021How I failed machine learning in medical imaging -- shortcomings and recommendationscited by 37
- 2023SAM3D: Segment Anything Model in Volumetric Medical Imagescited by 34
- 2024Revisiting MAE pre-training for 3D medical image segmentationcited by 33
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 32
- 2023MedShapeNet -- A Large-Scale Dataset of 3D Medical Shapes for Computer Visioncited by 31
- 2024Universal and Extensible Language-Vision Models for Organ Segmentation and Tumor Detection from Abdominal Computed Tomographycited by 31
- 2023Robustness of SAM: Segment Anything Under Corruptions and Beyondcited by 30
- 2024Interactive Medical Image Segmentation: A Benchmark Dataset and Baselinecited by 30
- 2021A Systematic Collection of Medical Image Datasets for Deep Learningcited by 29
- 2021QU-BraTS: MICCAI BraTS 2020 Challenge on Quantifying Uncertainty in Brain Tumor Segmentation - Analysis of Ranking Scores and Benchmarking Resultscited by 28
- 2023CuNeRF: Cube-Based Neural Radiance Field for Zero-Shot Medical Image Arbitrary-Scale Super Resolutioncited by 28
- 2023Physics-Informed Computer Vision: A Review and Perspectivescited by 28
50 most cited of 371 All 371 (JSON)
- 2026Unified Multi-Layer Subspace Modeling for Cross-Domain OOD Detection6 Sep 2026
- 2026Uni-Light: An Ultra-Lightweight Framework via Uncertainty-Aware Knowledge Distillation for Brain Tumour Segmentation6 Sep 2026
- 2026B-MIM: Biased Masked Image Modeling for Generalizable Segmentation of Fine-Grained Anatomical Structures25 Aug 2026
- 2026Inference-Time Orthogonal Seeding Enables Geometry-Aligned 3D Organ Segmentation for Slice-Propagation Methods12 Aug 2026
- 2026Robust Low-Tubal-Rank Tensor Completion under Cross-Concentrated Sampling4 Aug 2026
- 2026Test-time Adaptation of Pelvic Bone Segmentation Models via Dynamic Reliability-Guided1 Aug 2026
- 2026TCAM-Diff: Triplane-Aware Cross-Attention Medical Diffusion Model15 Jul 2026
- 2026Secure-by-Disguise: A Systematic Evaluation of Image Disguising for Confidential Medical Image Modeling9 Jul 2026
- 2026Specificity- and Calibration-Aware Breast Ultrasound Segmentation via Entropy-Guided Boundary Supervision21 Jun 2026
- 2026vesselFM-CT: Segmenting All Blood Vessels in CT Images for System-Level Cardiovascular Analysis8 Jun 2026
- 2026Vol-Mark: A Watermark for 3D Medical Volume Data Via Cubic Difference Expansion and Contrastive Learning6 May 2026
- 2026DALight-3D: A Lightweight 3D U-Net for Brain Tumor Segmentation from Multi-Modal MRI6 May 2026
38 more
- 2026Robustness Evaluation of a Foundation Segmentation Model Under Simulated Domain Shifts in Abdominal CT: Implications for Health Digital Twin Deployment28 Apr 2026
- 2026SGP-SAM: Self-Gated Prompting for Transferring 3D Segment Anything Models to Lesion Segmentation19 Apr 2026
- 2026Probing Intrinsic Medical Task Relationships: A Contrastive Learning Perspective7 Apr 2026
- 2026Geometrical Cross-Attention and Nonvoid Voxelization for Efficient 3D Medical Image Segmentation7 Apr 2026
- 2026PGR-Net: Prior-Guided ROI Reasoning Network for Brain Tumor MRI Segmentation23 Mar 2026
- 2026ViX-Ray: A Vietnamese Chest X-Ray Dataset for Vision-Language Models16 Mar 2026
- 2026Physics-Driven 3D Gaussian Rendering for Zero-Shot MRI Super-Resolution10 Mar 2026
- 2026SegReg: Latent Space Regularization for Improved Medical Image Segmentation26 Feb 2026
- 2026MeDUET: Disentangled Unified Pretraining for 3D Medical Image Synthesis and Analysis19 Feb 2026
- 2026DB-MSMUNet:Dual Branch Multi-scale Mamba UNet for Pancreatic CT Scans Segmentation8 Jan 2026
- 2026IBISAgent: Reinforcing Pixel-Level Visual Reasoning in MLLMs for Universal Biomedical Object Referring and Segmentation6 Jan 2026
- 2026FALCON: Few-Shot Adversarial Learning for Cross-Domain Medical Image Segmentation4 Jan 2026
- 2025TGC-Net: A Structure-Aware and Semantically-Aligned Framework for Text-Guided Medical Image Segmentation24 Dec 2025
- 2025Sharing Knowledge without Sharing Data: Stitches can improve ensembles of disjointly trained models19 Dec 2025
- 2025Pancakes: Consistent Multi-Protocol Image Segmentation Across Biomedical Domains15 Dec 2025
- 2025Hybrid Transformer-Mamba for Weakly Supervised Volumetric Medical Segmentation11 Dec 2025
- 2025NeuroABench: A Multimodal Evaluation Benchmark for Neurosurgical Anatomy Identification7 Dec 2025
- 2025TAP-CT: 3D Task-Agnostic Pretraining of Computed Tomography Foundation Models30 Nov 2025
- 2025MedCondDiff: Lightweight, Robust, Semantically Guided Diffusion for Medical Image Segmentation29 Nov 2025
- 2025Hard Spatial Gating for Precision-Driven Brain Metastasis Segmentation: Addressing the Over-Segmentation Paradox in Deep Attention Networks27 Nov 2025
- 2025Comparing SAM 2 and SAM 3 for Zero-Shot Segmentation of 3D Medical Data26 Nov 2025
- 2025LiMT: A Multi-task Liver Image Benchmark Dataset25 Nov 2025
- 2025AnatomicalNets: A Multi-Structure Segmentation and Contour-Based Distance Estimation Pipeline for Clinically Grounded Lung Cancer T-Staging24 Nov 2025
- 2025Not All Pixels Are Equal: Pixel-wise Meta-Learning for Medical Segmentation with Noisy Labels24 Nov 2025
- 2025MTMed3D: A Multi-Task Transformer-Based Model for 3D Medical Imaging15 Nov 2025
- 2025Enhancing Medical Image Segmentation via Heat Conduction Equation5 Nov 2025
- 2025Lite ENSAM: a lightweight cancer segmentation model for 3D Computed Tomography3 Nov 2025
- 2025SAMRI: Segment Any MRI30 Oct 2025
- 2025UnifiedFL: A Dynamic Unified Learning Framework for Equitable Federation30 Oct 2025
- 2025Comprehensive language-image pre-training for 3D medical image understanding16 Oct 2025
- 2025DPL: Spatial-Conditioned Diffusion Prototype Enhancement for One-Shot Medical Segmentation14 Oct 2025
- 2025MIMO: A medical vision language model with visual referring multimodal input and pixel grounding multimodal output11 Oct 2025
- 2025Longitudinal Flow Matching for Trajectory Modeling3 Oct 2025
- 2025MSD-KMamba: Bidirectional Spatial-Aware Multi-Modal 3D Brain Segmentation via Multi-scale Self-Distilled Fusion Strategy28 Sep 2025
- 2025Johnson-Lindenstrauss Lemma Guided Network for Efficient 3D Medical Segmentation26 Sep 2025
- 2025An Anisotropic Cross-View Texture Transfer with Multi-Reference Non-Local Attention for CT Slice Interpolation24 Sep 2025
- 2025nnFilterMatch: A Unified Semi-Supervised Learning Framework with Uncertainty-Aware Pseudo-Label Filtering for Efficient Medical Segmentation24 Sep 2025
- 2025The Missing Piece: A Case for Pre-Training in 3D Medical Object Detection19 Sep 2025
50 newest of 371 All 371 (JSON)
- 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Modelscited by 154
- 2024GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AIcited by 96
- 2023LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matchingcited by 60
- 2025Comprehensive language-image pre-training for 3D medical image understandingcited by 20
- 2025MIMO: A medical vision language model with visual referring multimodal input and pixel grounding multimodal outputcited by 14
- 2024F3OCUS -- Federated Finetuning of Vision-Language Foundation Models with Optimal Client Layer Updating Strategy via Multi-objective Meta-Heuristicscited by 4
- 2025MedBookVQA: A Systematic and Comprehensive Medical Benchmark Derived from Open-Access Bookcited by 2
- 2024MOSMOS: Multi-organ segmentation facilitated by medical report supervisioncited by 1
- 2024MiniGPT-Pancreas: Multimodal Large Language Model for Pancreas Cancer Classification and Detectioncited by 1
- 2025NeuroABench: A Multimodal Evaluation Benchmark for Neurosurgical Anatomy Identificationcited by 0
- 2026ViX-Ray: A Vietnamese Chest X-Ray Dataset for Vision-Language Modelscited by 0
- 2026ViX-Ray: A Vietnamese Chest X-Ray Dataset for Vision-Language Models16 Mar 2026
- 2025NeuroABench: A Multimodal Evaluation Benchmark for Neurosurgical Anatomy Identification7 Dec 2025
- 2025Comprehensive language-image pre-training for 3D medical image understanding16 Oct 2025
- 2025MIMO: A medical vision language model with visual referring multimodal input and pixel grounding multimodal output11 Oct 2025
- 2025MedBookVQA: A Systematic and Comprehensive Medical Benchmark Derived from Open-Access Book1 Jun 2025
- 2024MiniGPT-Pancreas: Multimodal Large Language Model for Pancreas Cancer Classification and Detection20 Dec 2024
- 2024F3OCUS -- Federated Finetuning of Vision-Language Foundation Models with Optimal Client Layer Updating Strategy via Multi-objective Meta-Heuristics17 Nov 2024
- 2024MOSMOS: Multi-organ segmentation facilitated by medical report supervision4 Sep 2024
- 2024GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI6 Aug 2024
- 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Models31 Mar 2024
- 2023LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matching20 Jun 2023
- 2024HiDiff: Hybrid Diffusion Framework for Medical Image Segmentationcited by 13
- 2024MedDiff-FM: A Diffusion-based Foundation Model for Versatile Medical Image Applicationscited by 7
- 2025Longitudinal Flow Matching for Trajectory Modelingcited by 6
- 2025Conditional diffusion model with spatial attention and latent embedding for medical image segmentationcited by 5
- 2025MedCondDiff: Lightweight, Robust, Semantically Guided Diffusion for Medical Image Segmentationcited by 0
- 2026MeDUET: Disentangled Unified Pretraining for 3D Medical Image Synthesis and Analysiscited by 0
- 2026TCAM-Diff: Triplane-Aware Cross-Attention Medical Diffusion Modelcited by 0
- 2026TCAM-Diff: Triplane-Aware Cross-Attention Medical Diffusion Model15 Jul 2026
- 2026MeDUET: Disentangled Unified Pretraining for 3D Medical Image Synthesis and Analysis19 Feb 2026
- 2025MedCondDiff: Lightweight, Robust, Semantically Guided Diffusion for Medical Image Segmentation29 Nov 2025
- 2025Longitudinal Flow Matching for Trajectory Modeling3 Oct 2025
- 2025Conditional diffusion model with spatial attention and latent embedding for medical image segmentation10 Feb 2025
- 2024MedDiff-FM: A Diffusion-based Foundation Model for Versatile Medical Image Applications20 Oct 2024
- 2024HiDiff: Hybrid Diffusion Framework for Medical Image Segmentation3 Jul 2024
- 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 412
- 2024A Comprehensive Survey of Mamba Architectures for Medical Image Analysis: Classification, Segmentation, Restoration and Beyondcited by 16
- 2025Hybrid Transformer-Mamba for Weakly Supervised Volumetric Medical Segmentationcited by 0
- 2026DB-MSMUNet:Dual Branch Multi-scale Mamba UNet for Pancreatic CT Scans Segmentationcited by 0
- 2026DB-MSMUNet:Dual Branch Multi-scale Mamba UNet for Pancreatic CT Scans Segmentation8 Jan 2026
- 2025Hybrid Transformer-Mamba for Weakly Supervised Volumetric Medical Segmentation11 Dec 2025
- 2024A Comprehensive Survey of Mamba Architectures for Medical Image Analysis: Classification, Segmentation, Restoration and Beyond3 Oct 2024
- 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation9 Jan 2024
- 2024MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationalecited by 14
- 2026IBISAgent: Reinforcing Pixel-Level Visual Reasoning in MLLMs for Universal Biomedical Object Referring and Segmentationcited by 10
- 2025MedSG-Bench: A Benchmark for Medical Image Sequences Groundingcited by 8
- 2026IBISAgent: Reinforcing Pixel-Level Visual Reasoning in MLLMs for Universal Biomedical Object Referring and Segmentation6 Jan 2026
- 2025MedSG-Bench: A Benchmark for Medical Image Sequences Grounding17 May 2025
- 2024MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationale18 Apr 2024
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
- 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 682
- 2021The Medical Segmentation Decathloncited by 620
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 444
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
- 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
- 2021TransFuse: Fusing Transformers and CNNs for Medical Image Segmentationcited by 258
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2022Metrics reloaded: Recommendations for image analysis validationcited by 190
- 2022Medical Image Segmentation Review: The success of U-Netcited by 190
- 2022UNETR++: Delving into Efficient and Accurate 3D Medical Image Segmentationcited by 112
12 most cited of 346 All 346 (JSON)
- 2026Unified Multi-Layer Subspace Modeling for Cross-Domain OOD Detection6 Sep 2026
- 2026Uni-Light: An Ultra-Lightweight Framework via Uncertainty-Aware Knowledge Distillation for Brain Tumour Segmentation6 Sep 2026
- 2026B-MIM: Biased Masked Image Modeling for Generalizable Segmentation of Fine-Grained Anatomical Structures25 Aug 2026
- 2026Inference-Time Orthogonal Seeding Enables Geometry-Aligned 3D Organ Segmentation for Slice-Propagation Methods12 Aug 2026
- 2026Robust Low-Tubal-Rank Tensor Completion under Cross-Concentrated Sampling4 Aug 2026
- 2026Test-time Adaptation of Pelvic Bone Segmentation Models via Dynamic Reliability-Guided1 Aug 2026
- 2026Secure-by-Disguise: A Systematic Evaluation of Image Disguising for Confidential Medical Image Modeling9 Jul 2026
- 2026Specificity- and Calibration-Aware Breast Ultrasound Segmentation via Entropy-Guided Boundary Supervision21 Jun 2026
- 2026vesselFM-CT: Segmenting All Blood Vessels in CT Images for System-Level Cardiovascular Analysis8 Jun 2026
- 2026Vol-Mark: A Watermark for 3D Medical Volume Data Via Cubic Difference Expansion and Contrastive Learning6 May 2026
- 2026DALight-3D: A Lightweight 3D U-Net for Brain Tumor Segmentation from Multi-Modal MRI6 May 2026
- 2026Robustness Evaluation of a Foundation Segmentation Model Under Simulated Domain Shifts in Abdominal CT: Implications for Health Digital Twin Deployment28 Apr 2026
12 newest of 346 All 346 (JSON)