AbdomenAtlas: A Large-Scale, Detailed-Annotated, & Multi-Center Dataset for Efficient Transfer Learning and Open Algorithmic Benchmarking
Not on the map. Why?
Abstract (arXiv)
We introduce the largest abdominal CT dataset (termed AbdomenAtlas) of 20,460 three-dimensional CT volumes sourced from 112 hospitals across diverse populations, geographies, and facilities. AbdomenAtlas provides 673K high-quality masks of anatomical structures in the abdominal region annotated by a team of 10 radiologists with the help of AI algorithms. We start by having expert radiologists manually annotate 22 anatomical structures in 5,246 CT volumes. Following this, a semi-automatic annotation procedure is performed for the remaining CT volumes, where radiologists revise the annotations predicted by AI, and in turn, AI improves its predictions by learning from revised annotations. Such a large-scale, detailed-annotated, and multi-center dataset is needed for two reasons. Firstly, AbdomenAtlas provides important resources for AI development at scale, branded as large pre-trained models, which can alleviate the annotation workload of expert radiologists to transfer to broader clinical applications. Secondly, AbdomenAtlas establishes a large-scale benchmark for evaluating AI algorithms -- the more data we use to test the algorithms, the better we can guarantee reliable performance in complex clinical scenarios. An ISBI & MICCAI challenge named BodyMaps: Towards 3D Atlas of Human Body was launched using a subset of our AbdomenAtlas, aiming to stimulate AI innovation and to benchmark segmentation accuracy, inference efficiency, and domain generalizability. We hope our AbdomenAtlas can set the stage for larger-scale clinical trials and offer exceptional opportunities to practitioners in the medical imaging community. Codes, models, and datasets are available at https://www.zongweiz.com/dataset
Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). Builds on 44 of its 69 references that are in the map. First posted on arXiv 23 Jul 2024.
Builds on
44 of 69 references.
References · 44
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
- 2021The Medical Segmentation Decathloncited by 620
- 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 504
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
- 20183D MRI brain tumor segmentation using autoencoder regularizationcited by 324
- 2019Med3D: Transfer Learning for 3D Medical Image Analysiscited by 282
32 more
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
- 2020AbdomenCT-1K: Is Abdominal Organ Segmentation A Solved Problem?cited by 222
- 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
- 2019Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysiscited by 159
- 2015DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentationcited by 158
- 2022Data Determines Distributional Robustness in Contrastive Language Image Pre-training (CLIP)cited by 137
- 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2024Merlin: A Computed Tomography Vision-Language Foundation Model and Datasetcited by 97
- 2023STU-Net: Scalable and Transferable Medical Image Segmentation Models Empowered by Large-Scale Supervised Pre-trainingcited by 96
- 2020DoDNet: Learning to segment multi-organ and tumors from multiple partially labeled datasetscited by 94
- 2024Towards Generalizable Tumor Synthesiscited by 65
- 2023Label-Free Liver Tumor Segmentationcited by 56
- 2021UniMiSS: Universal Medical Self-Supervised Learning via Breaking Dimensionality Barriercited by 55
- 2023Unleashing the Strengths of Unlabeled Data in Pan-cancer Abdominal Organ Quantification: the FLARE22 Challengecited by 50
- 2018Abdominal multi-organ segmentation with organ-attention networks and statistical fusioncited by 46
- 2019Learning Fixed Points in Generative Adversarial Networks: From Image-to-Image Translation to Disease Detection and Localizationcited by 38
- 2021SQUID: Deep Feature In-Painting for Unsupervised Anomaly Detectioncited by 34
- 2024Universal and Extensible Language-Vision Models for Organ Segmentation and Tumor Detection from Abdominal Computed Tomographycited by 31
- 2024From Pixel to Cancer: Cellular Automata in Computed Tomographycited by 20
- 2023Towards Unifying Anatomy Segmentation: Automated Generation of a Full-body CT Dataset via Knowledge Aggregation and Anatomical Guidelinescited by 17
- 2023Early Detection and Localization of Pancreatic Cancer by Label-Free Tumor Synthesiscited by 17
- 2024Shortcut Learning in Medical Image Segmentationcited by 16
- 2023Disruptive Autoencoders: Leveraging Low-level features for 3D Medical Image Pre-trainingcited by 15
- 2022Synthetic Tumors Make AI Segment Tumors Bettercited by 14
- 2024Exploiting Structural Consistency of Chest Anatomy for Unsupervised Anomaly Detection in Radiography Imagescited by 13
- 2024Towards a Comprehensive, Efficient and Promptable Anatomic Structure Segmentation Model using 3D Whole-body CT Scanscited by 10
- 2023Acquiring Weak Annotations for Tumor Localization in Temporal and Volumetric Datacited by 9
- 2023Synthetic Data as Validationcited by 9
- 2024Leveraging AI Predicted and Expert Revised Annotations in Interactive Segmentation: Continual Tuning or Full Training?cited by 9
- 2022Fighting the scanner effect in brain MRI segmentation with a progressive level-of-detail network trained on multi-site datacited by 5
- 2023A-Eval: A Benchmark for Cross-Dataset Evaluation of Abdominal Multi-Organ Segmentationcited by 4
Built on by
Citing papers per year: 2024: 9; 2025: 35; 2026: 20.
64 papers.
Sort:
By area:
- 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Modelscited by 144
- 2025RadGPT: Constructing 3D Image-Text Tumor Datasetscited by 34
- 2024Touchstone Benchmark: Are We on the Right Way for Evaluating AI Algorithms for Medical Segmentation?cited by 31
- 2024Learning General-Purpose Biomedical Volume Representations using Randomized Synthesiscited by 27
- 2025Primus: Enforcing Attention Usage for 3D Medical Image Segmentationcited by 22
- 2024Automatic Organ and Pan-cancer Segmentation in Abdomen CT: the FLARE 2023 Challengecited by 20
- 2025PanTS: The Pancreatic Tumor Segmentation Datasetcited by 15
- 2024ASIGN: An Anatomy-aware Spatial Imputation Graphic Network for 3D Spatial Transcriptomicscited by 13
- 2025MedSegFactory: Text-Guided Generation of Medical Image-Mask Pairscited by 13
- 2025Raptor: Scalable Train-Free Embeddings for 3D Medical Volumes Leveraging Pretrained 2D Foundation Modelscited by 13
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Datacited by 13
- 2024Analyzing Tumors by Synthesiscited by 11
38 more
- 2025Learning Segmentation from Radiology Reportscited by 11
- 2025Scaling Artificial Intelligence for Multi-Tumor Early Detection with More Reports, Fewer Maskscited by 8
- 2025Calibration and Uncertainty for multiRater Volume Assessment in multiorgan Segmentation (CURVAS) challenge resultscited by 7
- 2025MSWAL: 3D Multi-class Segmentation of Whole Abdominal Lesions Datasetcited by 6
- 2025Are Pixel-Wise Metrics Reliable for Sparse-View Computed Tomography Reconstruction?cited by 6
- 2025Scaling Self-Supervised and Cross-Modal Pretraining for Volumetric CT Transformerscited by 6
- 2025RadImageNet-VQA: A Large-Scale CT and MRI Dataset for Radiologic Visual Question Answeringcited by 6
- 2026Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Modelscited by 6
- 2025Expectation-Maximization as the Engine of Scalable Medical Intelligencecited by 5
- 2025X-LRM: X-ray Large Reconstruction Model for Extremely Sparse-View Computed Tomography Recovery in One Secondcited by 5
- 2025X-GRM: Large Gaussian Reconstruction Model for Sparse-view X-rays to Computed Tomographycited by 5
- 2025MedNeXt-v2: Scaling 3D ConvNeXts for Large-Scale Supervised Representation Learning in Medical Image Segmentationcited by 5
- 2024Label Critic: Design Data Before Modelscited by 4
- 2024Efficient MedSAMs: Segment Anything in Medical Images on Laptopcited by 4
- 2026RadThinking: A Dataset for Longitudinal Clinical Reasoning in Radiologycited by 4
- 2025Mamba Goes HoME: Hierarchical Soft Mixture-of-Experts for 3D Medical Image Segmentationcited by 3
- 2025See More, Change Less: Anatomy-Aware Diffusion for Contrast Enhancementcited by 3
- 2024Beyond Adapter Retrieval: Latent Geometry-Preserving Composition via Sparse Task Projectioncited by 2
- 2025The Missing Piece: A Case for Pre-Training in 3D Medical Object Detectioncited by 2
- 2025Are Video Models Emerging as Zero-Shot Learners and Reasoners in Medical Imaging?cited by 2
- 2025TAP-CT: 3D Task-Agnostic Pretraining of Computed Tomography Foundation Modelscited by 2
- 2026Large-Scale Label Quality Assessment for Medical Segmentation via a Vision-Language Judge and Synthetic Datacited by 2
- 2026MedTri: A Platform for Structured Medical Report Normalization to Enhance Vision-Language Pretrainingcited by 2
- 2026Learning Clinical Representations Under Systematic Distribution Shiftcited by 2
- 2026Discriminative Representation Learning for Clinical Predictioncited by 2
- 2025Boosting 3D Liver Shape Datasets with Diffusion Models and Implicit Neural Representationscited by 1
- 2025Patient-Specific Autoregressive Models for Organ Motion Prediction in Radiotherapycited by 1
- 2025State of Abdominal CT Datasets: A Critical Review of Bias, Clinical Relevance, and Real-world Applicabilitycited by 1
- 2025Cohort-Aware Agents for Individualized Lung Cancer Risk Prediction Using a Retrieval-Augmented Model Selection Frameworkcited by 1
- 2026Developing Foundation Models for Universal Segmentation from 3D Whole-Body Positron Emission Tomographycited by 1
- 2026Uncertainty-Aware Foundation Models for Clinical Datacited by 1
- 2026GenMed: A Pairwise Generative Reformulation of Medical Diagnostic Taskscited by 1
- 2024Zero-shot 3D Segmentation of Abdominal Organs in CT Scans Using Segment Anything Model 2: Adapting Video Tracking Capabilities for 3D Medical Imagingcited by 0
- 2025AdaViT: Adaptive Vision Transformer for Flexible Pretrain and Finetune with Variable 3D Medical Image Modalitiescited by 0
- 2025BoundarySeg:Boundary-Aware Multi-Task Learning for Semi-Supervised 3D Medical Image Segmentation with Limited Unlabeled Datacited by 0
- 2025Good Enough? An Investigation on the Impact of Label Quality in Large-Scale Medical Datasetscited by 0
- 2025ShapeKitcited by 0
- 2025RAPS-3D: Efficient interactive segmentation for 3D radiological imagingcited by 0
50 most cited of 64 All 64 (JSON)
- 2026Merlin Plus: A Large-Scale, Multi-Cancer, Image-Mask-Report Dataset29 Sep 2026
- 2026RT-Super: Learning Tumor Segmentation from Longitudinal Images and Reports28 Sep 2026
- 2026KneePreM: Towards 3D Knee MRI Foundation Models via Large-Scale Unlabeled Pretraining and Label-Efficient Fine-Tuning25 Sep 2026
- 2026Report Supervision27 Aug 2026
- 2026Lesion Detection in CT with Frozen Self-Distilled Features: SALT, a Spatially Adaptive Label-Guided Temperature5 Aug 2026
- 2026SLIP: Segmentation with Low-latency Interactive Prompting for 3D Medical Images24 Jul 2026
- 2026MorphologyFM: A Foundation Model for Morphology-Aware Representation Learning from ECG and Pulse Oximetry Waveforms3 Jul 2026
- 2026Toward Training-Free Zero-Shot Anomaly Detection in 3D Medical Images: A Batch-Based Approach Using 2D Foundation Models17 Jun 2026
- 2026Beyond Masks: The Case for Medical Image Parsing12 May 2026
- 2026RadThinking: A Dataset for Longitudinal Clinical Reasoning in Radiology11 May 2026
- 2026GenMed: A Pairwise Generative Reformulation of Medical Diagnostic Tasks11 May 2026
- 2026MedConcept: Unsupervised Concept Discovery for Interpretability in Medical VLMs13 Apr 2026
38 more
- 2026Uncertainty-Aware Foundation Models for Clinical Data5 Apr 2026
- 2026Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Models26 Mar 2026
- 2026Discriminative Representation Learning for Clinical Prediction21 Mar 2026
- 2026ILV: Iterative Latent Volumes for Fast and Accurate Sparse-View CT Reconstruction16 Mar 2026
- 2026Developing Foundation Models for Universal Segmentation from 3D Whole-Body Positron Emission Tomography12 Mar 2026
- 2026Learning Clinical Representations Under Systematic Distribution Shift7 Mar 2026
- 2026MedTri: A Platform for Structured Medical Report Normalization to Enhance Vision-Language Pretraining25 Feb 2026
- 2026Large-Scale Label Quality Assessment for Medical Segmentation via a Vision-Language Judge and Synthetic Data20 Jan 2026
- 2025MedNeXt-v2: Scaling 3D ConvNeXts for Large-Scale Supervised Representation Learning in Medical Image Segmentation19 Dec 2025
- 2025RadImageNet-VQA: A Large-Scale CT and MRI Dataset for Radiologic Visual Question Answering19 Dec 2025
- 2025See More, Change Less: Anatomy-Aware Diffusion for Contrast Enhancement8 Dec 2025
- 2025TAP-CT: 3D Task-Agnostic Pretraining of Computed Tomography Foundation Models30 Nov 2025
- 2025MedVision: Benchmarking Quantitative Medical Image Analysis24 Nov 2025
- 2025Scaling Self-Supervised and Cross-Modal Pretraining for Volumetric CT Transformers21 Nov 2025
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Data16 Oct 2025
- 2025Scaling Artificial Intelligence for Multi-Tumor Early Detection with More Reports, Fewer Masks16 Oct 2025
- 2025Are Video Models Emerging as Zero-Shot Learners and Reasoners in Medical Imaging?11 Oct 2025
- 2025Shaken or Stirred? An Analysis of MetaFormer's Token Mixing for Medical Imaging7 Oct 2025
- 2025The Missing Piece: A Case for Pre-Training in 3D Medical Object Detection19 Sep 2025
- 2025Cohort-Aware Agents for Individualized Lung Cancer Risk Prediction Using a Retrieval-Augmented Model Selection Framework20 Aug 2025
- 2025State of Abdominal CT Datasets: A Critical Review of Bias, Clinical Relevance, and Real-world Applicability19 Aug 2025
- 2025Toward Using Machine Learning as a Shape Quality Metric for Liver Point Cloud Generation4 Aug 2025
- 2025Raptor: Scalable Train-Free Embeddings for 3D Medical Volumes Leveraging Pretrained 2D Foundation Models11 Jul 2025
- 2025RAPS-3D: Efficient interactive segmentation for 3D radiological imaging10 Jul 2025
- 2025Mamba Goes HoME: Hierarchical Soft Mixture-of-Experts for 3D Medical Image Segmentation8 Jul 2025
- 2025Learning Segmentation from Radiology Reports8 Jul 2025
- 2025PanTS: The Pancreatic Tumor Segmentation Dataset2 Jul 2025
- 2025ShapeKit30 Jun 2025
- 2025Are Pixel-Wise Metrics Reliable for Sparse-View Computed Tomography Reconstruction?2 Jun 2025
- 2025Good Enough? An Investigation on the Impact of Label Quality in Large-Scale Medical Datasets27 May 2025
- 2025X-GRM: Large Gaussian Reconstruction Model for Sparse-view X-rays to Computed Tomography21 May 2025
- 2025Patient-Specific Autoregressive Models for Organ Motion Prediction in Radiotherapy17 May 2025
- 2025BoundarySeg:Boundary-Aware Multi-Task Learning for Semi-Supervised 3D Medical Image Segmentation with Limited Unlabeled Data14 May 2025
- 2025Calibration and Uncertainty for multiRater Volume Assessment in multiorgan Segmentation (CURVAS) challenge results13 May 2025
- 2025Boosting 3D Liver Shape Datasets with Diffusion Models and Implicit Neural Representations28 Apr 2025
- 2025MedSegFactory: Text-Guided Generation of Medical Image-Mask Pairs9 Apr 2025
- 2025AdaViT: Adaptive Vision Transformer for Flexible Pretrain and Finetune with Variable 3D Medical Image Modalities4 Apr 2025
- 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Models18 Mar 2025
50 newest of 64 All 64 (JSON)
- 2026Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Modelscited by 6
- 2026MedTri: A Platform for Structured Medical Report Normalization to Enhance Vision-Language Pretrainingcited by 2
- 2025MedVision: Benchmarking Quantitative Medical Image Analysiscited by 0
- 2026MedConcept: Unsupervised Concept Discovery for Interpretability in Medical VLMscited by 0
- 2026MedConcept: Unsupervised Concept Discovery for Interpretability in Medical VLMs13 Apr 2026
- 2026Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Models26 Mar 2026
- 2026MedTri: A Platform for Structured Medical Report Normalization to Enhance Vision-Language Pretraining25 Feb 2026
- 2025MedVision: Benchmarking Quantitative Medical Image Analysis24 Nov 2025
- 2025RadGPT: Constructing 3D Image-Text Tumor Datasetscited by 34
- 2024Touchstone Benchmark: Are We on the Right Way for Evaluating AI Algorithms for Medical Segmentation?cited by 31
- 2024Learning General-Purpose Biomedical Volume Representations using Randomized Synthesiscited by 27
- 2025Primus: Enforcing Attention Usage for 3D Medical Image Segmentationcited by 22
- 2024Automatic Organ and Pan-cancer Segmentation in Abdomen CT: the FLARE 2023 Challengecited by 20
- 2025PanTS: The Pancreatic Tumor Segmentation Datasetcited by 15
- 2024ASIGN: An Anatomy-aware Spatial Imputation Graphic Network for 3D Spatial Transcriptomicscited by 13
- 2025MedSegFactory: Text-Guided Generation of Medical Image-Mask Pairscited by 13
- 2025Raptor: Scalable Train-Free Embeddings for 3D Medical Volumes Leveraging Pretrained 2D Foundation Modelscited by 13
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Datacited by 13
- 2024Analyzing Tumors by Synthesiscited by 11
- 2025Learning Segmentation from Radiology Reportscited by 11
12 most cited of 56 All 56 (JSON)
- 2026Merlin Plus: A Large-Scale, Multi-Cancer, Image-Mask-Report Dataset29 Sep 2026
- 2026RT-Super: Learning Tumor Segmentation from Longitudinal Images and Reports28 Sep 2026
- 2026KneePreM: Towards 3D Knee MRI Foundation Models via Large-Scale Unlabeled Pretraining and Label-Efficient Fine-Tuning25 Sep 2026
- 2026Report Supervision27 Aug 2026
- 2026Lesion Detection in CT with Frozen Self-Distilled Features: SALT, a Spatially Adaptive Label-Guided Temperature5 Aug 2026
- 2026SLIP: Segmentation with Low-latency Interactive Prompting for 3D Medical Images24 Jul 2026
- 2026MorphologyFM: A Foundation Model for Morphology-Aware Representation Learning from ECG and Pulse Oximetry Waveforms3 Jul 2026
- 2026Toward Training-Free Zero-Shot Anomaly Detection in 3D Medical Images: A Batch-Based Approach Using 2D Foundation Models17 Jun 2026
- 2026Beyond Masks: The Case for Medical Image Parsing12 May 2026
- 2026RadThinking: A Dataset for Longitudinal Clinical Reasoning in Radiology11 May 2026
- 2026GenMed: A Pairwise Generative Reformulation of Medical Diagnostic Tasks11 May 2026
- 2026Uncertainty-Aware Foundation Models for Clinical Data5 Apr 2026
12 newest of 56 All 56 (JSON)