FreeTumor: Advance Tumor Segmentation via Large-Scale Tumor Synthesis
Not on the map. Why?
Abstract (arXiv)
AI-driven tumor analysis has garnered increasing attention in healthcare. However, its progress is significantly hindered by the lack of annotated tumor cases, which requires radiologists to invest a lot of effort in collecting and annotation. In this paper, we introduce a highly practical solution for robust tumor synthesis and segmentation, termed FreeTumor, which refers to annotation-free synthetic tumors and our desire to free patients that suffering from tumors. Instead of pursuing sophisticated technical synthesis modules, we aim to design a simple yet effective tumor synthesis paradigm to unleash the power of large-scale data. Specifically, FreeTumor advances existing methods mainly from three aspects: (1) Existing methods only leverage small-scale labeled data for synthesis training, which limits their ability to generalize well on unseen data from different sources. To this end, we introduce the adversarial training strategy to leverage large-scale and diversified unlabeled data in synthesis training, significantly improving tumor synthesis. (2) Existing methods largely ignored the negative impact of low-quality synthetic tumors in segmentation training. Thus, we employ an adversarial-based discriminator to automatically filter out the low-quality synthetic tumors, which effectively alleviates their negative impact. (3) Existing methods only used hundreds of cases in tumor segmentation. In FreeTumor, we investigate the data scaling law in tumor segmentation by scaling up the dataset to 11k cases. Extensive experiments demonstrate the superiority of FreeTumor, e.g., on three tumor segmentation benchmarks, average +8.9% DSC over the baseline that only using real tumors and +6.6% DSC over the state-of-the-art tumor synthesis method. Code will be available.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 66 of its 90 references that are in the map. First posted on arXiv 3 Jun 2024.
Builds on
66 of 90 references.
References · 66
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2022Video Diffusion Modelscited by 2,280
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
38 more
- 2017Random Erasing Data Augmentationcited by 1,235
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
- 2016Playing for Data: Ground Truth from Computer Gamescited by 816
- 2023Adversarial Diffusion Distillationcited by 741
- 2021The Medical Segmentation Decathloncited by 620
- 2020Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentationcited by 595
- 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 504
- 2022Diffusion Models for Adversarial Purificationcited by 469
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
- 2022AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentationcited by 347
- 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 307
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 269
- 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
- 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 235
- 2022Diffusion Models for Medical Anomaly Detectioncited by 231
- 2020A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promisescited by 230
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
- 2020AbdomenCT-1K: Is Abdominal Organ Segmentation A Solved Problem?cited by 222
- 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 191
- 2021ST++: Make Self-training Work Better for Semi-supervised Semantic Segmentationcited by 184
- 2022Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentationcited by 177
- 2022Fake it till you make it: Learning transferable representations from synthetic ImageNet clonescited by 171
- 2020Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentationcited by 134
- 2016Multivariate mixture model for myocardium segmentation combining multi-source imagescited by 133
- 2018Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networkscited by 131
- 2023MedSegDiff-V2: Diffusion based Medical Image Segmentation with Transformercited by 124
- 2019Synergistic Image and Feature Adaptation: Towards Cross-Modality Domain Adaptation for Medical Image Segmentationcited by 121
- 2023The KiTS21 Challenge: Automatic segmentation of kidneys, renal tumors, and renal cysts in corticomedullary-phase CTcited by 101
- 2021Learning to See by Looking at Noisecited by 92
- 2024VoCo: A Simple-yet-Effective Volume Contrastive Learning Framework for 3D Medical Image Analysiscited by 71
- 2022Adversarial Style Augmentation for Domain Generalized Urban-Scene Segmentationcited by 69
- 2023Freestyle Layout-to-Image Synthesiscited by 67
- 2022MR Image Denoising and Super-Resolution Using Regularized Reverse Diffusioncited by 66
- 2024Towards Generalizable Tumor Synthesiscited by 65
- 2023FreeMask: Synthetic Images with Dense Annotations Make Stronger Segmentation Modelscited by 61
- 2023Label-Free Liver Tumor Segmentationcited by 56
- 2023AbdomenAtlas-8K: Annotating 8,000 CT Volumes for Multi-Organ Segmentation in Three Weekscited by 52
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2024: 7; 2025: 5; 2026: 2.
14 papers.
Sort:
By area:
- 2024MAISI: Medical AI for Synthetic Imagingcited by 86
- 2024Large-Scale 3D Medical Image Pre-training with Geometric Context Priorscited by 34
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Datacited by 13
- 2025UniBiomed: A Universal Foundation Model for Grounded Biomedical Image Interpretationcited by 10
- 2025Learning Patient-Specific Disease Dynamics with Latent Flow Matching for Longitudinal Imaging Generationcited by 8
- 2024Can Medical Vision-Language Pre-training Succeed with Purely Synthetic Data?cited by 6
- 2024Optimizing Synthetic Data for Enhanced Pancreatic Tumor Segmentationcited by 3
- 2024MRGen: Segmentation Data Engine for Underrepresented MRI Modalitiescited by 3
- 2024AutoPET Challenge: Tumour Synthesis for Data Augmentationcited by 2
- 20263D-LLDM: Label-Guided 3D Latent Diffusion Model for Improving High-Resolution Synthetic MR Imaging in Hepatic Structure Segmentationcited by 2
- 2024Diff4MMLiTS: Advanced Multimodal Liver Tumor Segmentation via Diffusion-Based Image Synthesis and Alignmentcited by 1
- 2025Advancing Generalizable Tumor Segmentation with Anomaly-Aware Open-Vocabulary Attention Maps and Frozen Foundation Diffusion Modelscited by 1
- 2026Foundation VAEs for 3D CT Reconstruction, Augmentation, and Generation29 May 2026
- 20263D-LLDM: Label-Guided 3D Latent Diffusion Model for Improving High-Resolution Synthetic MR Imaging in Hepatic Structure Segmentation25 Mar 2026
- 2025Learning Patient-Specific Disease Dynamics with Latent Flow Matching for Longitudinal Imaging Generation9 Dec 2025
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Data16 Oct 2025
- 2025TumorGen: Boundary-Aware Tumor-Mask Synthesis with Rectified Flow Matching30 May 2025
- 2025Advancing Generalizable Tumor Segmentation with Anomaly-Aware Open-Vocabulary Attention Maps and Frozen Foundation Diffusion Models5 May 2025
- 2025UniBiomed: A Universal Foundation Model for Grounded Biomedical Image Interpretation30 Apr 2025
- 2024Diff4MMLiTS: Advanced Multimodal Liver Tumor Segmentation via Diffusion-Based Image Synthesis and Alignment29 Dec 2024
- 2024MRGen: Segmentation Data Engine for Underrepresented MRI Modalities4 Dec 2024
- 2024Can Medical Vision-Language Pre-training Succeed with Purely Synthetic Data?17 Oct 2024
- 2024Large-Scale 3D Medical Image Pre-training with Geometric Context Priors13 Oct 2024
- 2024MAISI: Medical AI for Synthetic Imaging13 Sep 2024
2 more
- 2024MAISI: Medical AI for Synthetic Imagingcited by 86
- 2025Learning Patient-Specific Disease Dynamics with Latent Flow Matching for Longitudinal Imaging Generationcited by 8
- 20263D-LLDM: Label-Guided 3D Latent Diffusion Model for Improving High-Resolution Synthetic MR Imaging in Hepatic Structure Segmentationcited by 2
- 2024Diff4MMLiTS: Advanced Multimodal Liver Tumor Segmentation via Diffusion-Based Image Synthesis and Alignmentcited by 1
- 2025Advancing Generalizable Tumor Segmentation with Anomaly-Aware Open-Vocabulary Attention Maps and Frozen Foundation Diffusion Modelscited by 1
- 2025TumorGen: Boundary-Aware Tumor-Mask Synthesis with Rectified Flow Matchingcited by 0
- 20263D-LLDM: Label-Guided 3D Latent Diffusion Model for Improving High-Resolution Synthetic MR Imaging in Hepatic Structure Segmentation25 Mar 2026
- 2025Learning Patient-Specific Disease Dynamics with Latent Flow Matching for Longitudinal Imaging Generation9 Dec 2025
- 2025TumorGen: Boundary-Aware Tumor-Mask Synthesis with Rectified Flow Matching30 May 2025
- 2025Advancing Generalizable Tumor Segmentation with Anomaly-Aware Open-Vocabulary Attention Maps and Frozen Foundation Diffusion Models5 May 2025
- 2024Diff4MMLiTS: Advanced Multimodal Liver Tumor Segmentation via Diffusion-Based Image Synthesis and Alignment29 Dec 2024
- 2024MAISI: Medical AI for Synthetic Imaging13 Sep 2024
- 2024Large-Scale 3D Medical Image Pre-training with Geometric Context Priorscited by 34
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Datacited by 13
- 2025UniBiomed: A Universal Foundation Model for Grounded Biomedical Image Interpretationcited by 10
- 2024Optimizing Synthetic Data for Enhanced Pancreatic Tumor Segmentationcited by 3
- 2024MRGen: Segmentation Data Engine for Underrepresented MRI Modalitiescited by 3
- 2024AutoPET Challenge: Tumour Synthesis for Data Augmentationcited by 2
- 2026Foundation VAEs for 3D CT Reconstruction, Augmentation, and Generationcited by 1
- 2026Foundation VAEs for 3D CT Reconstruction, Augmentation, and Generation29 May 2026
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Data16 Oct 2025
- 2025UniBiomed: A Universal Foundation Model for Grounded Biomedical Image Interpretation30 Apr 2025
- 2024MRGen: Segmentation Data Engine for Underrepresented MRI Modalities4 Dec 2024
- 2024Large-Scale 3D Medical Image Pre-training with Geometric Context Priors13 Oct 2024
- 2024AutoPET Challenge: Tumour Synthesis for Data Augmentation12 Sep 2024
- 2024Optimizing Synthetic Data for Enhanced Pancreatic Tumor Segmentation27 Jul 2024