mlsanityData to 7 Oct 2026

FreeTumor: Advance Tumor Segmentation via Large-Scale Tumor Synthesis

arXiv 2406.01264 ↗First posted 3 Jun 2024cs.CVcited by 14

Not on the map. Why?

Abstract (arXiv)

AI-driven tumor analysis has garnered increasing attention in healthcare. However, its progress is significantly hindered by the lack of annotated tumor cases, which requires radiologists to invest a lot of effort in collecting and annotation. In this paper, we introduce a highly practical solution for robust tumor synthesis and segmentation, termed FreeTumor, which refers to annotation-free synthetic tumors and our desire to free patients that suffering from tumors. Instead of pursuing sophisticated technical synthesis modules, we aim to design a simple yet effective tumor synthesis paradigm to unleash the power of large-scale data. Specifically, FreeTumor advances existing methods mainly from three aspects: (1) Existing methods only leverage small-scale labeled data for synthesis training, which limits their ability to generalize well on unseen data from different sources. To this end, we introduce the adversarial training strategy to leverage large-scale and diversified unlabeled data in synthesis training, significantly improving tumor synthesis. (2) Existing methods largely ignored the negative impact of low-quality synthetic tumors in segmentation training. Thus, we employ an adversarial-based discriminator to automatically filter out the low-quality synthetic tumors, which effectively alleviates their negative impact. (3) Existing methods only used hundreds of cases in tumor segmentation. In FreeTumor, we investigate the data scaling law in tumor segmentation by scaling up the dataset to 11k cases. Extensive experiments demonstrate the superiority of FreeTumor, e.g., on three tumor segmentation benchmarks, average +8.9% DSC over the baseline that only using real tumors and +6.6% DSC over the state-of-the-art tumor synthesis method. Code will be available.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 66 of its 90 references that are in the map. First posted on arXiv 3 Jun 2024.

Builds on

66 of 90 references.

References · 66

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2022Classifier-Free Diffusion Guidancecited by 5,717
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  8. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  9. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  10. 2022Video Diffusion Modelscited by 2,280
  11. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  12. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
38 more
  1. 2017Random Erasing Data Augmentationcited by 1,235
  2. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
  3. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
  4. 2016Playing for Data: Ground Truth from Computer Gamescited by 816
  5. 2023Adversarial Diffusion Distillationcited by 741
  6. 2021The Medical Segmentation Decathloncited by 620
  7. 2020Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentationcited by 595
  8. 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 504
  9. 2022Diffusion Models for Adversarial Purificationcited by 469
  10. 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
  11. 2022AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentationcited by 347
  12. 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 307
  13. 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 269
  14. 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
  15. 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 235
  16. 2022Diffusion Models for Medical Anomaly Detectioncited by 231
  17. 2020A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promisescited by 230
  18. 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
  19. 2020AbdomenCT-1K: Is Abdominal Organ Segmentation A Solved Problem?cited by 222
  20. 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 191
  21. 2021ST++: Make Self-training Work Better for Semi-supervised Semantic Segmentationcited by 184
  22. 2022Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentationcited by 177
  23. 2022Fake it till you make it: Learning transferable representations from synthetic ImageNet clonescited by 171
  24. 2020Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentationcited by 134
  25. 2016Multivariate mixture model for myocardium segmentation combining multi-source imagescited by 133
  26. 2018Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networkscited by 131
  27. 2023MedSegDiff-V2: Diffusion based Medical Image Segmentation with Transformercited by 124
  28. 2019Synergistic Image and Feature Adaptation: Towards Cross-Modality Domain Adaptation for Medical Image Segmentationcited by 121
  29. 2023The KiTS21 Challenge: Automatic segmentation of kidneys, renal tumors, and renal cysts in corticomedullary-phase CTcited by 101
  30. 2021Learning to See by Looking at Noisecited by 92
  31. 2024VoCo: A Simple-yet-Effective Volume Contrastive Learning Framework for 3D Medical Image Analysiscited by 71
  32. 2022Adversarial Style Augmentation for Domain Generalized Urban-Scene Segmentationcited by 69
  33. 2023Freestyle Layout-to-Image Synthesiscited by 67
  34. 2022MR Image Denoising and Super-Resolution Using Regularized Reverse Diffusioncited by 66
  35. 2024Towards Generalizable Tumor Synthesiscited by 65
  36. 2023FreeMask: Synthetic Images with Dense Annotations Make Stronger Segmentation Modelscited by 61
  37. 2023Label-Free Liver Tumor Segmentationcited by 56
  38. 2023AbdomenAtlas-8K: Annotating 8,000 CT Volumes for Multi-Organ Segmentation in Three Weekscited by 52

50 most cited of 66 All 66 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 5; 2026: 2.

14 papers.

Sort:

By area: