mlsanityData to 7 Oct 2026

Free Lunch in Medical Image Foundation Model Pre-training via Randomized Synthesis and Disentanglement

arXiv 2602.12317 ↗First posted 12 Feb 2026q-bio.QM cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Medical image foundation models (MIFMs) have demonstrated remarkable potential for a wide range of clinical tasks, yet their development is constrained by the scarcity, heterogeneity, and high cost of large-scale annotated datasets. Here, we propose RaSD (Randomized Synthesis and Disentanglement), a scalable framework for pre-training MIFMs entirely on synthetic data. By modeling anatomical structures and appearance variations with randomized Gaussian distributions, RaSD exposes models to sufficient multi-scale structural and appearance perturbations, forcing them to rely on invariant and task-relevant anatomical cues rather than dataset-specific textures, thereby enabling robust and transferable representation learning. We pre-trained RaSD on 1.2 million 3D volumes and 9.6 million 2D images, and extensively evaluated the resulting models across 6 imaging modalities, 48 datasets, and 56 downstream tasks. Across all evaluated downstream tasks, RaSD consistently outperforms training-from-scratch models, achieves the best performance on 17 tasks, and remains comparable to models pre-trained on large real datasets in most others. These results demonstrate that the capacity of synthetic data alone to drive robust representation learning. Our findings establish a paradigm shift in medical AI, demonstrating that synthetic data can serve as a "free lunch" for scalable, privacy-preserving, and clinically generalizable foundation models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 87 references that are in the map. First posted on arXiv 12 Feb 2026.

Builds on

37 of 87 references.

References · 37

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  5. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  6. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
  7. 2021The Medical Segmentation Decathloncited by 620
  8. 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 597
  9. 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 507
  10. 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
  11. 2022MONAI: An open-source framework for deep learning in healthcarecited by 438
  12. 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
25 more
  1. 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 307
  2. 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 235
  3. 2016Gland Segmentation in Colon Histology Images: The GlaS Challenge Contestcited by 203
  4. 2016Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challengecited by 198
  5. 2020SynthMorph: learning contrast-invariant registration without acquired imagescited by 137
  6. 2016Multivariate mixture model for myocardium segmentation combining multi-source imagescited by 133
  7. 2020VerSe: A Vertebrae Labelling and Segmentation Benchmark for Multi-detector CT Imagescited by 111
  8. 2023Scaling Laws of Synthetic Images for Model Training ... for Nowcited by 107
  9. 2018MILD-Net: Minimal Information Loss Dilated Network for Gland Instance Segmentation in Colon Histology Imagescited by 87
  10. 2022VinDr-Mammo: A large-scale benchmark dataset for computer-aided diagnosis in full-field digital mammographycited by 83
  11. 2024Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directionscited by 77
  12. 2024VoCo: A Simple-yet-Effective Volume Contrastive Learning Framework for 3D Medical Image Analysiscited by 71
  13. 2023LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matchingcited by 60
  14. 2024A Multimodal Vision Foundation Model for Clinical Dermatologycited by 49
  15. 2023Geometric Visual Similarity Learning in 3D Medical Image Self-supervised Pre-trainingcited by 36
  16. 2024Mammo-CLIP: A Vision Language Foundation Model to Enhance Data Efficiency and Robustness in Mammographycited by 35
  17. 2024Large-Scale 3D Medical Image Pre-training with Geometric Context Priorscited by 34
  18. 2021NuCLS: A scalable crowdsourcing, deep learning approach and dataset for nucleus classification, localization and segmentationcited by 33
  19. 2022WSSS4LUAD: Grand Challenge on Weakly-supervised Tissue Semantic Segmentation for Lung Adenocarcinomacited by 32
  20. 2023BHSD: A 3D Multi-Class Brain Hemorrhage Segmentation Datasetcited by 27
  21. 2024Learning General-Purpose Biomedical Volume Representations using Randomized Synthesiscited by 27
  22. 2023Efficient automatic segmentation for multi-level pulmonary arteries: The PARSE challengecited by 26
  23. 2023Domain generalization across tumor types, laboratories, and species -- insights from the 2022 edition of the Mitosis Domain Generalization Challengecited by 25
  24. 2024Multi-View and Multi-Scale Alignment for Contrastive Language-Image Pre-training in Mammographycited by 9
  25. 2025Segment Anything in Pathology Images with Natural Languagecited by 7

Built on by

Not cited yet.