Free Lunch in Medical Image Foundation Model Pre-training via Randomized Synthesis and Disentanglement
Not on the map. Why?
Abstract (arXiv)
Medical image foundation models (MIFMs) have demonstrated remarkable potential for a wide range of clinical tasks, yet their development is constrained by the scarcity, heterogeneity, and high cost of large-scale annotated datasets. Here, we propose RaSD (Randomized Synthesis and Disentanglement), a scalable framework for pre-training MIFMs entirely on synthetic data. By modeling anatomical structures and appearance variations with randomized Gaussian distributions, RaSD exposes models to sufficient multi-scale structural and appearance perturbations, forcing them to rely on invariant and task-relevant anatomical cues rather than dataset-specific textures, thereby enabling robust and transferable representation learning. We pre-trained RaSD on 1.2 million 3D volumes and 9.6 million 2D images, and extensively evaluated the resulting models across 6 imaging modalities, 48 datasets, and 56 downstream tasks. Across all evaluated downstream tasks, RaSD consistently outperforms training-from-scratch models, achieves the best performance on 17 tasks, and remains comparable to models pre-trained on large real datasets in most others. These results demonstrate that the capacity of synthetic data alone to drive robust representation learning. Our findings establish a paradigm shift in medical AI, demonstrating that synthetic data can serve as a "free lunch" for scalable, privacy-preserving, and clinically generalizable foundation models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 87 references that are in the map. First posted on arXiv 12 Feb 2026.
Builds on
37 of 87 references.
References · 37
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
- 2021The Medical Segmentation Decathloncited by 620
- 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 597
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 507
- 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
- 2022MONAI: An open-source framework for deep learning in healthcarecited by 438
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
25 more
- 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 307
- 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 235
- 2016Gland Segmentation in Colon Histology Images: The GlaS Challenge Contestcited by 203
- 2016Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challengecited by 198
- 2020SynthMorph: learning contrast-invariant registration without acquired imagescited by 137
- 2016Multivariate mixture model for myocardium segmentation combining multi-source imagescited by 133
- 2020VerSe: A Vertebrae Labelling and Segmentation Benchmark for Multi-detector CT Imagescited by 111
- 2023Scaling Laws of Synthetic Images for Model Training ... for Nowcited by 107
- 2018MILD-Net: Minimal Information Loss Dilated Network for Gland Instance Segmentation in Colon Histology Imagescited by 87
- 2022VinDr-Mammo: A large-scale benchmark dataset for computer-aided diagnosis in full-field digital mammographycited by 83
- 2024Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directionscited by 77
- 2024VoCo: A Simple-yet-Effective Volume Contrastive Learning Framework for 3D Medical Image Analysiscited by 71
- 2023LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matchingcited by 60
- 2024A Multimodal Vision Foundation Model for Clinical Dermatologycited by 49
- 2023Geometric Visual Similarity Learning in 3D Medical Image Self-supervised Pre-trainingcited by 36
- 2024Mammo-CLIP: A Vision Language Foundation Model to Enhance Data Efficiency and Robustness in Mammographycited by 35
- 2024Large-Scale 3D Medical Image Pre-training with Geometric Context Priorscited by 34
- 2021NuCLS: A scalable crowdsourcing, deep learning approach and dataset for nucleus classification, localization and segmentationcited by 33
- 2022WSSS4LUAD: Grand Challenge on Weakly-supervised Tissue Semantic Segmentation for Lung Adenocarcinomacited by 32
- 2023BHSD: A 3D Multi-Class Brain Hemorrhage Segmentation Datasetcited by 27
- 2024Learning General-Purpose Biomedical Volume Representations using Randomized Synthesiscited by 27
- 2023Efficient automatic segmentation for multi-level pulmonary arteries: The PARSE challengecited by 26
- 2023Domain generalization across tumor types, laboratories, and species -- insights from the 2022 edition of the Mitosis Domain Generalization Challengecited by 25
- 2024Multi-View and Multi-Scale Alignment for Contrastive Language-Image Pre-training in Mammographycited by 9
- 2025Segment Anything in Pathology Images with Natural Languagecited by 7
Built on by
Not cited yet.