mlsanityData to 14 Oct 2026

F3-Net: Foundation Model for Full Abnormality Segmentation of Medical Images with Flexible Input Modality Requirement

arXiv 2507.08460 ↗First posted 11 Jul 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

F3-Net is a foundation model designed to overcome persistent challenges in clinical medical image segmentation, including reliance on complete multimodal inputs, limited generalizability, and narrow task specificity. Through flexible synthetic modality training, F3-Net maintains robust performance even in the presence of missing MRI sequences, leveraging a zero-image strategy to substitute absent modalities without relying on explicit synthesis networks, thereby enhancing real-world applicability. Its unified architecture supports multi-pathology segmentation across glioma, metastasis, stroke, and white matter lesions without retraining, outperforming CNN-based and transformer-based models that typically require disease-specific fine-tuning. Evaluated on diverse datasets such as BraTS 2021, BraTS 2024, and ISLES 2022, F3-Net demonstrates strong resilience to domain shifts and clinical heterogeneity. On the whole pathology dataset, F3-Net achieves average Dice Similarity Coefficients (DSCs) of 0.94 for BraTS-GLI 2024, 0.82 for BraTS-MET 2024, 0.94 for BraTS 2021, and 0.79 for ISLES 2022. This positions it as a versatile, scalable solution bridging the gap between deep learning research and practical clinical deployment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 54 references that are in the map. First posted on arXiv 11 Jul 2025.

Builds on

30 of 54 references.

References · 30

  1. 2023Segment Anythingcited by 8,234
  2. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 959
  3. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 830
  4. 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 518
  5. 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 352
  6. 2016Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentationcited by 263
  7. 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 237
  8. 2023Learning to Exploit Temporal Structure for Biomedical Vision-Language Processingcited by 211
  9. 2023MedNeXt: Transformer-driven Scaling of ConvNets for Medical Image Segmentationcited by 162
  10. 2024Medical SAM 2: Segment medical images as video via Segment Anything Model 2cited by 154
  11. 2015Brain Tumor Segmentation with Deep Neural Networkscited by 137
  12. 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
18 more
  1. 2019Automated brain extraction of multi-sequence MRI using artificial neural networkscited by 134
  2. 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Imagescited by 134
  3. 2023SAM-Med3D: Towards General-purpose Segmentation Models for Volumetric Medical Imagescited by 107
  4. 2022ISLES 2022: A multi-center magnetic resonance imaging stroke lesion segmentation datasetcited by 106
  5. 2021GANs for Medical Image Synthesis: An Empirical Studycited by 65
  6. 2017Ensembles of Multiple Models and Architectures for Robust Brain Tumour Segmentationcited by 58
  7. 2023M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing Modalitiescited by 56
  8. 2019Brain Tumor Segmentation on MRI with Missing Modalitiescited by 42
  9. 2023Unified Multi-Modal Image Synthesis for Missing Modality Imputationcited by 40
  10. 2024Foundation Models for Biomedical Image Segmentation: A Surveycited by 28
  11. 2022Shifts 2.0: Extending The Dataset of Real Distributional Shiftscited by 24
  12. 2018Factorised spatial representation learning: application in semi-supervised myocardial segmentationcited by 11
  13. 2023MRI Scan Synthesis Methods based on Clustering and Pix2Pixcited by 6
  14. 2023Generative Adversarial Networks for Brain Images Synthesis: A Reviewcited by 4
  15. 2024Self-supervised 3D Patient Modeling with Multi-modal Attentive Fusioncited by 4
  16. 2021Generative Adversarial Networks (GAN) Powered Fast Magnetic Resonance Imaging -- Mini Review, Comparison and Perspectivescited by 3
  17. 2024Foundation AI Model for Medical Image Segmentationcited by 2
  18. 2025Multi-encoder nnU-Net outperforms transformer models with self-supervised pretrainingcited by 1

Built on by

Not cited yet.