mlsanityData to 14 Oct 2026

Brain Imaging Foundation Models, Are We There Yet? A Systematic Review of Foundation Models for Brain Imaging and Biomedical Research

arXiv 2506.13306 ↗First posted 16 Jun 2025eess.IV cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Foundation models (FMs), large neural networks pretrained on extensive and diverse datasets, have revolutionized artificial intelligence and shown significant promise in medical imaging by enabling robust performance with limited labeled data. Although numerous surveys have reviewed the application of FM in healthcare care, brain imaging remains underrepresented, despite its critical role in the diagnosis and treatment of neurological diseases using modalities such as MRI, CT, and PET. Existing reviews either marginalize brain imaging or lack depth on the unique challenges and requirements of FM in this domain, such as multimodal data integration, support for diverse clinical tasks, and handling of heterogeneous, fragmented datasets. To address this gap, we present the first comprehensive and curated review of FMs for brain imaging. We systematically analyze 161 brain imaging datasets and 86 FM architectures, providing information on key design choices, training paradigms, and optimizations driving recent advances. Our review highlights the leading models for various brain imaging tasks, summarizes their innovations, and critically examines current limitations and blind spots in the literature. We conclude by outlining future research directions to advance FM applications in brain imaging, with the aim of fostering progress in both clinical and research settings.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 68 of its 164 references that are in the map. First posted on arXiv 16 Jun 2025.

Builds on

68 of 164 references.

References · 68

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2023Segment Anythingcited by 8,234
  5. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  6. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,631
  7. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  8. 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 613
  9. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
  10. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 392
  11. 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 338
  12. 2019Med3D: Transfer Learning for 3D Medical Image Analysiscited by 288
38 more
  1. 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detectioncited by 271
  2. 2023PMC-CLIP: Contrastive Language-Image Pre-training using Biomedical Documentscited by 212
  3. 2023BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Taskscited by 201
  4. 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 163
  5. 2019Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysiscited by 159
  6. 2024Medical SAM 2: Segment medical images as video via Segment Anything Model 2cited by 154
  7. 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
  8. 2023MedSegDiff-V2: Diffusion based Medical Image Segmentation with Transformercited by 124
  9. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 124
  10. 2024Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Modelscited by 116
  11. 2023SAM-Med3D: Towards General-purpose Segmentation Models for Volumetric Medical Imagescited by 107
  12. 2022Multi-Modal Masked Autoencoders for Medical Vision-and-Language Pre-Trainingcited by 104
  13. 2023STU-Net: Scalable and Transferable Medical Image Segmentation Models Empowered by Large-Scale Supervised Pre-trainingcited by 100
  14. 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directionscited by 97
  15. 2023Sparse Low-rank Adaptation of Pre-trained Language Modelscited by 96
  16. 2021Pre-trained Language Models in Biomedical Domain: A Systematic Surveycited by 87
  17. 2023SegVol: Universal and Interactive Volumetric Medical Image Segmentationcited by 87
  18. 2024Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directionscited by 77
  19. 2023Foundational Models in Medical Imaging: A Comprehensive Survey and Future Visioncited by 76
  20. 2022BrainGB: A Benchmark for Brain Network Analysis with Graph Neural Networkscited by 75
  21. 2024VoCo: A Simple-yet-Effective Volume Contrastive Learning Framework for 3D Medical Image Analysiscited by 75
  22. 2020MedICaT: A Dataset of Medical Images, Captions, and Textual Referencescited by 71
  23. 2021MMBERT: Multimodal BERT Pretraining for Improved Medical VQAcited by 68
  24. 2022Medical Image Understanding with Pretrained Vision Language Models: A Comprehensive Studycited by 66
  25. 2023Qilin-Med-VL: Towards Chinese Large Vision-Language Model for General Healthcarecited by 62
  26. 2023Large AI Models in Health Informatics: Applications, Challenges, and the Futurecited by 61
  27. 2023LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matchingcited by 60
  28. 2023Open-Ended Medical Visual Question Answering Through Prefix Tuning of Language Modelscited by 58
  29. 2024ROCOv2: Radiology Objects in COntext Version 2, an Updated Multimodal Image Datasetcited by 54
  30. 2023MedBLIP: Bootstrapping Language-Image Pre-training from 3D Medical Images and Textscited by 51
  31. 2023ScribblePrompt: Fast and Flexible Interactive Segmentation for Any Biomedical Imagecited by 48
  32. 2024BrainSegFounder: Towards 3D Foundation Models for Neuroimage Segmentationcited by 39
  33. 2024MedCLIP-SAMv2: Towards Universal Text-Driven Medical Image Segmentationcited by 39
  34. 2023Geometric Visual Similarity Learning in 3D Medical Image Self-supervised Pre-trainingcited by 37
  35. 2023Towards Unifying Medical Vision-and-Language Pre-training via Soft Promptscited by 36
  36. 2024Foundation Models for Biomedical Image Segmentation: A Surveycited by 28
  37. 2024Data-Centric Foundation Models in Computational Healthcare: A Surveycited by 27
  38. 2023MIS-FM: 3D Medical Image Segmentation using Foundation Models Pretrained on a Large-Scale Unannotated Datasetcited by 26

50 most cited of 68 All 68 (JSON)

Built on by

Not cited yet.