A continually expandable foundation model for brain MRI
Not on the map. Why?
Abstract (arXiv)
Brain magnetic resonance imaging (MRI) is central to neuroscience and clinical assessment, but models are commonly developed for individual diseases, populations or imaging protocols. Foundation models promise more general representations, yet they are usually pretrained once and can lose earlier capabilities when updated with new data. Here we show that Alcmaeon, a three-dimensional brain MRI foundation model pretrained without manual labels on more than 425,000 volumes and derived imaging maps, can be expanded sequentially across clinical domains. Alcmaeon combines volumetric encoding and latent diffusion generation with Graph-Blueprint Pruning (GBP), which protects network modules important to earlier domains while leaving the remaining capacity trainable. Across expansion from healthy ageing and neurodegeneration to developmental, psychiatric and tumour imaging, GBP showed less forgetting than sequential adaptation and elastic weight consolidation across voxel-level reconstruction measures, with its largest advantage after adaptation to tumour imaging. The blueprints provided an inspectable record of how model capacity was protected and reused. Representations from different model levels supported image synthesis, disease classification, survival modelling and postoperative prediction, although no single representation was optimal for every task. These findings provide a route towards brain MRI foundation models that can grow with emerging data while retaining earlier capabilities.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 49 references that are in the map. First posted on arXiv 8 Aug 2026.
Builds on
22 of 49 references.
References · 22
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
- 2018Overcoming catastrophic forgetting with hard attention to the taskcited by 681
- 2020Linear Mode Connectivity in Multitask and Continual Learningcited by 145
- 2019Automated brain extraction of multi-sequence MRI using artificial neural networkscited by 134
- 2022What is Healthy? Generative Counterfactual Diffusion for Lesion Localizationcited by 52
10 more
- 2023The Brain Tumor Segmentation (BraTS) Challenge 2023: Focus on Pediatrics (CBTN-CONNECT-DIPGR-ASNR-MICCAI BraTS-PEDs)cited by 49
- 2023The Brain Tumor Segmentation (BraTS-METS) Challenge 2023: Brain Metastasis Segmentation on Pre-treatment MRIcited by 36
- 2024An OpenMind for 3D medical vision self-supervised learningcited by 26
- 2025Flow Matching for Medical Image Synthesis: Bridging the Gap Between Speed and Qualitycited by 25
- 2025Towards Scalable Language-Image Pre-training for 3D Medical Imagingcited by 14
- 2022Counterfactual Image Synthesis for Discovery of Personalized Predictive Image Markerscited by 10
- 2025Building a General SimCLR Self-Supervised Foundation Model Across Neurological Diseases to Advance 3D Brain MRI Diagnosescited by 10
- 2025Learning without Isolation: Pathway Protection for Continual Learningcited by 6
- 2026BrainDINO: A Brain MRI Foundation Model for Generalizable Clinical Representation Learningcited by 4
- 2021Predicting survival of glioblastoma from automatic whole-brain and tumor segmentation of MR imagescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Anatomically-conditioned Latent Diffusion Model for Data-Efficient Few-Shot Cross-Domain 3D Glioma MRI Synthesis
- 2025Deep generative priors for 3D brain analysis
- 2024TADM: Temporally-Aware Diffusion Model for Neurodegenerative Progression on Brain MRI
- 20264DLoG: Generative Modeling of Neurodegenerative Brain Anatomy with 4D Longitudinal Diffusion Model
- 2026CLIMB: Controllable Longitudinal Brain Image Generation using Mamba-based Latent Diffusion Model and Gaussian-aligned Autoencoder
- 2025Lesion-Aware Post-Training of Latent Diffusion Models for Synthesizing Diffusion MRI from CT Perfusion
- 2025Diffusion Models for conditional MRI generation
- 2024Enhancing Spatiotemporal Disease Progression Models via Latent Diffusion and Prior Knowledge