Towards a general-purpose foundation model for fMRI analysis
Not on the map. Why?
Abstract (arXiv)
Functional MRI (fMRI) is crucial for studying brain function and diagnosing neurological disorders. However, existing analysis methods suffer from reproducibility and transferability challenges due to complex preprocessing pipelines and task-specific model designs. In this work, we introduce NeuroSTORM (Neuroimaging Foundation Model with Spatial-Temporal Optimized Representation Modeling) that learns generalizable representations directly from 4D fMRI volumes and enables efficient transfer to diverse downstream applications. Specifically, NeuroSTORM is pre-trained on 28.65 million fMRI frames from over 50,000 subjects, spanning multiple centers and ages 5 to 100. It combines an efficient spatiotemporal modeling design and lightweight task adaptation to enable scalable pre-training and fast transfer to downstream applications. Here we show that NeuroSTORM consistently outperforms existing methods across five downstream tasks, including demographic prediction, phenotype prediction, disease diagnosis, re-identification, and state classification. On two multi-hospital clinical cohorts with 17 diagnoses, NeuroSTORM achieves the best diagnosis performance while remaining predictive of psychological and cognitive phenotypes. These results suggest that NeuroSTORM could become a standardized foundation model for reproducible and transferable fMRI analysis.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 30 of its 71 references that are in the map. First posted on arXiv 11 Jun 2025.
Builds on
30 of 71 references.
References · 30
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
- 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
- 2023Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priorscited by 160
- 2022Seeing Beyond the Brain: Conditional Diffusion Model with Sparse Masked Modeling for Vision Decodingcited by 144
- 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
18 more
- 2024MindEye2: Shared-Subject Models Enable fMRI-To-Image With 1 Hour of Datacited by 109
- 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospectscited by 99
- 2022Brain Network Transformercited by 94
- 2022Mind Reader: Reconstructing complex images from brain activitiescited by 85
- 2024MindBridge: A Cross-Subject Brain Decoding Frameworkcited by 66
- 2024Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Maskingcited by 65
- 2022Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysiscited by 59
- 2022On Data Scaling in Masked Image Modelingcited by 46
- 2023SwiFT: Swin 4D fMRI Transformercited by 36
- 2023Community-Aware Transformer for Autism Prediction in fMRI Connectomecited by 28
- 2020Attend and Decode: 4D fMRI Task State Decoding Using Attention Modelscited by 17
- 2021Self-Supervised Transformers for fMRI representationcited by 17
- 2023AnyStar: Domain randomized universal star-convex 3D instance segmentationcited by 15
- 2024BrainChat: Decoding Semantic Information from fMRI using Vision-language Pretrained Modelscited by 3
- 2024Modality-Agnostic fMRI Decoding of Vision and Languagecited by 2
- 2024Mind-to-Image: Projecting Visual Mental Imagination of the Brain from fMRIcited by 2
- 2024Brain Dialogue Interface (BDI): A User-Friendly fMRI Model for Interactive Brain Decodingcited by 2
- 2023Large-scale Graph Representation Learning of Dynamic Brain Connectome with Transformerscited by 1
Built on by
Citing papers per year: 2025: 8; 2026: 7.
15 papers.
Sort:
By area:
- 2025SLIM-Brain: A Data- and Training-Efficient Foundation Model for fMRI Data Analysiscited by 9
- 2026FlexiBrain: Resolution-Agnostic Voxel-Level Encoding for Native fMRIcited by 6
- 2025Scaling Vision Transformers for Functional MRI with Flat Mapscited by 5
- 2026BrainWorld: A Structural-Prior-Conditioned Generative Model for Whole-Brain 4D fMRI Dynamicscited by 5
- 2025Brain-Semantoks: Learning Semantic Tokens of Brain Dynamics with a Self-Distilled Foundation Modelcited by 4
- 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applicationscited by 3
- 2025From Prediction to Understanding: Will AI Foundation Models Transform Brain Science?cited by 2
- 2025Region-Aware Reconstruction Strategy for Pre-training fMRI Foundation Modelcited by 1
- 2025MAC: Masked Agent Collaboration Boosts Large Language Model Medical Decision-Makingcited by 0
- 2025Expertise-aware Multi-LLM Recruitment and Collaboration for Medical Decision-Makingcited by 0
- 2025Prediction and Causality of functional MRI and synthetic signal using a Zero-Shot Time-Series Foundation Modelcited by 0
- 2026Vascular anatomy-aware self-supervised pre-training for X-ray angiogram analysiscited by 0
3 more
- 2026One Brain, Omni Modalities: Towards Unified Non-Invasive Brain Decoding with Large Language Modelscited by 0
- 2026PIMSM: Physics-Informed Multi-Scale Mamba for Stable Neural Representations under Distribution Shiftcited by 0
- 2026Learning Robust and Task-Invariant Functional Representation from fMRI through Siamese Self-Supervised Learningcited by 0
- 2026BrainWorld: A Structural-Prior-Conditioned Generative Model for Whole-Brain 4D fMRI Dynamics16 Jun 2026
- 2026FlexiBrain: Resolution-Agnostic Voxel-Level Encoding for Native fMRI9 Jun 2026
- 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications28 May 2026
- 2026Learning Robust and Task-Invariant Functional Representation from fMRI through Siamese Self-Supervised Learning27 May 2026
- 2026PIMSM: Physics-Informed Multi-Scale Mamba for Stable Neural Representations under Distribution Shift8 May 2026
- 2026One Brain, Omni Modalities: Towards Unified Non-Invasive Brain Decoding with Large Language Models25 Feb 2026
- 2026Vascular anatomy-aware self-supervised pre-training for X-ray angiogram analysis12 Feb 2026
- 2025SLIM-Brain: A Data- and Training-Efficient Foundation Model for fMRI Data Analysis26 Dec 2025
- 2025Brain-Semantoks: Learning Semantic Tokens of Brain Dynamics with a Self-Distilled Foundation Model12 Dec 2025
- 2025Region-Aware Reconstruction Strategy for Pre-training fMRI Foundation Model1 Nov 2025
- 2025Scaling Vision Transformers for Functional MRI with Flat Maps15 Oct 2025
- 2025From Prediction to Understanding: Will AI Foundation Models Transform Brain Science?21 Sep 2025
3 more
- 2025Prediction and Causality of functional MRI and synthetic signal using a Zero-Shot Time-Series Foundation Model15 Sep 2025
- 2025Expertise-aware Multi-LLM Recruitment and Collaboration for Medical Decision-Making19 Aug 2025
- 2025MAC: Masked Agent Collaboration Boosts Large Language Model Medical Decision-Making25 Jul 2025
- 2025SLIM-Brain: A Data- and Training-Efficient Foundation Model for fMRI Data Analysiscited by 9
- 2025Scaling Vision Transformers for Functional MRI with Flat Mapscited by 5
- 2026BrainWorld: A Structural-Prior-Conditioned Generative Model for Whole-Brain 4D fMRI Dynamicscited by 5
- 2025Brain-Semantoks: Learning Semantic Tokens of Brain Dynamics with a Self-Distilled Foundation Modelcited by 4
- 2025From Prediction to Understanding: Will AI Foundation Models Transform Brain Science?cited by 2
- 2025Region-Aware Reconstruction Strategy for Pre-training fMRI Foundation Modelcited by 1
- 2025Expertise-aware Multi-LLM Recruitment and Collaboration for Medical Decision-Makingcited by 0
- 2025Prediction and Causality of functional MRI and synthetic signal using a Zero-Shot Time-Series Foundation Modelcited by 0
- 2026Vascular anatomy-aware self-supervised pre-training for X-ray angiogram analysiscited by 0
- 2026One Brain, Omni Modalities: Towards Unified Non-Invasive Brain Decoding with Large Language Modelscited by 0
- 2026Learning Robust and Task-Invariant Functional Representation from fMRI through Siamese Self-Supervised Learningcited by 0
- 2026BrainWorld: A Structural-Prior-Conditioned Generative Model for Whole-Brain 4D fMRI Dynamics16 Jun 2026
- 2026Learning Robust and Task-Invariant Functional Representation from fMRI through Siamese Self-Supervised Learning27 May 2026
- 2026One Brain, Omni Modalities: Towards Unified Non-Invasive Brain Decoding with Large Language Models25 Feb 2026
- 2026Vascular anatomy-aware self-supervised pre-training for X-ray angiogram analysis12 Feb 2026
- 2025SLIM-Brain: A Data- and Training-Efficient Foundation Model for fMRI Data Analysis26 Dec 2025
- 2025Brain-Semantoks: Learning Semantic Tokens of Brain Dynamics with a Self-Distilled Foundation Model12 Dec 2025
- 2025Region-Aware Reconstruction Strategy for Pre-training fMRI Foundation Model1 Nov 2025
- 2025Scaling Vision Transformers for Functional MRI with Flat Maps15 Oct 2025
- 2025From Prediction to Understanding: Will AI Foundation Models Transform Brain Science?21 Sep 2025
- 2025Prediction and Causality of functional MRI and synthetic signal using a Zero-Shot Time-Series Foundation Model15 Sep 2025
- 2025Expertise-aware Multi-LLM Recruitment and Collaboration for Medical Decision-Making19 Aug 2025