BrainTaskonomy: Learning How to Pretrain and What to Transfer in fMRI Foundation Models
Not on the map. Why?
Abstract (arXiv)
fMRI foundation models increasingly aggregate heterogeneous data across brain states, cohorts, and acquisition settings, yet pretraining domains are commonly treated as a flat mixture and downstream tasks are adapted independently. We study whether measured learning relations can organize both stages without modifying the backbone. During pretraining, a lightweight Brain-DiT proxy estimates difficulty and directed facilitation across ten fMRI domains, yielding a priority-guided cumulative domain curriculum combined with high-to-low-noise timestep scheduling and joint consolidation. During adaptation, controlled first- and higher-order transfer across fifteen tasks constructs a directed taskonomy, from which budgeted integer programming (BIP) selects directly supervised source tasks and target-specific routes. The joint priority-domain and high-to-low-timestep curriculum reduces v-NMSE, PSD-NMSE, and FC-MSE by 6.5%, 16.3%, and 10.5%, respectively, relative to uniform sampling over both dimensions, and shows strong downstream performance across six in- and out-of-domain tasks. The taskonomy reveals asymmetric, target-dependent transfer, while exploratory sealed-test evaluation shows larger descriptive gains for BIP policies when higher-order route spaces are available than for matched random controls. Together, these findings support organizing fMRI pretraining and adaptation by measured learning relations rather than treating domains and tasks as independent flat sets.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 31 references that are in the map. First posted on arXiv 9 Sep 2026.
Builds on
16 of 31 references.
References · 16
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
- 2019Which Tasks Should Be Learned Together in Multi-task Learning?cited by 375
- 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
- 2021Efficiently Identifying Task Groupings for Multi-Task Learningcited by 222
- 2024RegMix: Data Mixture as Regression for Language Model Pre-trainingcited by 177
- 2023Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Modelscited by 121
- 2023DoGE: Domain Reweighting with Generalization Estimationcited by 90
- 2024Denoising Task Difficulty-based Curriculum for Training Diffusion Modelscited by 27
- 2025CineBrain: A Large-Scale Multi-Modal Brain Dataset During Naturalistic Audiovisual Narrative Processingcited by 11
- 2026Omni-fMRI: A Universal Atlas-Free fMRI Foundation Modelcited by 11
- 2026Brain-DiT: A Universal Multi-state fMRI Foundation Model with Metadata-Conditioned Pretrainingcited by 11
- 2024Uncovering cognitive taskonomy through transfer learning in masked autoencoder-based fMRI reconstructioncited by 7
4 more
- 2026FlexiBrain: Resolution-Agnostic Voxel-Level Encoding for Native fMRIcited by 6
- 2025Adopting a human developmental visual diet yields robust, shape-based AI visioncited by 5
- 2026BrainWorld: A Structural-Prior-Conditioned Generative Model for Whole-Brain 4D fMRI Dynamicscited by 5
- 2026Beyond Single-Source Cognitive Taskonomy:Multi-Source Task Relations through fMRI Transfer Learningcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026A Scaling Study for fMRI Foundation Modelscited by 0
- 2026A Scaling Study for fMRI Foundation Models23 Sep 2026