mlsanityData to 14 Oct 2026

RegionFM: Interpretable Region-Based Brain MRI Classification Using Foundation Model Embeddings

arXiv 2607.16325 ↗First posted 15 Jul 2026cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Foundation models provide powerful representations for brain MRI analysis, but their predictions remain difficult to interpret in anatomically meaningful terms. Clinical assessment of brain MRI is commonly organized around anatomically defined structures and regional abnormalities, whereas conventional explanation methods typically produce voxel- or patch-level importance maps that do not explicitly quantify the contributions of individual brain regions. To address this mismatch, we propose RegionFM, an interpretable framework that integrates anatomical segmentation with brain MRI foundation-model embeddings. RegionFM first divides each MRI scan into anatomical regions and constructs a separate MRI volume for each region. A frozen foundation model then encodes each region into an embedding, and a region-additive logistic model combines these embeddings such that every anatomical region contributes an explicit scalar term to the final prediction. This formulation supports both subject-level and cohort-level analyses of regional contributions. We evaluate RegionFM on cognitive-impairment classification using embeddings from multiple pretrained brain MRI foundation models. The results show that RegionFM maintains performance comparable to less interpretable fine-tuning approaches while providing anatomically grounded explanations. Randomized embedding ablations yield near-chance performance, indicating that the predictions rely on meaningful structure captured by the foundation-model embeddings rather than simple feature statistics. Overall, RegionFM better aligns model explanations with anatomy-based clinical reasoning while maintaining competitive predictive performance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 3 of its 16 references that are in the map. First posted on arXiv 15 Jul 2026.

Builds on

3 of 16 references.

References · 3

  1. 2020Neural Additive Models: Interpretable Machine Learning with Neural Netscited by 319
  2. 2019FastSurfer -- A fast and accurate deep learning based neuroimaging pipelinecited by 112
  3. 2026Learning Sparse Latent Predictive Foundation Model for Multimodal Neuroimagingcited by 4

Built on by

Not cited yet.